{"id":1502,"date":"2018-01-04T15:01:30","date_gmt":"2018-01-04T09:31:30","guid":{"rendered":"http:\/\/pramodsingla.com\/?p=1502"},"modified":"2018-01-04T15:01:30","modified_gmt":"2018-01-04T09:31:30","slug":"exam-70-776-perform-big-data-engineering-on-microsoft-cloud-services-2","status":"publish","type":"post","link":"https:\/\/pramodsingla.com\/?p=1502","title":{"rendered":"Exam 70-776: Perform Big Data Engineering on Microsoft Cloud Services"},"content":{"rendered":"<p><strong>Design and Implement Complex Event Processing By Using Azure Stream Analytics (15-20%)<\/strong><\/p>\n<ul>\n<li>Ingest data for real-time processing\n<ul>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/stream-analytics\/stream-analytics-introduction\" target=\"_blank\" rel=\"noopener\">What is Stream Analytics?<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/stream-analytics\/stream-analytics-get-started-with-azure-stream-analytics-to-process-data-from-iot-devices\" target=\"_blank\" rel=\"noopener\">Get started with Azure Stream Analytics to process data from IoT devices<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/stream-analytics\/stream-analytics-comparison-storm\" target=\"_blank\" rel=\"noopener\">Choosing a streaming analytics platform: comparing Apache Storm and Azure Stream Analytics<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/stream-analytics\/stream-analytics-define-inputs\" target=\"_blank\" rel=\"noopener\">Data connection: Learn about data stream inputs from events to Stream Analytics<\/a><\/li>\n<li><a href=\"https:\/\/blogs.msdn.microsoft.com\/streamanalytics\/2017\/08\/24\/event-processing-ordering-design-choices-for-azure-stream-analytics\/\" target=\"_blank\" rel=\"noopener\">Event Processing Ordering Design Choices for Azure Stream Analytics<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/stream-analytics\/stream-analytics-define-outputs\" target=\"_blank\" rel=\"noopener\">Stream Analytics outputs: Options for storage, analysis<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/stream-analytics\/stream-analytics-twitter-sentiment-analysis-trends\" target=\"_blank\" rel=\"noopener\">Real-time Twitter sentiment analysis in Azure Stream Analytics<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/stream-analytics\/stream-analytics-scale-jobs\" target=\"_blank\" rel=\"noopener\">Scale Azure Stream Analytics jobs to increase stream data processing throughput<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/stream-analytics\/stream-analytics-streaming-unit-consumption\" target=\"_blank\" rel=\"noopener\">Optimize your job to use Streaming Units efficiently<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/stream-analytics\/stream-analytics-use-reference-data\" target=\"_blank\" rel=\"noopener\">Using reference data or lookup tables in a Stream Analytics input stream<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Design and implement Azure Stream Analytics\n<ul>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/stream-analytics\/stream-analytics-how-to-configure-azure-machine-learning-endpoints-in-stream-analytics\" target=\"_blank\" rel=\"noopener\">Machine Learning integration in Stream Analytics<\/a><\/li>\n<li><a href=\"https:\/\/esciencegroup.com\/2015\/12\/09\/streaming-events-to-azureml-through-azure-stream-analytics\/\" target=\"_blank\" rel=\"noopener\">Streaming Events to AzureML Through Azure Stream Analytics<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/stream-analytics\/stream-analytics-set-up-alerts\" target=\"_blank\" rel=\"noopener\">Set up alerts for Azure Stream Analytics jobs<\/a><\/li>\n<li><a href=\"https:\/\/blogs.msdn.microsoft.com\/streamanalytics\/2017\/01\/18\/processing-configurable-threshold-based-rules-in-azure-stream-analytics\/\" target=\"_blank\" rel=\"noopener\">Processing Configurable Threshold Based Rules in Azure Stream Analytics<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/monitoring-and-diagnostics\/insights-alerts-portal\" target=\"_blank\" rel=\"noopener\">Create metric alerts in Azure Monitor for Azure services &#8211; Azure portal<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/stream-analytics\/stream-analytics-machine-learning-integration-tutorial\" target=\"_blank\" rel=\"noopener\">Performing sentiment analysis by using Azure Stream Analytics and Azure Machine Learning<\/a><\/li>\n<li><a href=\"https:\/\/azure.microsoft.com\/en-us\/blog\/machine-learning-based-anomaly-detection-in-azure-stream-analytics\/\" target=\"_blank\" rel=\"noopener\">Machine Learning-based anomaly detection in Azure Stream Analytics<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Implement and manage the streaming pipeline\n<ul>\n<li><a href=\"https:\/\/azure.microsoft.com\/en-us\/resources\/videos\/realtime-scoring-with-azure-stream-analytics\/\" target=\"_blank\" rel=\"noopener\">Realtime scoring with Azure Stream Analytics<\/a><\/li>\n<li><a href=\"https:\/\/azure.microsoft.com\/en-us\/blog\/improved-troubleshooting-in-azure-stream-analytics-with-diagnostic-logs\/\" target=\"_blank\" rel=\"noopener\">Improved troubleshooting in Azure Stream Analytics with diagnostic logs<\/a><\/li>\n<li><a href=\"https:\/\/channel9.msdn.com\/Events\/TechEd\/Europe\/2014\/DBI-B316\" target=\"_blank\" rel=\"noopener\">Introducing Azure Stream Analytics: Processing on Near-Realtime Data<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Query real-time data by using the Azure Stream Analytics query language\n<ul>\n<li><a href=\"https:\/\/msdn.microsoft.com\/en-us\/library\/azure\/dn834998.aspx\" target=\"_blank\" rel=\"noopener\">Stream Analytics Query Language Reference<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/stream-analytics\/stream-analytics-stream-analytics-query-patterns\" target=\"_blank\" rel=\"noopener\">Query examples for common Stream Analytics usage patterns<\/a><\/li>\n<li><a href=\"https:\/\/azure.microsoft.com\/en-us\/resources\/videos\/deep-dive-azure-stream-analytics-query-language\/\" target=\"_blank\" rel=\"noopener\">Deep Dive: Azure Stream Analytics Query Language<\/a><\/li>\n<li><a href=\"https:\/\/msdn.microsoft.com\/en-us\/library\/azure\/dn835030.aspx\" target=\"_blank\" rel=\"noopener\">Built-in Functions (Azure Stream Analytics)<\/a><\/li>\n<li><a href=\"https:\/\/msdn.microsoft.com\/en-us\/library\/azure\/dn835065.aspx\" target=\"_blank\" rel=\"noopener\">Data Types (Azure Stream Analytics)<\/a><\/li>\n<li><a href=\"https:\/\/msdn.microsoft.com\/en-us\/library\/azure\/mt573293.aspx\" target=\"_blank\" rel=\"noopener\">TIMESTAMP BY (Azure Stream Analytics)<\/a><\/li>\n<li><a href=\"https:\/\/msdn.microsoft.com\/en-us\/library\/azure\/mt721300.aspx\" target=\"_blank\" rel=\"noopener\">Event Delivery Guarantees (Azure Stream Analytics)<\/a><\/li>\n<li><a href=\"https:\/\/blogs.msdn.microsoft.com\/streamanalytics\/2017\/01\/13\/how-to-achieve-exactly-once-delivery-for-sql-output\/\" target=\"_blank\" rel=\"noopener\">How to achieve exactly-once delivery for SQL output<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><strong>Design and Implement Analytics by Using Azure Data Lake (25-30%)<\/strong><\/p>\n<ul>\n<li>Ingest data into Azure Data Lake Store\n<ul>\n<li><a href=\"https:\/\/azure.microsoft.com\/en-us\/resources\/videos\/data-lake-store-primer\/\" target=\"_blank\" rel=\"noopener\">Introduction to Azure Data Lake Store<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-store\/data-lake-store-get-started-portal\" target=\"_blank\" rel=\"noopener\">Get started with Azure Data Lake Store using the Azure portal<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-store\/data-lake-store-get-started-powershell\" target=\"_blank\" rel=\"noopener\">Get started with Azure Data Lake Store using Azure PowerShell<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-store\/data-lake-store-get-started-net-sdk\" target=\"_blank\" rel=\"noopener\">Get started with Azure Data Lake Store using .NET SDK<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-azure-datalake-connector\" target=\"_blank\" rel=\"noopener\">Copy data to and from Data Lake Store by using Data Factory<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-store\/data-lake-store-copy-data-azure-storage-blob\" target=\"_blank\" rel=\"noopener\">Copy data from Azure Storage Blobs to Data Lake Store<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-store\/data-lake-store-copy-data-wasb-distcp\" target=\"_blank\" rel=\"noopener\">Use Distcp to copy data between Azure Storage Blobs and Data Lake Store<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-store\/data-lake-store-data-transfer-sql-sqoop\" target=\"_blank\" rel=\"noopener\">Copy data between Data Lake Store and Azure SQL database using Sqoop<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-store\/data-lake-store-offline-bulk-data-upload\" target=\"_blank\" rel=\"noopener\">Use the Azure Import\/Export service for offline copy of data to Data Lake Store<\/a><\/li>\n<li><a href=\"https:\/\/channel9.msdn.com\/Series\/AzureDataLake\/ADL-Security\" target=\"_blank\" rel=\"noopener\">Azure Data Lake &#8211; Security Essentials<\/a><\/li>\n<li><a href=\"https:\/\/www.analytix-unboxed.com\/securing-azure-data-lake-store\/\" target=\"_blank\" rel=\"noopener\">Securing Azure Data Lake Store<\/a><\/li>\n<li><a href=\"https:\/\/azure.microsoft.com\/en-us\/blog\/the-intelligent-data-lake\/\" target=\"_blank\" rel=\"noopener\">The Intelligent Data Lake<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-store\/data-lake-store-performance-tuning-guidance\" target=\"_blank\" rel=\"noopener\">Tuning Azure Data Lake Store for performance<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-store\/data-lake-store-diagnostic-logs\" target=\"_blank\" rel=\"noopener\">Accessing diagnostic logs for Azure Data Lake Store<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Manage Azure Data Lake Analytics\n<ul>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-analytics\/data-lake-analytics-overview\" target=\"_blank\" rel=\"noopener\">Overview of Microsoft Azure Data Lake Analytics<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-analytics\/data-lake-analytics-get-started-portal\" target=\"_blank\" rel=\"noopener\">Get started with Azure Data Lake Analytics using Azure portal<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-analytics\/data-lake-analytics-manage-use-portal\" target=\"_blank\" rel=\"noopener\">Manage Azure Data Lake Analytics by using the Azure portal<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-analytics\/data-lake-analytics-manage-use-cli\" target=\"_blank\" rel=\"noopener\">Manage Azure Data Lake Analytics using Azure Command-line Interface (CLI)<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-analytics\/data-lake-analytics-manage-use-powershell\" target=\"_blank\" rel=\"noopener\">Manage Azure Data Lake Analytics using Azure PowerShell<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-analytics\/data-lake-analytics-manage-use-python-sdk\" target=\"_blank\" rel=\"noopener\">Manage Azure Data Lake Analytics using Python<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-analytics\/data-lake-analytics-quota-limits\" target=\"_blank\" rel=\"noopener\">Azure Data Lake Analytics Quota Limits<\/a><\/li>\n<li><a href=\"https:\/\/channel9.msdn.com\/Series\/AzureDataLake\/ADL-DevTools\" target=\"_blank\" rel=\"noopener\">Azure Data Lake Developer Tools<\/a><\/li>\n<li><a href=\"https:\/\/www.red-gate.com\/simple-talk\/cloud\/cloud-data\/azure-data-lakes\/\" target=\"_blank\" rel=\"noopener\">Azure Data Lakes<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-analytics\/data-lake-analytics-monitor-and-troubleshoot-jobs-tutorial\" target=\"_blank\" rel=\"noopener\">Troubleshoot Azure Data Lake Analytics jobs using Azure Portal<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-analytics\/data-lake-analytics-data-lake-tools-view-jobs\" target=\"_blank\" rel=\"noopener\">Use Job Browser and Job View for Azure Data lake Analytics jobs<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-analytics\/data-lake-analytics-data-lake-tools-use-vertex-execution-view\" target=\"_blank\" rel=\"noopener\">Use the Vertex Execution View in Data Lake Tools for Visual Studio<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Extract and transform data by using U-SQL\n<ul>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-analytics\/data-lake-analytics-u-sql-programmability-guide\" target=\"_blank\" rel=\"noopener\">U-SQL programmability guide<\/a><\/li>\n<li><a href=\"http:\/\/www.sqlservercentral.com\/stairway\/142480\/\" target=\"_blank\" rel=\"noopener\">Stairway to U-SQL<\/a><\/li>\n<li><a href=\"https:\/\/msdn.microsoft.com\/en-us\/library\/azure\/mt621297.aspx\" target=\"_blank\" rel=\"noopener\">Data Types and Literals (U-SQL)<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-analytics\/data-lake-analytics-u-sql-develop-user-defined-operators\" target=\"_blank\" rel=\"noopener\">Develop U-SQL user-defined operators (UDOs)<\/a><\/li>\n<li><a href=\"https:\/\/msdn.microsoft.com\/en-us\/library\/azure\/mt621316.aspx\" target=\"_blank\" rel=\"noopener\">Extending U-SQL Expressions with User-Code<\/a><\/li>\n<li><a href=\"https:\/\/blogs.msdn.microsoft.com\/visualstudio\/2015\/09\/28\/introducing-u-sql-a-language-that-makes-big-data-processing-easy\/\" target=\"_blank\" rel=\"noopener\">Introducing U-SQL \u2013 A Language that makes Big Data Processing Easy<\/a><\/li>\n<li><a href=\"http:\/\/www.sqlservercentral.com\/articles\/U-SQL\/145032\/\" target=\"_blank\" rel=\"noopener\">Stairway to U-SQL Level 8: Joining Tables in U-SQL<\/a><\/li>\n<li><a href=\"http:\/\/www.sqlservercentral.com\/articles\/U-SQL\/146839\/\" target=\"_blank\" rel=\"noopener\">Stairway to U-SQL Level 10: Table-Valued Functions and UDTs<\/a><\/li>\n<li><a href=\"http:\/\/www.sqlservercentral.com\/articles\/Azure\/161158\/\" target=\"_blank\" rel=\"noopener\">Stairway to U-SQL Level 16: The Azure Data Lake Catalog<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-analytics\/data-lake-analytics-u-sql-catalog\" target=\"_blank\" rel=\"noopener\">Get started with the U-SQL Catalog<\/a><\/li>\n<li><a href=\"https:\/\/msdn.microsoft.com\/en-us\/library\/azure\/mt621364.aspx\" target=\"_blank\" rel=\"noopener\">U-SQL Assemblies<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Extend U-SQL programmability\n<ul>\n<li><a href=\"https:\/\/blogs.msdn.microsoft.com\/visualstudio\/2015\/10\/28\/writing-and-using-custom-code-in-u-sql-user-defined-functions\/\" target=\"_blank\" rel=\"noopener\">Writing and Using Custom Code in U-SQL \u2013 User-Defined Functions<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-analytics\/data-lake-analytics-u-sql-python-extensions\" target=\"_blank\" rel=\"noopener\">Tutorial: Get started with extending U-SQL with Python<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-analytics\/data-lake-analytics-u-sql-r-extensions\" target=\"_blank\" rel=\"noopener\">Tutorial: Get started with extending U-SQL with R<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-analytics\/data-lake-analytics-u-sql-cognitive\" target=\"_blank\" rel=\"noopener\">Tutorial: Get started with the Cognitive capabilities of U-SQL<\/a><\/li>\n<li><a href=\"https:\/\/es.slideshare.net\/MichaelRys\/usql-federated-distributed-queries-sqlbits-2016\" target=\"_blank\" rel=\"noopener\">U-SQL Federated Distributed Queries (SQLBits 2016)<\/a><\/li>\n<li><a href=\"http:\/\/sqlblog.com\/blogs\/jorg_klein\/archive\/2016\/06\/17\/setup-azure-data-lake-analytics-federated-u-sql-queries-to-azure-sql-database.aspx\" target=\"_blank\" rel=\"noopener\">Setup Azure Data Lake Analytics federated U-SQL queries to Azure SQL Database<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Integrate Azure Data Lake Analytics with other services\n<ul>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-usql-activity\" target=\"_blank\" rel=\"noopener\">Transform data by running U-SQL scripts on Azure Data Lake Analytics<\/a><\/li>\n<li><a href=\"https:\/\/blogs.msdn.microsoft.com\/azuredatalake\/\" target=\"_blank\" rel=\"noopener\">Azure Data Lake &amp; Azure HDInsight Blog<\/a><\/li>\n<li><a href=\"https:\/\/azure.microsoft.com\/en-in\/blog\/creating-big-data-pipelines-using-azure-data-lake-and-azure-data-factory\/\" target=\"_blank\" rel=\"noopener\">Creating big data pipelines using Azure Data Lake and Azure Data Factory<\/a><\/li>\n<li><a href=\"https:\/\/azure.microsoft.com\/en-us\/blog\/azure-data-lake-now-integrated-with-azure-data-catalog\/\" target=\"_blank\" rel=\"noopener\">Azure Data Lake now integrated with Azure Data Catalog<\/a><\/li>\n<li><a href=\"https:\/\/azure.microsoft.com\/en-us\/resources\/videos\/build-2016-azure-data-lake-and-azure-data-warehouse-applying-modern-practices-to-your-app\/\" target=\"_blank\" rel=\"noopener\">Azure Data Lake and Azure Data Warehouse: Applying Modern Practices to Your App<\/a><\/li>\n<li><a href=\"https:\/\/blogs.msdn.microsoft.com\/azuredatalake\/2017\/08\/28\/directly-store-streaming-data-into-azure-data-lake-with-azure-event-hubs-capture-provider\/\" target=\"_blank\" rel=\"noopener\">Directly store streaming data into Azure Data Lake with Azure Event Hubs Capture Provider<\/a><\/li>\n<li><a href=\"http:\/\/anthonychu.ca\/post\/event-hubs-archive-azure-data-lake-analytics-usql\/\" target=\"_blank\" rel=\"noopener\">Query Event Hubs Archive with Azure Data Lake Analytics and U-SQL<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><strong>Design and Implement Azure SQL Data Warehouse Solutions (15-20%)<\/strong><\/p>\n<ul>\n<li>Design tables in Azure SQL Data Warehouse\n<ul>\n<li><a href=\"http:\/\/www.sqlservercentral.com\/articles\/SQL\/149761\/\" target=\"_blank\" rel=\"noopener\">Azure DWH part 1:Common questions about Azure SQL Data Warehouse<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-tables-distribute\" target=\"_blank\" rel=\"noopener\">Distributing tables in SQL Data Warehouse<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-tables-overview\" target=\"_blank\" rel=\"noopener\">Overview of tables in SQL Data Warehouse<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-distributed-data\" target=\"_blank\" rel=\"noopener\">Distributed data and distributed tables for Massively Parallel Processing (MPP)<\/a><\/li>\n<li><a href=\"https:\/\/azure.microsoft.com\/fr-fr\/blog\/clustered-columnstore-tables-are-the-new-default-in-azure-sql-data-warehouse\/\" target=\"_blank\" rel=\"noopener\">Clustered Columnstore Tables are the New Default in Azure SQL Data Warehouse<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/sql\/relational-databases\/indexes\/columnstore-indexes-overview\" target=\"_blank\" rel=\"noopener\">Columnstore indexes &#8211; overview<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Query data in Azure SQL Data Warehouse\n<ul>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-develop-label\" target=\"_blank\" rel=\"noopener\">Use labels to instrument queries in SQL Data Warehouse<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/sql\/t-sql\/functions\/aggregate-functions-transact-sql\" target=\"_blank\" rel=\"noopener\">Aggregate Functions (Transact-SQL)<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-tables-statistics\" target=\"_blank\" rel=\"noopener\">Managing statistics on tables in SQL Data Warehouse<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-overview-manage-user-queries\" target=\"_blank\" rel=\"noopener\">Monitor user queries in Azure SQL Data Warehouse<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-manage-monitor\" target=\"_blank\" rel=\"noopener\">Monitor your workload using DMVs<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-memory-optimizations-for-columnstore-compression\" target=\"_blank\" rel=\"noopener\">Maximizing rowgroup quality for columnstore<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-develop-concurrency\" target=\"_blank\" rel=\"noopener\">Concurrency and workload management in SQL Data Warehouse<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Integrate Azure SQL Data Warehouse with other services\n<ul>\n<li><a href=\"http:\/\/www.sqlservercentral.com\/articles\/data\/160522\/\" target=\"_blank\" rel=\"noopener\">Azure DWH part 15: PolyBase and Azure Data Lake<\/a><\/li>\n<li><a href=\"http:\/\/www.sqlservercentral.com\/articles\/PolyBase\/160452\/\" target=\"_blank\" rel=\"noopener\">Azure DWH part 14: PolyBase to access to Non relational data<\/a><\/li>\n<li><a href=\"http:\/\/www.sqlservercentral.com\/articles\/Integration+Services+(SSIS)\/152373\/\" target=\"_blank\" rel=\"noopener\">Azure DWH part 4: How to import data to Azure DWH using SSIS<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-overview-load\" target=\"_blank\" rel=\"noopener\">Load data into Azure SQL Data Warehouse<\/a><\/li>\n<li><a href=\"http:\/\/www.sqlservercentral.com\/articles\/Azure\/141822\/\" target=\"_blank\" rel=\"noopener\">Azure Machine Learning &#8211; Your first experiment<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-develop-ctas\" target=\"_blank\" rel=\"noopener\">Create Table As Select (CTAS) in SQL Data Warehouse<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/sql\/t-sql\/statements\/create-external-table-as-select-transact-sql\" target=\"_blank\" rel=\"noopener\">CREATE EXTERNAL TABLE AS SELECT (Transact-SQL)<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-azure-sql-data-warehouse-connector\" target=\"_blank\" rel=\"noopener\">Copy data to and from Azure SQL Data Warehouse using Azure Data Factory<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-migrate-data\" target=\"_blank\" rel=\"noopener\">Migrate Your Data<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><strong>Design and Implement Cloud-Based Integration by using Azure Data Factory (15-20%)<\/strong><\/p>\n<ul>\n<li>Implement datasets and linked services.\n<ul>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-introduction\" target=\"_blank\" rel=\"noopener\">Introduction to Azure Data Factory<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-compute-linked-services\" target=\"_blank\" rel=\"noopener\">Compute environments supported by Azure Data Factory<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-create-datasets\" target=\"_blank\" rel=\"noopener\">Datasets in Azure Data Factory<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-scheduling-and-execution\" target=\"_blank\" rel=\"noopener\">Data Factory scheduling and execution<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Move, transform, and analyze data by using Azure Data Factory activities\n<ul>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-copy-data-from-azure-blob-storage-to-sql-database\" target=\"_blank\" rel=\"noopener\">Tutorial: Copy data from Blob Storage to SQL Database using Data Factory<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-onprem-file-system-connector\" target=\"_blank\" rel=\"noopener\">Copy data to and from an on-premises file system by using Azure Data Factory<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-create-pipelines\" target=\"_blank\" rel=\"noopener\">Pipelines and Activities in Azure Data Factory<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-data-processing-using-batch\" target=\"_blank\" rel=\"noopener\">Process large-scale datasets using Data Factory and Batch<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-integrate-azure-data-factory\" target=\"_blank\" rel=\"noopener\">Use Azure Data Factory with SQL Data Warehouse<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Orchestrate data processing by using Azure Data Factory pipelines\n<ul>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-create-pipelines\" target=\"_blank\" rel=\"noopener\">Pipelines and Activities in Azure Data Factory<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-scheduling-and-execution\" target=\"_blank\" rel=\"noopener\">Data Factory scheduling and execution<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Monitor and manage Azure Data Factory\n<ul>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-monitor-manage-pipelines\" target=\"_blank\" rel=\"noopener\">Monitor and manage Azure Data Factory pipelines by using the Azure portal and PowerShell<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-monitor-manage-app\" target=\"_blank\" rel=\"noopener\">Monitor and manage Azure Data Factory pipelines by using the Monitoring and Management app<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-troubleshoot\" target=\"_blank\" rel=\"noopener\">Troubleshoot Data Factory issues<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-troubleshoot-gateway-issues\" target=\"_blank\" rel=\"noopener\">Troubleshoot issues with using Data Management Gateway<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-faq\" target=\"_blank\" rel=\"noopener\">Azure Data Factory &#8211; Frequently Asked Questions<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><strong>Manage and Maintain Azure SQL Data Warehouse, Azure Data Lake, Azure Data Factory, and Azure Stream Analytics (20-25%)<\/strong><\/p>\n<ul>\n<li>Provision Azure SQL Data Warehouse, Azure Data Lake, Azure Data Factory, and Azure Stream Analytics\n<ul>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-get-started-provision\" target=\"_blank\" rel=\"noopener\">Create an Azure SQL Data Warehouse<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-store\/data-lake-store-get-started-portal\" target=\"_blank\" rel=\"noopener\">Get started with Azure Data Lake Store using the Azure portal<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/data-factory-copy-activity-tutorial-using-azure-portal\" target=\"_blank\" rel=\"noopener\">Tutorial: Use Azure portal to create a Data Factory pipeline to copy data<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/stream-analytics\/stream-analytics-get-started-with-azure-stream-analytics-to-process-data-from-iot-devices\" target=\"_blank\" rel=\"noopener\">Get started with Azure Stream Analytics to process data from IoT devices<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Implement authentication, authorization, and auditing\n<ul>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-database\/sql-database-aad-authentication\" target=\"_blank\" rel=\"noopener\">Use Azure Active Directory Authentication for authentication with SQL Database or SQL Data Warehouse<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-database\/sql-database-firewall-configure\" target=\"_blank\" rel=\"noopener\">Azure SQL Database server-level and database-level firewall rules<\/a><\/li>\n<li><a href=\"https:\/\/www.sqlshack.com\/working-azure-active-directory-azure-sql-database\/\" target=\"_blank\" rel=\"noopener\">Working with Azure Active Directory and Azure SQL Database<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/active-directory\/active-directory-whatis\" target=\"_blank\" rel=\"noopener\">What is Azure Active Directory?<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-overview-manage-security\" target=\"_blank\" rel=\"noopener\">Secure a database in SQL Data Warehouse<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-auditing-overview\" target=\"_blank\" rel=\"noopener\">Auditing in Azure SQL Data Warehouse<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/stream-analytics\/stream-analytics-operation-logs\" target=\"_blank\" rel=\"noopener\">Debug Stream Analytics jobs using service and operation logs<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/stream-analytics\/stream-analytics-troubleshooting-guide\" target=\"_blank\" rel=\"noopener\">Troubleshooting guide for Azure Stream Analytics<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/security\/azure-log-audit\" target=\"_blank\" rel=\"noopener\">Azure Logging and Auditing<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-store\/data-lake-store-security-overview\" target=\"_blank\" rel=\"noopener\">Security in Azure Data Lake Store<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Manage data recovery for Azure SQL Data Warehouse, Azure Data Lake, and Azure Data Factory, Azure Stream Analytics\n<ul>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-backups\" target=\"_blank\" rel=\"noopener\">SQL Data Warehouse backups<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-restore-database-portal\" target=\"_blank\" rel=\"noopener\">Restore Azure SQL Data Warehouse (portal)<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-restore-database-powershell\" target=\"_blank\" rel=\"noopener\">Restore an Azure SQL Data Warehouse (PowerShell)<\/a><\/li>\n<li><a href=\"http:\/\/www.sqlservercentral.com\/articles\/Azure\/153547\/\" target=\"_blank\" rel=\"noopener\">Backups in Azure SQL Data Warehouse<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-migrate-data\" target=\"_blank\" rel=\"noopener\">Migrate Your Data<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Monitor Azure SQL Data Warehouse, Azure Data Lake, and Azure Stream Analytics\n<ul>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-develop-concurrency\" target=\"_blank\" rel=\"noopener\">Concurrency and workload management in SQL Data Warehouse<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-manage-compute-overview#scale-compute\" target=\"_blank\" rel=\"noopener\">Scale compute<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/sql-data-warehouse\/sql-data-warehouse-manage-monitor\" target=\"_blank\" rel=\"noopener\">Monitor your workload using DMVs<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-analytics\/data-lake-analytics-data-lake-tools-use-vertex-execution-view\" target=\"_blank\" rel=\"noopener\">Use the Vertex Execution View in Data Lake Tools for Visual Studio<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Design and implement storage solutions for big data implementations.\n<ul>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-lake-store\/data-lake-store-performance-tuning-guidance\" target=\"_blank\" rel=\"noopener\">Tuning Azure Data Lake Store for performance<\/a><\/li>\n<li><a href=\"https:\/\/azure.microsoft.com\/en-us\/pricing\/details\/data-lake-store\/\" target=\"_blank\" rel=\"noopener\">Pricing details<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/vs-azure-tools-storage-manage-with-storage-explorer\" target=\"_blank\" rel=\"noopener\">Get started with Storage Explorer (Preview)<\/a><\/li>\n<li><a href=\"https:\/\/channel9.msdn.com\/Shows\/msftazure\/Red-Gate-Azure-Storage-Explorer-Free-Tool\" target=\"_blank\" rel=\"noopener\">Red Gate Azure Storage Explorer [Free Tool]<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/storage\/common\/storage-use-azcopy\" target=\"_blank\" rel=\"noopener\">Transfer data with the AzCopy on Windows<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/storage\/common\/storage-use-azcopy-linux?toc=%2fazure%2fstorage%2fblobs%2ftoc.json\" target=\"_blank\" rel=\"noopener\">Transfer data with AzCopy on Linux<\/a><\/li>\n<li><a href=\"http:\/\/www.red-gate.com\/products\/azure-development\/azure-explorer\/\" target=\"_blank\" rel=\"noopener\">A free storage tool for Microsoft Azure<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/architecture\/patterns\/\" target=\"_blank\" rel=\"noopener\">Cloud Design Patterns<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><strong>Useful Links<\/strong><\/p>\n<p><a href=\"https:\/\/www.microsoft.com\/en-us\/learning\/exam-70-776.aspx\">https:\/\/www.microsoft.com\/en-us\/learning\/exam-70-776.aspx<\/a><\/p>\n<p><a href=\"https:\/\/www.mssqltips.com\/sqlservertip\/5102\/exam-material-for-the-microsoft-70776-perform-big-data-engineering-on-microsoft-cloud-services\/\">https:\/\/www.mssqltips.com\/sqlservertip\/5102\/exam-material-for-the-microsoft-70776-perform-big-data-engineering-on-microsoft-cloud-services\/<\/a><\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Design and Implement Complex Event Processing By Using Azure Stream Analytics (15-20%) Ingest data for real-time processing What is Stream[&#8230;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_mi_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0},"categories":[7,8,20],"tags":[44,49,50,54,56,57,67],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/pramodsingla.com\/index.php?rest_route=\/wp\/v2\/posts\/1502"}],"collection":[{"href":"https:\/\/pramodsingla.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/pramodsingla.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/pramodsingla.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/pramodsingla.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1502"}],"version-history":[{"count":0,"href":"https:\/\/pramodsingla.com\/index.php?rest_route=\/wp\/v2\/posts\/1502\/revisions"}],"wp:attachment":[{"href":"https:\/\/pramodsingla.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1502"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/pramodsingla.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1502"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/pramodsingla.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1502"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}