Azure Functions Interview Questions and Answers
In this Azure Data engineer series I am going to share the most frequently asked interview question for freshers and experienced professionals up to 2,3,4,5,6,7,8,9,10 + years. Azure Functions is one of the popular services for the Azure Data engineer professional or as Azure cloud developer. Hence if you are planning to make a career […]
How to send the notebook run status to ADF from Azure Databricks notebook?
Are you looking for the solution on how you can pass the message from the Azure Databricks notebook execution to the Azure data factory then you have reach to the right place. In this article I will explain to you how you can pass different types of output from Azure Databricks spark notebook execution using […]
Azure Synapse Analytics Interview Questions and Answers
In this Azure Data engineer series I am going to share the most frequently asked interview question for freshers and experienced professional upto 2,3,4,5,6,7,8,9,10 + years. Azure synapse analytics is one of the popular service for the Azure Data engineer professional hence if you are planning to make a career as Azure data engineer, then […]
How to use GetMetaData Activity in Azure Data Factory?
Are you looking to learn how to use the get method activity in the Azure data factory or maybe you are looking for how to get the last modified date for a file that exists in your blob storage. Or you are wondering how to get the list of file names or folder names from […]
How do you use Filter Activity in Azure Data Factory?
Are you looking to find how you can use the filter activity within the Azure data factory or maybe you are looking for a solution to the scenario where you get an input array and out of that you want to filter out few values? Whatever be the reason for filtering out your input variable […]
How do you call a pipeline from another pipeline in Azure data Factory?
Are you looking out for help on how to call a pipeline from another pipeline in the Azure data factory or maybe you are looking for help on how you can pass parameter from one pipeline to another pipeline in the Azure data factory or adf. You may also be wondering on understanding how to […]
ForEach Activity in Azure Data Factory With Practical Example
Are you looking to understand what is the foreach activity in the Azure Data Factory or maybe you are looking for various use cases and scenarios where you can use the foreach activity? There are situations where foreach activity is the only way to achieve the business requirements. In this tutorial, we will go through […]
How To Monitor Azure Data Factory Effectively
Are you looking to find the ways to monitor Azure Data Factory or may be looking for a professional way of alerting the Azure data factory whenever any pipeline fails or any activities get failed. In this article I will take you through the step by step process of configuring the logs for the Azure […]
How To Run PowerShell Script in Azure Data Factory
Are you wondering how to execute a PowerShell script from the azure data factory (ADF) pipeline, then you have reached the right place. In this blog, I will take you through a step-by-step approach with the practical example demo of calling the powershell script from inside the azure data factory pipeline. Azure data factory is […]
How To Check IF File Exist In Azure Data Factory (ADF)
You can check if file exist in Azure Data factory by using these two steps 1. Use GetMetaData Activity with a property named ‘exists’ this will return true or false. 2. Use the if Activity to take decisions based on the result of GetMetaData Activity. Steps to check if file exists in Azure Blob Storage […]