In this video, Austin walks through a SORT transformation for a Data Flow inside Azure Data Factory.
This transformation allows the user to sort a column of the table by a certain condition that is applied to the dataset. For needing to view the data by a certain metric or condition the sort transformation is perfect!
Azure Data Factory is a cloud-based data integration service that allows you to create data-driven workflows for orchestrating and automating data movement and data transformation. It can be used to create, schedule and orchestrate data pipelines that can ingest data from various sources, process the data using compute services such as Azure HDInsight Hadoop, Spark, Azure Data Lake, and Azure Machine Learning, and publish the output data to data stores such as Azure SQL Data Warehouse and Azure Blob storage.
You can use Azure Data Factory to build data pipelines that can process both structured and unstructured data, and move data between on-premises and cloud data stores. You can also use it to build data pipelines that can process data in real-time, or schedule data processing to occur at regular intervals.