February 1, 2022

Dev Diary - Adding Transformations to Mapping Data Flows

BimlFlex now supports defining derived columns in Azure Data Factory Mapping Data Flows, enabling complex logic and dependencies using the expression editor.

October 13, 2021

Creating custom column-level transformations in BimlFlex

BimlFlex allows for high customization by adding specific column-level transformations using Custom Configurations.

September 19, 2021

Dev Diary - First look at a source-to-staging pattern in Mapping Data Flows

The 2021 BimlFlex release adds Mapping Data Flow patterns for loading data into Staging Areas and PSA, using Delta Lake and Azure SQL with Lookup and Window Functions for data validation.

September 7, 2021

Dev Diary – Orchestrating Mapping Data Flows

BimlFlex automates Mapping Data Flow execution in Azure Data Factory by generating pipelines, integrating with the BimlCatalog for audit tracking, and handling orchestration complexities, including batch execution and parallel processing.

August 31, 2021

Dev Diary – Defining Mapping Data Flow Parameters with Biml

BimlFlex enables dynamic Mapping Data Flows in Azure Data Factory by utilizing parameters to integrate metadata, control execution, and manage schema drift, ensuring flexibility in data logistics processes.

August 22, 2021

Dev Diary - Using Mapping Data Flow Parameters to dynamically use BimlFlex metadata

BimlFlex is integrating Data Flow Mapping Parameters into Azure Data Factory to enable schema drift support, ensuring dynamic metadata injection for flexible, adaptable transformations without predefined schemas.