February 10, 2022

Dev Diary - Configuring load windows and filters for Mapping Data Flows

BimlFlex now supports configurable load windows using parameters, enabling delta loads for various data sources, including file-based sources and Salesforce.

February 4, 2022

Dev Diary - Connecting to unsupported data sources using Mapping Data Flows and BimlFlex

BimlFlex now supports mixing and matching data sources by adding a landing step for unsupported sources, such as Salesforce, before processing with data flows.

February 1, 2022

Dev Diary - Adding Transformations to Mapping Data Flows

BimlFlex now supports defining derived columns in Azure Data Factory Mapping Data Flows, enabling complex logic and dependencies using the expression editor.

October 13, 2021

Creating custom column-level transformations in BimlFlex

BimlFlex allows for high customization by adding specific column-level transformations using Custom Configurations.

September 19, 2021

Dev Diary - First look at a source-to-staging pattern in Mapping Data Flows

The 2021 BimlFlex release adds Mapping Data Flow patterns for loading data into Staging Areas and PSA, using Delta Lake and Azure SQL with Lookup and Window Functions for data validation.

September 7, 2021

Dev Diary – Orchestrating Mapping Data Flows

BimlFlex automates Mapping Data Flow execution in Azure Data Factory by generating pipelines, integrating with the BimlCatalog for audit tracking, and handling orchestration complexities, including batch execution and parallel processing.