September 19, 2021

Dev Diary - First look at a source-to-staging pattern in Mapping Data Flows

The 2021 BimlFlex release adds Mapping Data Flow patterns for loading data into Staging Areas and PSA, using Delta Lake and Azure SQL with Lookup and Window Functions for data validation.

September 7, 2021

Dev Diary – Orchestrating Mapping Data Flows

BimlFlex automates Mapping Data Flow execution in Azure Data Factory by generating pipelines, integrating with the BimlCatalog for audit tracking, and handling orchestration complexities, including batch execution and parallel processing.

August 31, 2021

Dev Diary – Defining Mapping Data Flow Parameters with Biml

BimlFlex enables dynamic Mapping Data Flows in Azure Data Factory by utilizing parameters to integrate metadata, control execution, and manage schema drift, ensuring flexibility in data logistics processes.

August 22, 2021

Dev Diary - Using Mapping Data Flow Parameters to dynamically use BimlFlex metadata

BimlFlex is integrating Data Flow Mapping Parameters into Azure Data Factory to enable schema drift support, ensuring dynamic metadata injection for flexible, adaptable transformations without predefined schemas.

July 18, 2017

Azure Data Warehouse Automation with BimlFlex

BimlFlex simplifies data warehouse automation with seamless on-premise and Azure compatibility, optimizing ETL and data integration for modern cloud solutions.

March 5, 2013

Using the WMI Data Reader Task in SSIS for System Data Queries

The WMI Data Reader task in SSIS retrieves system data using WMI queries. This post covers setup in BIDS and Mist, including query execution, connections, and output formatting.