March 16, 2022

Dev Diary - Embracing the new Azure Data Factory Script Activity

The upcoming 2022 R2 release of BimlFlex integrates Azure Data Factory's new Script Activity, allowing direct execution of SQL statements like stored procedures and lookups on Snowflake and Oracle, replacing the need for the Azure Function Bridge.

February 14, 2022

Dev Diary - Customizing file paths for Delta Lake

BimlFlex now supports defining specific directories within a Delta Lake container for different layers, enabling a lakehouse architecture for your data solution.

August 18, 2021

Dev Diary - Generating ADF Data Flow Mapping using Biml

Varigence is finalizing BimlFlex's support for Azure Data Factory Data Flow Mappings, allowing for dynamic, metadata-driven ETL automation with inline datasets and optimized compute management for cloud-based data logistics.

August 18, 2021

Dev Diary - Deploying Biml-Generated ADF Data Flow Mappings

Varigence is automating Azure Data Factory Data Flow Mapping deployments using BimlStudio-generated ARM templates, allowing for seamless resource provisioning via Azure Portal or PowerShell scripts.

July 29, 2021

Delta Lake on Azure work in progress – introduction

Varigence is actively enhancing BimlFlex to support Delta Lake for Azure Data Factory, enabling ACID-compliant transaction control on Azure Data Lake Gen2, simplifying Lake House architecture automation.

March 13, 2019

Snowflake Integration Powered by BimlFlex

This post explores automating Snowflake data integration using BimlFlex, covering metadata import, ingestion, orchestration, staging, and integration while leveraging Snowflake’s architecture for efficient ELT.