Metadata-driven data ingestion from Salesforce to Data Lake using Azure Synapse PipelinesSep 11, 2021923Sep 11, 2021923
How to read files on SharePoint Online using Azure Data FactoryOrganizations that have moved to Office 365, maintain few key data points on excel files/SharePoint Lists stored in SharePoint Online. If…May 12, 20211103May 12, 20211103
Running Spark Jobs on a Remote Databricks Cluster using Databricks ConnectDatabricks Connect is a client library for Databricks Runtime. It allows you to write jobs using Spark APIs and run them remotely on a…Apr 23, 202174Apr 23, 202174
Handling Dynamic Column Headers with Azure Data Factory Mapping DataflowsDealing with dynamically changing column names or changing schema at the source level makes it complicated to consume the files using data…Apr 1, 202174Apr 1, 202174