Metadata-driven data ingestion from Salesforce to Data Lake using Azure Synapse PipelinesSep 11, 20213Sep 11, 20213
How to read files on SharePoint Online using Azure Data FactoryOrganizations that have moved to Office 365, maintain few key data points on excel files/SharePoint Lists stored in SharePoint Online. If…May 12, 20213May 12, 20213
Running Spark Jobs on a Remote Databricks Cluster using Databricks ConnectDatabricks Connect is a client library for Databricks Runtime. It allows you to write jobs using Spark APIs and run them remotely on a…Apr 23, 2021Apr 23, 2021
Handling Dynamic Column Headers with Azure Data Factory Mapping DataflowsDealing with dynamically changing column names or changing schema at the source level makes it complicated to consume the files using data…Apr 1, 2021Apr 1, 2021
