Charith EkanayakeMetadata-driven data ingestion from Salesforce to Data Lake using Azure Synapse PipelinesSep 11, 20212Sep 11, 20212
Charith EkanayakeHow to capture metadata with Azure Data Factory custom activitiesJun 5, 2021Jun 5, 2021
Charith EkanayakeHow to read files on SharePoint Online using Azure Data FactoryOrganizations that have moved to Office 365, maintain few key data points on excel files/SharePoint Lists stored in SharePoint Online. If…May 12, 20213May 12, 20213
Charith EkanayakeRunning Spark Jobs on a Remote Databricks Cluster using Databricks ConnectDatabricks Connect is a client library for Databricks Runtime. It allows you to write jobs using Spark APIs and run them remotely on a…Apr 23, 2021Apr 23, 2021
Charith EkanayakeHandling Dynamic Column Headers with Azure Data Factory Mapping DataflowsDealing with dynamically changing column names or changing schema at the source level makes it complicated to consume the files using data…Apr 1, 2021Apr 1, 2021
