Charith EkanayakeMetadata-driven data ingestion from Salesforce to Data Lake using Azure Synapse Pipelines4 min read·Sep 11, 2021--2--2
Charith EkanayakeHow to capture metadata with Azure Data Factory custom activities4 min read·Jun 5, 2021----
Charith EkanayakeHow to read files on SharePoint Online using Azure Data FactoryOrganizations that have moved to Office 365, maintain few key data points on excel files/SharePoint Lists stored in SharePoint Online. If…4 min read·May 12, 2021--3--3
Charith EkanayakeRunning Spark Jobs on a Remote Databricks Cluster using Databricks ConnectDatabricks Connect is a client library for Databricks Runtime. It allows you to write jobs using Spark APIs and run them remotely on a…4 min read·Apr 23, 2021----
Charith EkanayakeHandling Dynamic Column Headers with Azure Data Factory Mapping DataflowsDealing with dynamically changing column names or changing schema at the source level makes it complicated to consume the files using data…4 min read·Apr 1, 2021----