Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Scroll ignore
scroll-viewporttrue
scroll-pdftrue
scroll-officetrue
scroll-chmtrue
scroll-docbooktrue
scroll-eclipsehelptrue
scroll-htmltrue
scroll-epubtrue

Open in new tab

This page will walkthrough the setup of Azure Data Factory in K .using the direct connect method

Integration details

Scope

Included

Comments

Metadata

Status
colourGreen
titleYES

See below

Lineage

Status
colourGreen
titleYES

Usage

Status
colourGreen
titleYES

Sensitive Data Scanner

Status
colourRed
titleNo
Sensitive data scanner not available for pipelines
titleN/A

Note

Known limitations

  • Not all sources and destinations are included in the metadata extraction. Improvements are planned to provide wider coverage

  • Sources Implemented

    • SNOWFLAKE

...

Step 1) Enabling Azure Data Factory Admin APIs to be accessible to an AD Group

...

  • Select Platform Settings in the side bar

  • In the pop-out side panel, under Integrations click on Sources

  • Click Add Source and select AZURE_DATA_FACTORY

...

  • Select Direct Connect and add your Azure Data Factory details and click Next

  • Fill in the Source Settings and click Save & Next

    • Name: Give the Azure Data Factory source a name in K. If you have multiple ADFs, each one will need to have a unique name

    • Host: Enter the url e.g. adf.azure.com

    • Timeout: Default is 10, sometimes it may take longer for the API to respond, so we recommend increasing it to 20

    • Add Update the Host / Mapping details. See Database mapping - see Host / Database Mapping for more details. This step can be completed after the initial load via the guided workflow.

    • Select Enable Workspace Filtering if you wish to load only select Workspaces

  • Add Connection Details and click Save & Next

    • Tenant ID: Add the Directory (tenant) ID copied from step 2

    • Client ID : Add the Application (client) ID copied from Step 2

    • Client Secret: Add the Secret ID copied from Step 2

  • Test your connection and click Next

  • If you selected Enabled Workspace Filtering select the Workspaces you want to load. If you have a lot of workspaces this may take a bit of time to load.

  • Click Finish Setup

...