Document toolboxDocument toolbox

Fivetran

This page will guide you through the setup of Fivetran in K using the direct connect method

Integration details

Scope

Included

Comments

Scope

Included

Comments

Metadata

YES

 

Lineage

YES

 

Usage

NO

Usage currently not captured for Fivetran pipelines

Sensitive Data Scanner

N/A

 

Known limitations

  • Not all sources and destinations are included in the metadata extraction. Improvements are planned to provide wider coverage.


Step 1) Create an API Key

  • Log into your Fivetran account and go to Settings. Go to the API Config section to find the API Key and Secret

  • Copy the API Key and Secret for the next step


Step 2) Add Fivetran as a New Source

  • Select Platform Settings in the side bar

  • In the pop-out side panel, under Integrations click on Sources

  • Click Add Source and select Fivetran

 


Step 3) Schedule Fivetran source load

  • Select Platform Settings in the side bar

  • In the pop-out side panel, under Integrations click on Sources

  • Locate your new Fivetran source and click on the Schedule Settings (clock) icon to set the schedule

Note that scheduling a source can take up to 15 minutes to propagate the change.


Step 4) Manually run an ad hoc load to test Fivetran setup

  • Next to your new Source, click on the Run manual load icon

  • Confirm how your want the source to be loaded

  • After the source load is triggered, a pop up bar will appear taking you to the Monitor tab in the Batch Manager page. This is the usual page you visit to view the progress of source loads

 

A manual source load will also require a manual run of

  • DAILY

  • GATHER_METRICS_AND_STATS

To load all metrics and indexes with the manually loaded metadata. These can be found in the Batch Manager page