Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Scroll ignore
scroll-viewporttrue
scroll-pdftrue
scroll-officetrue
scroll-chmtrue
scroll-docbooktrue
scroll-eclipsehelptrue
scroll-htmltrue
scroll-epubtrue

Open in new tab

This page will walkthrough guide you through the setup of Fivetran in K using the Direct Connect methoddirect connect method

Integration details

Scope

Included

Comments

Metadata

Status
colourGreen
titleYES

 

Lineage

Status
colourGreen
titleYES

 

Usage

Status
colourRed
titleNO

Usage currently not captured for Fivetran pipelines

Sensitive Data Scanner

Status
titleN/A

Note

Known limitations

  • Not all sources and destinations are included in the metadata extraction. Improvements are planned to provide wider coverage.

...

Step 1) Create an API Key

...

  • Select Direct Connect and add your Fivetran details and click Next

  • Fill in the Source Settings and click Save & Next

    • Name: Give the Fivetran source a name in K

    • Host: Can be any unique value. For example add fivetran.com/[fivetran account name]

    • Update the Host / Database mapping - see Host / Database Mapping for each project. This step can be completed after the initial load via the guided workflow.

  • Add your Key (client ID) and Secret (client Secret) copied from Step 1 and click Save

  • Test your connection and click Save

  • Click Finish Setup

...

Info

Note that scheduling a source can take up to 15 minutes to propagate the change.

...

Step 4) Manually run an ad hoc load to test

...

  • Select Platform Settings in the side bar

  • In the pop-out side panel, under Platform Settings click on Batch Manager

  • In Source Load click Run

...

Fivetran setup

  • Next to your new Source, click on the Run manual load icon

    Image Added
  • Confirm how your want the source to be loaded

    Image Added
  • After the source load is triggered, the screen will change a pop up bar will appear taking you to the Monitor tab where you can see in the Batch Manager page. This is the usual page you visit to view the progress of the job.

...

  • source loads

    Image Added

Info

A manual source load will also require a manual run of

  • DAILY

  • GATHER_METRICS_AND_STATS

To load all metrics and indexes with the manually loaded metadata. These can be found in the Batch Manager page

 

Warning

Troubleshooting failed loads

  • If the job failed at the extraction step

    • Check the error. Contact KADA Support if required.

    • Rerun the source job

  • If the job failed at the load step, the landing folder failed directory will contain the file with issues.

    • Find the bad record and fix the file

    • Rerun the source job