Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

About Collectors

Insert excerpt
CollectorsCollector MethodCollectors
Collector Method
nameabout

...

Pre-requisites

Snowflake Access

Create a Snowflake user with read access to following tables in the Snowflake database.

...

Step 2: Getting Access to the Source Landing Directory

Insert excerpt
CollectorsCollector MethodCollectors
Collector Method
namelanding

...

Step 3: Install the Collector

...

Once the files have been validated, you can push the files to the K landing directory.

You can use Azure Storage Explorer if you want to initially do this manually. You can push the files using python as well (see Airflow example below)

...

Example: Using Airflow to orchestrate the Extract and Push to K

Insert excerpt
CollectorsCollector MethodCollectors
Collector Method
nameairflow