About Collectors
Insert excerpt | ||||||
---|---|---|---|---|---|---|
|
...
Pre-requisites
Python 3.6 - 3.9
Access to the KADA Collector repository that contains the Snowflake whl
The repository is currently hosted in KADA’s Azure Blob Storage. You will be given a SAS token to access the repository. Reach out to KADA Support (support@kada.ai) if you do not have access.
Download the Snowflake whl (e.g. kada_collectors_extractors_snowflake-#.#.#-py3-none-any.whl)
Access to K landing directory
Access toSnowflake (see section below)Access to K landing directory
Snowflake Access
Create a Snowflake user with read access to following tables in the Snowflake database.
...
Step 2: Getting Access to the Source Landing Directory
Insert excerpt | ||||||
---|---|---|---|---|---|---|
|
...
Step 3: Install the Collector
...
Once the files have been validated, you can push the files to the K landing directory.
You can use Azure Storage Explorer if you want to initially do this manually. You can push the files using python as well (see Airflow example below)
...
Example: Using Airflow to orchestrate the Extract and Push to K
Insert excerpt | ||||||
---|---|---|---|---|---|---|
|