Integration to Snowflake DMF is in private preview. Please reach out to your KADA account manager to enable it.
This page will guide you through the setup of Snowflake Data Metrics Functions (DMF) for integration with K using the direct connect method.
Integration details
Scope | Included | Comments |
|---|---|---|
Metadata | YES | |
Lineage | YES |
|
Usage | YES | |
Data Quality | YES | See known limitations below |
Known limitations
K does NOT SUPPORT the out of the box DMFs (in the CORE schema).
K only uses user defined DMFs because K measures DQ results as a % of rows that meet the test condition.
K expects the DMF result to be a value between 0 to 100
Out of the box DMFs measure the number of rows that meet the test condition which does not provide sufficient context
Replacement DMFs for out of the box DMFs are available here Setting up Snowflake Data Metrics Functions
Step 1) Establish Snowflake Access
Ensure that you have setup Snowflake in K as per Snowflake
We recommend you use the same user for the Snowflake integration as the same user for DMF integration (option 1). A new user can be created specifically for this integration (option 2).
Add the following grants to the K user
Option 1: Extending the K user with access to Snowflake DMF
Assuming you followed the Snowflake integration instructions and created a role called CATALOG_READ_ONLY you can follow the steps to add grants to extend the user to be able to read Snowflake DMF details
--Log in with a user that has the permissions to assign/update roles --Add the following DQ related roles to the KADA role created previously GRANT APPLICATION ROLE SNOWFLAKE.DATA_QUALITY_MONITORING_VIEWER TO ROLE CATALOG_READ_ONLY; GRANT DATABASE ROLE SNOWFLAKE.DATA_METRIC_USER TO ROLE CATALOG_READ_ONLY GRANT DATABASE ROLE SNOWFLAKE.OBJECT_VIEWER TO ROLE CATALOG_READ_ONLY
Option 2: Creating a user with access to Snowflake DMF
To create a user with general access to metadata available in Snowflake Account Usage schema
--Log in with a user that has the permissions to create a role/user --Create a new role for the Catalog user Create role CATALOG_READ_ONLY; --Grant the role access to the Account usage schema grant imported privileges on database Snowflake to CATALOG_READ_ONLY; grant select on all tables in schema SNOWFLAKE.ACCOUNT_USAGE to CATALOG_READ_ONLY; grant monitor on account to role CATALOG_READ_ONLY; GRANT APPLICATION ROLE SNOWFLAKE.DATA_QUALITY_MONITORING_VIEWER TO ROLE CATALOG_READ_ONLY; GRANT DATABASE ROLE SNOWFLAKE.DATA_METRIC_USER TO ROLE CATALOG_READ_ONLY GRANT DATABASE ROLE SNOWFLAKE.OBJECT_VIEWER TO ROLE CATALOG_READ_ONLY --Create a new user for K and grant it the role (remove the []) create user [kada_user] password=['abc123!@#'] default_role = CATALOG_READ_ONLY default_warehouse = [warehouse];
Snowflake integration uses username/password. Using keys will be supported in an upcoming release
Step 2) Connecting K to Snowflake
The DMF integration for Snowflake is currently in Private Preview. Please reach out to the KADA team to configure it for your account. General availability is scheduled for 5.41 (August 2024)