K provides context and trust to your data items by helping you understand the lineage and relationships between data items. You can see where your data item sources data from, where it flows to, how it joins to other data items.
As part of the Oct 23 release of 5.33, K can now automatically detect column level lineage and help you understand how column level data is used, transformed, and derived throughout data processes.
...
| Info |
|---|
We are in the process of refining the parsing process to reduce the time taken for the job to run and increase the accuracy. During the beta release, there are the following known limitations:
|
Enabling column level lineage
...
Column level lineage has limitations due to the variety and complexity of SQL dialects. See Known limitations below for currently known limitations. |
...
Enabling column level lineage
The column level lineage parse is currently available as a manually triggered process to supplement lineage captured during daily processes.
The column level lineage process analyses actively run code captured in K. If your environment is complex with a large amount of code, running the process may take time.
To trigger this column lineage job, go to Settings → Batch Manager and select QUERY_LINEAGE
...
...
Known limitations
...
Limitation | Fixed in Release |
|---|---|