Column level lineage
- Chichi
- Dean Nguyen
K provides context and trust to your data items by helping you understand the lineage and relationships between data items. You can see where your data item sources data from, where it flows to, how it joins to other data items.
K automatically detect column level lineage and help you understand how column level data is used, transformed, and derived throughout data processes.
Column level lineage has limitations due to the variety and complexity of SQL dialects. See limitations page currently gaps with Column level lineage.
Enabling column level lineage
The column level lineage parse is currently available as a manually triggered process to supplement lineage captured during daily processes.
The column level lineage process analyses actively run code captured in K. If your environment is complex with a large amount of code, running the process may take time.
To trigger this column lineage job, go to Settings → Batch Manager and select QUERY_LINEAGE
