K provides context and trust to your data items by helping you understand the lineage and relationships between data items.
You can see where your data item sources data from, where it flows to, how it joins to other data items.
...
Lineage crosses different item types, from tables to reports, across different sources. K automatically generates lineage across these item. Where it can’t, lineage can be manually added via the UI or via the API.
| Info |
|---|
Column level lineage is coming in Q2 2022 |
Using Lineage
You can access Lineage by going to any profile page and clicking on the Lineage tab
...
Lineage views
There are several types of views for lineage
...
View
...
Description
...
Best for
...
Basic
...
This view shows high level lineage between tables, reports, pipelines. Items like code are hidden.
This is the default view for all item types except for code.
...
To check where a specific item sources its data from, and if those sources are trusted.
...
In Depth
...
This view shows detailed lineage between items including code that connects them.
This is the default view for code
...
To investigate how data items are connected and what logic might be used to filter data.
...
List
...
This view lists all the immediate up and downstream data items.
...
If more than 50 items are connected in lineage, it is best to use the list to see them all.
Navigating the Lineage chart
The lineage chart should be read Left to Right. Items to the left are upstream (they provide data to) of the assets on the right.
...
Some items have lineage that can be displayed. They will appear with a + sign that you can click to expand
You can click automated links to see the details to join the two items. This might be code or a pipeline that connects the two
The current target you are looking at will be highlighted in Blue
The details panel
When you click on a data item or an automated link a panel will appear to provide additional details
In a Data Item details panel you will see
Details about the data item including any tags, collections, and descriptions
Properties about the data item include its type, trust score, classification etc
Action buttons that are relevant to the data item
In a Link details panel you will see
The data item (code, pipelines) that join the two data items
Details of the data item like the actual code used
Action buttons that are relevant to the data item
Accessing Lineage Explorer
The Lineage explorer is useful to see complex lineage that might require more screen real estate.
You can access the Impact Assessment through the Data Applications page or the Data Item’s Profile Page (e.g. table profile)
...
Access via Data Applications on the side bar
...
Access via your Data Item’s Profile Page and clicking on the Lineage Tab / Explorer or via the Open in applications button at the top
| Info |
|---|
If you select the Lineage Explorer via the profile page, the data details will automatically pre-populate |
Updating Lineage Data
Sometimes lineage may be missing on a table (or other item). To update the Lineage information, first go to the Data Item’s Profile Page
...
Click Link and a pop-up box will appear
...
Confirm if you want to add an Upstream or Downstream item
...
| Scroll ignore | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||||||||
On your homepage, K provides a personalised Feed to help you navigate the constantly changing Data Ecosystem.
The feed will provide regular updates about new and changed data items, updates from the data governance team about policies and terms, and crowdsourced issues, tags and changes.
Check in with feed regularly to stay up to date on your part of the data ecosystem.
...