Bulk Lineage Mapper
- Chichi
There are a few scenarios when K may not be automatically link and create a lineage map. For example:
Upstream Data Source has been loaded as a Manual Source in K
Data that has been loaded has insufficient metadata to enable automated lineage
Where you know that a tables, column, dataset tables or dataset fields are connected, you can use the Lineage Mapper application to bulk map lineage using rules to connect data and content.
Accessing Lineage Mapper
You can access Lineage Mapper by clicking on K Applications and then Lineage Mapper
How to bulk map lineage
Step 1) Confirm the asset type combination and source you want to link
You can choose to link:
Tables / Dataset Tables → Tables / Dataset Tables
Columns / Dataset Fields → Columns / Dataset Fields
If you select to link at the Table level, you can also choose the lineage level to link e.g. if you also want to link underlying columns
Step 2) Confirm the table/column/dataset that is to be linked
Step 3) Confirm how the names should be matched. You can specific that column name has the following combinations:
Name
<prefix> + Name
Name + <suffix>
<prefix> + Name + <suffix>
Step 4) Review the examples to confirm that the correct data asset has been selected and the correct prefix/suffix has been added
The examples pull the first three column / table / dataset names to help give you an indication about the name formatting.
Step 5) Click Confirm
Step 6) You will be taken to the My Applications → Jobs → Lineage Mapping page where you can see the progress of your Lineage Mapping Job.
While the job is running, you can click the Cross icon to cancel the job
After the job has been completed, you will not be able to ‘reverse’ the mapping job. Any changes or errors will need to be manually edited one at a time.
What does a manual lineage link look like?
Manual lineage links are displayed with a dash line and a (M) symbol.
