...
| Scroll ignore | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||||||||
About Collectors
| Insert excerpt | ||||||
|---|---|---|---|---|---|---|
|
...
Pre-requisites
Collector Server Minimum Requirements
| Insert excerpt | ||||||||
|---|---|---|---|---|---|---|---|---|
|
Informatica Requirements
Informatica 9.1+ with repository hosted in Oracle.Python 3.8 - 3.11Access to K landing directory
Access to Informatica Repository (see section below)
Establish Informatica Repository Access
Create an Oracle user with read access to all tables in the Informatica repository database.
Establish Informatica Server Access
Create a user that has read access to the Informatica Server.
...
Step 1: Create the Source in K
...
If you are handling external arguments of the runner yourself, you’ll need to consider the following for the run method https://kadaai.atlassian.net/wiki/spaces/KSL/pages/1902411777/Additional+Notes#Extractor-run-method
| Code Block | ||
|---|---|---|
| ||
from kada_collectors.extractors.snowflake import Extractor
kwargs = {my args} # However you choose to construct your args
hwm_kwrgs = {"start_hwm": "end_hwm": } # The hwm values
ext = Extractor(**kwargs)
ext.run(**hwm_kwrgs) |
...
To edit the internal SQL being run refer to https://kadaai.atlassian.net/wiki/spaces/KSL/pages/1902411777/Additional+Notes#Adding-Custom-SQL
...
Step 7: Check the Collector Outputs
...
If you want prefer file managed hwm, you can edit the location of the hwn by following these instructions Additional Notes
...
Step 8: Push the Extracts to K
...