| Info |
|---|
This his collector is for Informatica versions prior to Informatica Intelligent Cloud Services (IICS) |
| Scroll ignore | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||||||||
About Collectors
| Insert excerpt | ||||||
|---|---|---|---|---|---|---|
|
...
Informatica 9.1+ with repository hosted in Oracle.
Python 3.6 - 3.10
Access to the KADA Collector repository that contains the Informatica whl
The repository is currently hosted in KADA’s Azure Blob Storage. You will be given a SAS token to access the repository. Reach out to KADA Support (support@kada.ai) if you do not have access.
Download the Informatica whl (e.g. kada_collectors_extractors_informatica-#.#.#-py3-none-any.whl)Access to K landing directory
Access to Informatica Repository (see section below)
3.6 - 3.10
...
Some python packages also have dependencies on the OS level packages, so you may be required to install additional OS packages if the below fails to install.Run the following command to install the collector
You can download the latest Core Library and whl via Platform Settings → Sources → Download Collectors
...
Run the following command to install the collector
| Code Block |
|---|
pip install kada_collectors_extractors_<version>-none-any.whl |
You will also need to install the common library kada_collectors_lib for this collector to function properly.
| Code Block |
|---|
pip install kada_collectors_extractors_informatica-2.0.0-py3-lib-<version>-none-any.whl |
| Info |
|---|
You may require an ODBC package for the OS to be installed as well as an oracle client library package if do you not have one already, see https://www.oracle.com/au/database/technologies/instant-client.html |
...
Step 4: Generate runtime mappings
...
If you are handling external arguments of the runner yourself, you’ll need to consider the following for the run method https://kadaai.atlassian.net/wiki/spaces/DATKSL/pages/18943181521902411777/Notes+v2.0.0#TheAdditional+Notes#Extractor-run-method
| Code Block | ||
|---|---|---|
| ||
from kada_collectors.extractors.snowflake import Extractor
kwargs = {my args} # However you choose to construct your args
hwm_kwrgs = {"start_hwm": "end_hwm": } # The hwm values
ext = Extractor(**kwargs)
ext.run(**hwm_kwrgs) |
...
To edit the internal SQL being run refer to https://kadaai.atlassian.net/wiki/spaces/DATKSL/pages/18943181521902411777/Notes+v2.0.0#AddingAdditional+Notes#Adding-Custom-SQL
...
Step 7: Check the Collector Outputs
...
If you want prefer file managed hwm, you can edit the location of the hwn by following these instructions https://kadaai.atlassian.net/wiki/spaces/DATKSL/pages/18943181521902411777/Notes+v2.0.0#Storing-HWM-in-another-locationAdditional+Notes#Storing-High-Water-Marks-(HWM)
...
Step 8: Push the Extracts to K
...