Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Info

This his collector is for Informatica versions prior to Informatica Intelligent Cloud Services (IICS)

Scroll ignore
scroll-viewporttrue
scroll-pdftrue
scroll-officetrue
scroll-chmtrue
scroll-docbooktrue
scroll-eclipsehelptrue
scroll-htmltrue
scroll-epubtrue

Open in new tab

About Collectors

Insert excerpt
Collector Method
Collector Method
nameabout

...

  • Informatica 9.1+ with repository hosted in Oracle.

  • Python 3.6 - 3.10

    Access to the KADA Collector repository that contains the Informatica whl

  • The repository is currently hosted in KADA’s Azure Blob Storage. You will be given a SAS token to access the repository. Reach out to KADA Support (support@kada.ai) if you do not have access.

  • Download the Informatica whl (e.g. kada_collectors_extractors_informatica-#.#.#-py3-none-any.whl)

    - 3.10

  • Access to K landing directory

  • Access to Informatica Repository (see section below)

...

Some python packages also have dependencies on the OS level packages, so you may be required to install additional OS packages if the below fails to install.Run the following command to install the collector

You can download the latest Core Library and whl via Platform Settings → SourcesDownload Collectors

...

Run the following command to install the collector

Code Block
pip install kada_collectors_extractors_<version>-none-any.whl

You will also need to install the common library kada_collectors_lib for this collector to function properly.

Code Block
pip install kada_collectors_extractors_informatica-2.0.0-py3-lib-<version>-none-any.whl
Info

You may require an ODBC package for the OS to be installed as well as an oracle client library package if do you not have one already, see https://www.oracle.com/au/database/technologies/instant-client.html

...

If you are handling external arguments of the runner yourself, you’ll need to consider the following for the run method https://kadaai.atlassian.net/wiki/spaces/DATKSL/pages/18943181521902411777/Notes+v2.0.0#TheAdditional+Notes#Extractor-run-method

Code Block
languagepy
from kada_collectors.extractors.snowflake import Extractor

kwargs = {my args} # However you choose to construct your args
hwm_kwrgs = {"start_hwm": "end_hwm": } # The hwm values

ext = Extractor(**kwargs)
ext.run(**hwm_kwrgs)

...

To edit the internal SQL being run refer to https://kadaai.atlassian.net/wiki/spaces/DATKSL/pages/18943181521902411777/Notes+v2.0.0#AddingAdditional+Notes#Adding-Custom-SQL

...

Step 7: Check the Collector Outputs

...

If you want prefer file managed hwm, you can edit the location of the hwn by following these instructions https://kadaai.atlassian.net/wiki/spaces/DATKSL/pages/18943181521902411777/Notes+v2.0.0#Storing-HWM-in-another-locationAdditional+Notes#Storing-High-Water-Marks-(HWM)

...

Step 8: Push the Extracts to K

...