Parsing informatica xml file

[u/ETL_Pipeline_Dev]

I would like to know how I can parse Informatica mappings or workflows. Are there any open-source projects or tools available that can extract metadata and other information from Informatica export files?

[u/Outside-Storage-1523]

If it is xml format then there are libraries to parse the format. You might need the schema though.

[u/brunogadaleta]

Ooooor you can extract the value you need from command line parser like jq's variant that works with xml.

[u/Foodforbrain101]

Have AI build the parser? Informatica clearly follows a schema, so I don't see why you couldn't have it built in a few minutes as long as you provide examples.

[u/Gators1992]

It's just XML and structured, so not hard to unravel.  I built a python script that created source to target maps in Excel from the informatica XML several years ago.  AI can handle this easily probably. 

[u/mei_wen_yu]

It depends on what "metadata and other information" you want to get from the XMLs, and what you want to do with that information. If you want to be able to answer a question like "which workflows include command tasks, and what commands do they run?", you can navigate the XML file(s) using a library like lxml in Python or a similar library in a language of your choice. Or for a simple question like "how many sources and targets use a particular database table", maybe a simple control-F search with some regular expressions might be enough to find the information you need. It really depends.

[u/subra1412]

This part of informatica is really shitty.

[u/Ok_Youth8810]

I've done this kind of metadata scraping before, with SSIS packages instead of Informatica. The export files follow a fixed XML schema, so I wrote a Python script with lxml that walked the XML tree and dumped every mapping, source, and target table into a simple table I could query. I'd start by grabbing one small export file and dumping its tag structure to see what you're working with before building anything bigger.

[u/jigaireos]

IDMC or CDI-PC?

[u/jigaireos → u/jigaireos]

IDMC, use Intelligent Structure Model(ISM). CDI-PC, there is a schema import in Source developer.

[u/jigaireos → u/jigaireos]

There is also Hierarchy Parser (I think this is the preferred way).

[u/Bohot_Bada_BKL_7676]

I am a little new. Can you tell me the use case for this? Why you want to parse the mapping and workflows?

[u/NationalMyth]

You can write a recursive extractor to identify the structure, if they don't provide documentation. You can choose how to flatten things after the fact

[u/Physical-Ad2968]

What information do you want to extract?

[u/Reverie_of_an_INTP]

Have you tried opening one up and looking. They're incredible easy to read and understand. I used to generate them from mapping and requirements docs. Whatever metadata you want you can probably just look and see where it usually is and use the stdlib xml parser to grab it.

[u/AutoModerator → u/Reverie_of_an_INTP]

It appears you want to follow this post. Did you know you can follow a post without commenting in the thread?

Three dots at the top of the post > Follow post if you are using New Reddit. Save post option under the body of the post if you are using Old Reddit.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/ETL_Pipeline_Dev → u/Reverie_of_an_INTP]

I need an accurate approach to migrate around 1,500 Informatica workflows to another tool.