I’m a data engineer and previously did ERP implementations for 3 years. Saw how much of a crap shoot most F500 companies data is, anyways took this job to go back to school at smaller firm.

Company is finally realizing how bad their data is and have exec support, but I don’t think they know how bad it really is. I mainly work with the external data for business decisions.

Basically the internal data is split across 6 systems and they have no standard documentation/ideas of how their business operates or what data each unit consumes etc.

My manager/engineering team are building out a new software and haven’t even cracked open the data foundation. I’ve seen this a million times in implementation where execs and management assume the data is all good and then it’s go-live / go-time and realize their data is up the wall.

I know for a fact this companies internal data is messed up to a new level (without even seeing it)… manager thinks this will just be a light lift we just go in write out some documents and map some schemas and it’s all good happy day…

How do I communicate to him and the other executives that if they want to really do this it’s not like a week to a month project???

I mean we are talking about establishing data maturity/ MDM from scratch

Do you use Qt and Python to visualize and interact with data?

Then you might like this library that I've been working on for the past couple years. It provides an easy way to add parameters for different types: float, int, string, but also Qt types such as QPointF, QSizeF etc.

I use it to load pydantic models from configs and save them back out.

https://github.com/beatreichenbach/qt-parameters

This is a utility that is part of the framework I had posted about earlier, the post discusses the ideas and the utility behind the tool. The TL;DR version is that it helps you move from a conceptual business use case to a data representation that can be consumed by the tool, the required context is also presented.

https://r2dssanity.substack.com/p/from-business-use-case-to-technical?r=3ncgel&utm_campaign=post&utm_medium=web&showWelcomeOnShare=true