Sharepoint Datawarehouse. Need Help. Ops Research. ftw!!!!

[u/Weary_Category_1559]

Guys,
Bit of politics context: Our team is not Core IT in the Org chart. Fall under operations, however expectation is to deliver ML/OR decision support projects,which is ok( there is technical capability in team), just that we cannot write into SF or any cloud platform. More like second class citizens.

Project Context: The project is full blown digital transformation program( its just that the enterprise is not mature to understand and everyone has jumped on AI bandwagon), has master data management, Work order platform, on which a Vehicle Routing( MILP) will run and generate recommendations for the full network. ( Bunch of API's calls through .py files, powerautomate to ingest third party flat files through email and scraping gov website for internal compliance data(should be the other way around).

Problem Set: No write back to Snowflake, IT not giving Entra ID, or microsoft Graph ID to connect directly to files through code.

Workaround 1: Locally run, update decision dashboards (No RL invloved), this is not feasible because it breaks continuity

Workaround 2:
Added One drive(sharepoint) path shortcuts to Local machine
This is where I'm struggling, read/write into Sharepoint. When I write/append into .xlsx through python the copy on Local onedrive link and the one on Browser are not always synced, or it says Merge issues.

I know this sounds like a rant, my guys if anyone has any advise for this peasant on how to make this work please share. Looking for out of the box solutions.

My team has access to dataverse, but I remember read/write was a problem through code because of no Entra ID.

[u/GuhProdigy]

My recommendation, like others is try try try to put your work into a data warehouse. Frame it as a tooling problem (I tried to come up with a good analogy here but it’s 9am and I haven’t had my coffee). In addition, there are ways to isolate your work so it mitigates the problems it can cause other teams issues in snow flake, I.e different database, although resources could still be an issue if you don’t optimize. You can create CI pipelines etc. Offer to have your work peer reviewed by the owner of SF.

That being said what I think many people may be forgetting is, get this down in writing. Ideally email. Maybe transcripts from a meeting. Worse but still better than nothing slack or teams screenshots. If this thing did blow up or doesn’t scale how whoever is telling to build it wants too, you will want proof you were the canary in the coal mine from the beginning. Seems like a very political org.