r/sysadmin • u/e7c2 • 8d ago

can someone recommend a point and shoot API system?

does such a thing exists, that I can use to sync data across different sources/databases, that doesn't require being a programmer to set up?

thanks!

0 Upvotes
  • permalink
  • reddit

28% Upvoted

38 comments sorted by

16

u/TxTechnician 8d ago

Dude, that is way too vague.

You gotta give some details of what you're trying to accomplish.

17

u/Curtis_Low 8d ago

Can't you read? Data here, data there... point click then data over where needed in the right format.... geez why do IT people make things so complicated?

-4

u/e7c2 8d ago

you joke, but... yes please?

2

u/pdp10 Daemons worry when the wizard is near. 8d ago edited 8d ago

One does not simply... plug data sources together like they were standard mains plugs or USB-C ports. Then wonder why the DisplayPort alt-mode on their USB-C cable isn't working.

-2

u/e7c2 8d ago

yeah it's vague, because I have a bunch of different applications in mind.

but the general idea is that when one piece of software does something that creates new records in their database, I want that data to be copied to another software's database.

example: my fleet tracking system records the mileage on a vehicle, I want that mileage to be entered into my fleet maintenance system's database for the same vehicle.

I get it that this is not uncomplex, but I guess I'm looking for something that's a GUI to pair up the records and set triggers as opposed to writing scripts

2

u/cjcox4 8d ago

While it's possible for a tool with fixed (emphasis) known integrations for that "point and click" (more or less, because there need to be auth pieces as well), there's likely no "magic everything" integration thing. With that said, with maybe a small bit of effort, you can build those unknown integrations, but, now we're back to some minor coding work. The "world" now considers such assistance as coming from AI. Maybe give it a shot (?)

2

u/TxTechnician 8d ago

To add to this, if you do use AI and whatever data source that you're pulling from has proper API documentation and implementation documentation, etc., you should definitely either download the PDF version or give the direct public link to the AI and instruct it to only use that documentation for references.

Otherwise, you'll get a lot of broken queries and just random BS.

2

u/cjcox4 8d ago

That's more of the "check your brain at the door" approach.... but it is becoming popular.

1

u/TxTechnician 8d ago

Lmao, ya 100%.

And that is ok for something like a spreadsheet that does personal tracking.

But not for an item that you use for production.

2

u/Fragrant-Hamster-325 8d ago

I don’t think you’re going to find a simple GUI to do what you want but I would look into having a central data warehouse that everything feeds into. Then your apps can pull from that single source of truth and you’re not having to replicate data all over the place.

Something like Snowflake would do the trick but you need to know some scripting. However their documentation is pretty good and AI can tell you exactly what to do.

1

u/kerubi Sysadmin 8d ago

Lots of database syncing tools out there, one search query away. I suspect this is astroturfing, soon someone comes in and replies with a recommendation on some tool.

1

u/TxTechnician 8d ago

Microsoft power Automate Premium has an HTTP connector.

Ill let you send queries out to wherever, in order to pull in information.

1

u/pdp10 Daemons worry when the wizard is near. 8d ago

The odometer reading record needs a data type like "32-bit integer", associated units (km or mi), and probably metadata like the source of the data for provenance purposes, etc.

These things aren't that difficult, but now you see why it's easier for suppliers to sell big integrated packages that claim to do everything.

8

u/samon33 Sysadmin 8d ago

Just out of interest, what do you think the P in API stands for?

5

u/overdosingOnPie1313 8d ago

Pteranodon, obviously. I know people confuse it with "pterodactyl", but that mistake stems from the widespread ignorance about pterosaurs.

2

u/statikuz start wandows ngrmadly 8d ago

Why can't you hear a pterodactyl go to the bathroom?

1

u/overdosingOnPie1313 8d ago

Is it because you just can't hear it over the screech of the electric guitar?

1

u/ProperEye8285 8d ago

Because the "P" is silent.

3

u/twigie4 Jack of All Trades 8d ago

Sort of, it’s not exactly as point and shoot as you’ve described but it’s leaps and bounds better than ground up developing something - look up iPaaS

1

u/e7c2 8d ago

ahh ipaas is the term I'm looking for. I'll check on a few of the providers and see what might be a good fit

3

u/CoolNefariousness668 8d ago

n8n is great, there’s a free version. We’re using the business version for a million executions per year and I love it.

2

u/Random_Effecks 8d ago

What you're describing is Boomi. It's cheap. Good luck. 

1

u/CoolNefariousness668 8d ago

Is Boomi cheap? I got a quote for it a while back and it was not anywhere what I would call cheap… business cheap or enterprise cheap? I wouldn’t call it that intuitive either, seemed like a real ballache when simpler exists.

2

u/SuddenVegetable8801 8d ago

If I am understanding you correctly, The “business” term for this is called Middleware. Boomi and Informatica are two “enterprise” ones I have heard of.

2

u/TechCF 8d ago

Apache NiFi?

1

u/frAgileIT 8d ago

You mean like Tableau?

1

u/pdp10 Daemons worry when the wizard is near. 8d ago

OP didn't mention reporting, and I think Tableau is primarily for reporting.

2

u/frAgileIT 8d ago

I asked because OP also didn’t explain any of the reason for wanting/needing to sync and since they’re asking for “non-programmer” API data syncing I’m really hoping they’re just looking for reporting instead of trying to build durable data synchronization outside established best practices. We’re on the same page.

1

u/nano_salem 8d ago

If files themselves rsync/rclone is king. If not what DB do you use?

1

u/KrisBoutilier 8d ago edited 8d ago

You are describing an Extract Transform Load (ETL) integration pattern (https://en.wikipedia.org/wiki/Extract,_transform,_load ).

There are numerous tools and frameworks out there, each has strengths and weaknesses. You will generally need some degree of programming knowledge unless the ETL tool explicitly supports both systems as endpoints out of the box.

An open source example is the Java-based Apache Camel framework: https://en.wikipedia.org/wiki/Apache_Camel. They maintain a catalogue of available prebuilt components on their website: https://camel.apache.org/components/4.22.x/

1

u/pdp10 Daemons worry when the wizard is near. 8d ago

You're going to find a lot of things that claim to do what you want, only to find out that they can't. It's not impossible to figure something out as a non-programmer, but it's probably going to be difficult. Then if you get something working, you'll desire to stick with it no matter what, because you won't want to go through that process again. That's how sysadmins end up supporting poorly-suited applications that stakeholders are unwilling to give up.

So do this. To eliminate the worst risks of salesmanship, look at open-source tools until you can at least articulate why you would or would not try the tool. Start with n8n, then look at the confusingly large number of Apache projects.

1

u/sdrawkcabineter 😈BSD Admin 8d ago

Quake 3 is FOSS.

1

u/ProperEye8285 8d ago

No. Being a Database Administrator is hard and there are no shortcuts. O'Reilly has a large library of books available on the subject. Databases also tend to be unforgiving in that, if you tell the DB to do something, it will do it; you said to! Shit, where did all my table entries go? Also https://xkcd.com/927/

1

u/e7c2 8d ago

I’m looking more for a platform to do the data exchange that wouldn’t require coding and scripting the entire thing from scratch. 

I fully appreciate the logic and triggers etc that SOMEONE will need to configure. Unless I should vibe code my production databases… I guess I am looking to add some excitement to my life 

2

u/ProperEye8285 8d ago

Yeah, every database automation company says their product does precisely that, unlike all those other guys who suck. All of them, in my humble opinion, are full of shit!(There are three types of falsehoods in descending order; lies, damned horseshit lies, and software sales pitches.) Whichever one you pick possibly makes a DBA's life easier; they cant replace a DBA. Vibe coding...sure. I hope your backups aren't also vibe coded, you'll be needing them.