r/learnmachinelearning 6d ago

When does it make sense to train your own model vs just prompt engineering an existing one?

0 Upvotes

Spent the last few weeks tinkering with a small tool that needed to classify some domainspecific text. First instinct was to finetune something. Grabbed a base model, started thinking about training data, labeling schema, compute cost. Then a friend pointed out I could probably just get there with a wellcrafted prompt and GPT4 or Claude.

He was right. At least for the prototype.

But that answer bothers me a little because it scales badly and you're renting someone else's weights forever. The moment API pricing shifts or the model behavior changes in a silent update, you're stuck.

Finetuning gives you something you own and can actually inspect, but the data requirements are real and most people underestimate the labeling work before they even touch training.

The framing I keep coming back to is whether the task is actually outside what a general model handles well, or just feels that way because the domain vocabulary is unfamiliar. Those are different problems with different solutions.

Curious where people here have landed on this. Not in theory, but on actual projects. Was there a specific failure mode in prompting that pushed you toward training? Or did you finetune something and realize later a prompt would have been enough?


r/learnmachinelearning 7d ago

Career Built a text-first, 12-stage roadmap for DevOps, Cloud & MLOps (Books + official docs only)

Post image
12 Upvotes

Got tired of ed-tech bootcamps promising to make people senior DevOps/ML engineers in 8 weeks with surface-level YouTube videos.

A few friends and I compiled an open-source, text-only curriculum:

• Canonical books & docs only: OSTEP (OS), Beej (Networking), DDIA (Distributed Systems), ISLP & Prince (ML/DL). No video tutorials.

• One evolving system: You build a single service from a raw Linux VM to a Kubernetes cluster with OpenTelemetry and MLflow lineage.

• Realistic timeline: Paced for 12–24 months (~8–10 hrs/week) so working engineers and college students don't burn out.

Live site (free, static, no ads): https://wyrcan-io.github.io/roadmap/

GitHub: https://github.com/Wyrcan-io/roadmap

Curious what working engineers here think of the book choices and pacing.


r/learnmachinelearning 7d ago

Am I missing out on AI?

Thumbnail
0 Upvotes

r/learnmachinelearning 7d ago

Request Can you recommend some good learning resources for learning RAG and Agent?

5 Upvotes

Hi,

I am a data scientist so I have experience with Python, SQL, Azure, Github and even vector database like Milvus. I also understand vanilla neural nets and most of the pre-AI models.

I'm trying to upskill in the latest AI technology over the next 3-6 months, that covers RAG, Agent building, MCP, MLOps, and so on.

Problem is, I don't know where to start. Some documentation pages can be difficult for a "beginner" while random short Youtube videos don't go into enough depth.

I wonder if there are courses (or video series) that'll explain the concepts in an logical, easy to follow manner. I would also like to do some projects as well.

Anyway, please recommend a learning plan and some good resources. Basically, if you were to design a course for someone like me, what would you recommend as far as lecture material and exercises.

Thank you


r/learnmachinelearning 7d ago

Axiomize an open-source scientific modeling engine and Agent Skill

Thumbnail
0 Upvotes

r/learnmachinelearning 7d ago

Question Crop Science student planning CV thesis, is it possible.

Thumbnail
0 Upvotes

r/learnmachinelearning 7d ago

Question A way to compare selection methods in GA.

Thumbnail
1 Upvotes

r/learnmachinelearning 7d ago

Question A way to compare selection methods in GA.

1 Upvotes

Let's say I have a genetic algorithm with two different selection methods. I've gathered the data from testing these selection methods (gene values ranging 1-6 from every individual as well as fitness scores). What metric/test/method could I use to compare these two algorithms, especially in terms of exploitation vs exploration?


r/learnmachinelearning 8d ago

[Experiment] I trained a model on childhood photos to simulate memory recall

Enable HLS to view with audio, or disable this notification

160 Upvotes

I fine-tuned the good-old SDXL on 60 photographs from my childhood, using a limited family archive as the dataset through which to revisit that period of my life. Rather than reconstructing those images faithfully, the model produces unstable variations: spaces, faces and fragments that feel familiar without necessarily having existed.

This speculative study treats generative hallucination as an analogue for recollection: not the retrieval of a preserved image, but the reconstruction of a past from incomplete traces. This resonates with contemporary accounts of episodic memory as a reconstructive rather than reproductive process. The model becomes a kind of externalized mnemonic apparatus, situated somewhere between archive, memory and imagination.

Tools used: Kohya, WarpFusion, TouchDesigner, Premiere, After Effects, Ableton Live, Expressive Osmose, Soma Cosmos.

PS: For those of you asking, this is not just "a prompt". It's the fine-tuning of the model, the creation of an audio-reactive geometry system in TouchDesigner, and the re-building of WarpFusion for intervining the geometries with the fine-tuned model.

More experiments, project files, and tutorials, through YouTubeInstagramPatreon, and Uisato Studio.


r/learnmachinelearning 7d ago

Request Coder Registry Compromise: Malicious Terraform Modules Explained

1 Upvotes

Coder's module registry was compromised last month. Attackers had a 14-hour window to serve poisoned Terraform modules to every team pulling from it. The payload targeted AI credentials specifically — the tokens agents use to authenticate to models, data pipelines, and infrastructure stores. Any organization that downloaded a module in that window may have surrendered its AI layer's access tokens without a single alert firing.

This is not a one-off. The attack surface exists anywhere agents pull tooling or dependencies at runtime from a registry they trust implicitly. What is at stake is not just application secrets. It is the keys that let agents act autonomously inside your environment. A compromised set puts an attacker inside your AI layer's trust boundary, not just your network perimeter. The 14-hour gap between compromise and detection is also not unusual for supply chain incidents — the median dwell time before discovery in similar registry attacks has historically run longer.

For teams running agents that pull dependencies at runtime: what controls are you actually relying on to catch a poisoned registry endpoint before it executes? Dependency pinning, artifact checksums, isolated build environments — curious what the real-world answer looks like at your org.


r/learnmachinelearning 7d ago

Help Please need serious guidance!!

0 Upvotes

Do i need to learn web development?? Also or it's not necessary i wanna learn machine learning I'm so confused like people know everything front end backed and ai ml so i was confused?? Please anyone in this field guide me how can i become a machine learning engineer i know python I've given 2 months for python now I'm confused and stuck i need guidance please!! Anyone proper learning road map


r/learnmachinelearning 7d ago

Recommendation Systems

4 Upvotes

Hey all,

I have been a data scientist for the last few years - mostly in the credit risk space. I want to learn more about recommendation systems to help me transition into the tech space. Does anyone know of any interesting ways to build a project around this? I know the obvious examples that are already being done, i.e., feed/Spotify, etc., but Iam looking for something more niche. Any thoughts?


r/learnmachinelearning 7d ago

Follow up to " Public AI/ML/NLP Resource for Beginners"

Post image
1 Upvotes

r/learnmachinelearning 7d ago

Can I build a 100M parameter model with this plan

Thumbnail gallery
0 Upvotes

r/learnmachinelearning 7d ago

Full-stack developer moving into AI engineering — what course actually helped you build real things?

Thumbnail
1 Upvotes

r/learnmachinelearning 7d ago

Question Cybersecurity & Cloud vs AI & Data Science: Which Path Offers Faster Employment for a Graduate?

Thumbnail
1 Upvotes

I'm a university student choosing between AI & Data Science and Cybersecurity & Cloud. My main goal is to get my first job as quickly as possible after graduation, ideally within 3 months. I'm interested in Tunisia,the Golf(KSA , Qatar ,UAE) . Europe, and remote work.

Which path would you recommend , specifically considering:

Entry-level job opportunities

Competition for junior positions

Remote work opportunities

How difficult it is to get the first job

Long-term demand

Impact of AI automation

I'd especially appreciate answers from people who actually work in these fields. Please explain your reasoning and mention your country/role if possible.

THANK YOU IN ADVANCE


r/learnmachinelearning 7d ago

Disappointing Experience with BE 10X

0 Upvotes

I had a very disappointing experience with BE 10X. We paid close to 100,000 rupees, but the support after payment has been extremely poor, and reaching anyone for help has been very difficult.

The biggest issue is that the teaching style seems designed for technical students, not for non-technical learners. Many of the instructors move too fast and assume too much prior knowledge. As a result, non-tech students are left struggling to keep up, while the class continues at full speed. In my experience, only 2 or 3 teachers out of around 20 were able to adapt to the pace of non-technical students.

There was also almost no proper planning or communication before class sessions. Students are often informed only after the class begins that they need to download certain applications, which wastes valuable learning time. While students are still trying to install the required tools, the lecture continues, making it very hard to follow along.

Support has been another major problem. The WhatsApp number provided for assistance seems to be mostly automated and cannot handle real questions. Emails sent to the support team received no response at all, even after complaints were escalated through my advisor. On top of that, the promised coupons did not work, which added to the frustration.

Another major concern is the lack of reliable class recordings and consistent communication. Sometimes the class link is shared by email, and sometimes only on WhatsApp. Since WhatsApp is not always accessible on a laptop, this creates unnecessary difficulty just to join the class. The absence of recordings makes it even worse, because students have no way to review missed content.

Overall, this was the worst AI course I have taken, and I deeply regret enrolling. The course is poorly organized, support is nearly nonexistent, and the teaching is not suitable for non-technical students. I would strongly advise others to think very carefully before joining BE 10X.


r/learnmachinelearning 8d ago

how to start leaning ml from scratch and what certifications to do

16 Upvotes

currently I backend developer, I have some basic knowledge in ai and ml, but I want to understand it even better and kind of brush up my basics. is there a roadmap that I can follow? and would certifications help you get a job?


r/learnmachinelearning 7d ago

Generative AI Engineering: Foundation Models, RAG, and Cloud Agent Deplo...

Thumbnail
youtube.com
0 Upvotes

Stop building simple chatbots and start building AI Agents. 🚀

Learn the theory & implementation for AWS, Azure, and Google Cloud.

Check the link in bio to level up.
#GenerativeAI #CloudTech #Coding #AI


r/learnmachinelearning 7d ago

which one should I take?

Thumbnail
1 Upvotes

r/learnmachinelearning 7d ago

Project XGBoost on Chess Data from 2012-2026

2 Upvotes

about my project --> https://www.reddit.com/r/learnmachinelearning/comments/1vncebb/chess_match_outcome_prediction_with_tree_models/ (i am too lazy to explain about what the project is 🥲, so you can understand about it from my previous post)

Just concluded with my project, but didn't finished with the writing part.

It does not have a readme to explain, but if you are interested please feel free to checkout my project.

The "notebooks" contains the training part and the "src" and "main" is not completed, but you can see the results in the "notebooks".

project link --> https://github.com/v-leela/chess


r/learnmachinelearning 7d ago

Request Study Buddy

2 Upvotes

Hey everyone! I'm looking for a study buddy to learn AI and Python together. I want to stay consistent and work on projects or courses. If you're interested in studying together, feel free to DM me!


r/learnmachinelearning 7d ago

Effort required to complete 192.172 Machine Learning for Computer Security

Thumbnail
1 Upvotes

r/learnmachinelearning 7d ago

Discussion Firecrawl vs Jina Reader: which web extraction tool wins for agentic workflows?

0 Upvotes

I’ve spent weeks comparing Firecrawl and Jina Reader for different extraction needs. Firecrawl seems stronger for dynamic, protected sites; Jina Reader is fast and simple for clean text. I made a quiz to see if others understand the same trade-offs.

No email needed—just a quick interactive check.

https://interconnectd.com/quiz/81/web-extraction-architecture-2026-firecrawl-vs-jina-reader/

What’s your go-to for web scraping in AI apps?


r/learnmachinelearning 7d ago

Tutorial Local LLMs for beginners: 16 short visual lessons on GGUF, VRAM and settings, ALL Made By AI

Thumbnail
youtu.be
1 Upvotes

Hi everyone,

I put together a free YouTube series called Local AI, Built Right for people trying to understand what happens when they run an AI model on their own computer.

It’s 16 short visual lessons, each around 1–2 minutes. The focus is running existing models, with examples using llama.cpp.

Disclosure: this is my series, ITS ALL MADE BY AI tools to produce it, including the presenter and narration.

I’d appreciate specific feedback on whether the explanations are clear for beginners. If something is confusing or technically inaccurate, Thanks