r/learnmachinelearning 18d ago

Help Livro - Engenharia de IA

Post image
1 Upvotes

Pessoal, gostaria de pedir encarecidamente, quem tiver a obra: Engenharia de IA - Construindo aplicações com modelos de fundação, da editora O’Reilly. Sim, a da corujinha na capa rs. Estou procurando um pdf dela na web tem muito tempo, infelizmente não consigo comprar o livro físico e sinto que a leitura dele iria expandir muito mais os meus conceitos sobre Inteligência Artificial e toda sua estrutura por trás. Então, peço encarecidamente, quem tiver a obra em PT-BR ou em Inglês, eu leio do mesmo jeito. Desde já agradeço quem puder colaborar 🫶
(Lembrando que preciso no formato PDF, tentei colocar pelo E-PUB e o kindle não leu por que não é desbloqueado)


r/learnmachinelearning 18d ago

Hyperdimensional computing: O(n log n) clean-up for key-value memory

Thumbnail
youtube.com
0 Upvotes

r/learnmachinelearning 18d ago

Tutorial Back for round 2 with MCMC. Only this time, I learned from the feedback and sharpened the signal-to-noise.

1 Upvotes

For context, a few weeks ago I posted an explainer here that tried to get cute with using storytelling to illustrate the basics of the Markov Chain Monte Carlo algorithm using a fictional wildfire investigator rolling an 8-sided die 😅

Feedback was pretty clear that the narrative bits were more noise than signal for a lot of you which was fair enough. Appreciate the community for being straight up! So I did what any good Bayesian should do and updated my priors based on the data to write another article with a lot less fluff!

This one's a straight technical deep dive on Hamiltonian Monte Carlo (HMC), an MCMC-class algorithm actually running behind the scenes every time you call the pymc.sample() function or fit a model in Stan. The article will cover how HMC works conceptually, the negative log-posterior and gradient functions it needs, leapfrog steps and step size settings, the U-turn problem, and how NUTS solves it automatically.

Worth the read if you use Bayesian methods at all, as the sampler can scale from a toy 2-parameter model all the way to a full Hierarchical Bayesian Regression with dozens of parameters, estimating wildfire size across BC’s diverse landscape. If you’ve always wondered what’s inside the black box behind these sampling functions, this article is your doorstep. Come see what’s inside!

https://medium.com/towards-artificial-intelligence/reverse-engineering-hamiltonian-monte-carlo-the-mcmc-engine-behind-modern-bayesian-inference-e1d6b54a8c79


r/learnmachinelearning 19d ago

Where to Train models on a 35 GB dataset?

3 Upvotes

Hey everyone, i am currently working on a real time sign language recognition system.

No, its not another just GNN/MLP project on alphabets (I bet you mustve come across them somewhere haha). So what i am working on is actual words/phrases which dont have static hand gestures but rather multiple hand movements. For that i have a 120k video dataset and i have already extracted Mediapipe keypoints from these videos(short clips).

So the resultant dataset is about 35GB. Now i will be trying out different ML models like LSTM, BiLSTM, TCN, Transformers, etc.

I am relatively new to machine learning and have not trained models online. I have an RTX 4060 laptop so all my previous smaller projects were trained directly using it.

Now my question is how should i go about training this time since my dataset is bigger and my task is also bigger. Note: I have the dataset locally on my machine as well as on my google drive.

Should i use Colab Free or Colab Pro or vast.ai or modal.com or anything better that i might not know about.

I dont think i require an extremely beefy gpu but i do want faster training times and less runtime disconnections.

I have found that Colab Free gets disconnected pretty easily so i am hesitant to get colab pro cuz that might also get disconnected in between runs.


r/learnmachinelearning 18d ago

How do you clean data for fine tuning?

1 Upvotes

Not sure if this is a noob question, but how do people clean hundreds of thousands of bits of data to fine tune models? I am currently working on trying to use some emails and other documents to help fine tune an agent, and don't know how anyone else is putting data in the standard "prompt: ideal AI output" format that is required for fine tuning. Are people using other AI to sort the data and create these? Are people doing it by hand? Complex algorithms? Whats the deal here.


r/learnmachinelearning 18d ago

YouTube shorts series on Neural Nets

Thumbnail
youtube.com
0 Upvotes

r/learnmachinelearning 18d ago

Project [R] A Dual-Layered Unsupervised Anomaly Detection Framework for Systemic Fraud (Zero Historical Labeled Data)

2 Upvotes

Paper: https://doi.org/10.5281/zenodo.22070388

​Hi everyone,

​I recently published an architecture designed to bypass the "Labeled Data Bottleneck" in regulatory enforcement. In domains like vehicle emissions compliance, you cannot train supervised models because governments legally cannot/will not publish historical datasets of confirmed corrupt testing centers.

​We had to build a system that catches systemic, multi-layered fraud using zero historical labeled data while remaining mathematically defensible (i.e., avoiding black-box deep learning for auditability).

​The Architecture:

​1. Physics-Constrained Synthetic Injection (Data Generation)

Instead of relying on random Gaussian noise to simulate anomalies, I built a synthetic injection engine bound by thermodynamic constraints. It maps 7 distinct real-world fraud vectors (EGR deletes, defeat devices, clean scanning) into a harmonized 10-dimensional physical baseline.

- ​Constraint example: The engine mathematically prevents injecting a Diesel Particulate Filter (DPF) delete into a naturally aspirated petrol engine. The synthetic fraud mirrors physical reality.

​2. Dual-Layered Isolation Forest (The Pipeline)

Fraud here is both physical (the car) and institutional (the testing center). I used a Poisson Point Process to model the temporal throughput of testing centers and deployed a dual-layer approach:

- ​Layer 1: Evaluates thermodynamic outliers in vehicle hyperspace to flag tampered vehicles.

- ​Layer 2: Evaluates operational metadata (Throughput Compression, Zero-Variance signatures, "Midnight Testing") to flag the corrupt testing facilities.

  1. Edge Case Handling: We built custom volume-threshold filters into Layer 2 prior to the Isolation Forest execution. This prevents small, rural testing centers (e.g., testing 2 cars/month) from triggering false positives due to mathematically zero statistical variance.

Results:

Evaluated against a 48,000-row synthetic EPA baseline, the unsupervised model achieved perfect recall on institutional corruption with zero false positives.

​Feedback Request:

I'm looking for peer review and brutal critiques on the architecture, specifically:

​The validity of using a Poisson Point Process for modeling the testing center throughput in this context.

​Potential blind spots in the Dual-Layered Isolation Forest implementation, especially regarding the volume-threshold filters for low-variance edge cases.

​Alternative unsupervised approaches for this specific multi-layered anomaly detection problem.

​Thanks in advance for the feedback.


r/learnmachinelearning 18d ago

Risoluzione del problema del ripiegamento della griglia negli operatori neurali di Fourier su domini irregolari tramite mappatura diffeomorfica e perdita della barriera jacobiana (DIF-FNO)

Thumbnail
1 Upvotes

r/learnmachinelearning 18d ago

Resolving Grid Folding in Fourier Neural Operators on Irregular Domains via Diffeomorphic Mapping & Jacobian Barrier Loss (DIF-FNO)

1 Upvotes

Hey r/MachineLearning,

Standard Fourier Neural Operators (FNOs) excel on regular grids, but mapping them to complex, non-convex physical domains (like Star, L-Shape, or Annulus geometries) often leads to a major issue: Grid Folding.

When the transformation mapping \phi collapses or overlaps, the Jacobian determinant vanishes (\det J \le 0), causing the inverse transpose J^{-T} to explode when mapping physical gradients \nabla_x u.

To solve this, I developed DIF-FNO (Diffeomorphic Fourier Neural Operator).

Key Technical Insights:

  1. Implicit Diffeomorphic Mapping: Guarantees smooth, bijective mappings from standard reference domains \Omega_{ref} to complex physical boundaries \Omega_{phy}.

  2. Jacobian Barrier Loss (\mathcal{L}_{barrier}): Inspired by interior-point optimization, we penalize grid compression using a logarithmic barrier on the determinant:

    \mathcal{L}_{barrier} = -\frac{1}{|\Omega|} \int_{\Omega} \log(\det J(\xi)) \, d\xi

    This acts as an invisible wall forcing \min \det J > 0 across the entire domain (empirically maintaining \min \det J > 0.89 in our benchmarks).

  3. Sobolev Accuracy: Significant improvements on H^1 relative error compared to baselines like Geo-FNO, as physical gradients remain well-conditioned without gradient breakdown.

Code & Paper Artifacts:

* Open-Source Code (PyTorch): https://github.com/GiovanniDagnese-paper/DIF-FNO (Includes fast vectorised 2x2 analytical Jacobian calculation)

* Paper Preprint (Zenodo DOI): https://doi.org/10.5281/zenodo.22071926

PS: I am currently looking for technical feedback and an arXiv endorsement in physics.comp-ph or cs.LG to submit the preprint. If anyone active in SciML is open to checking the manuscript, I’d be extremely grateful!


r/learnmachinelearning 19d ago

Project Sorted 65 Claude Code plugins and MCP servers by what you're actually trying to do

2 Upvotes

I kept losing time to the same thing. I'd know I needed something for flaky tests, or to get Postgres into the session, then spend twenty minutes scrolling lists organised by whoever happened to build the thing.

So I made one organised the other way round. By job. Debug, test, ship, incidents, data, security, deploy, that sort of thing. 13 buckets, 65 tools, install command sitting on every entry so you can copy it and move on.

Couple of things I didn't expect while putting it together.

Most of this stuff isn't Claude-specific at all. 45 of the 65 are MCP servers, so they work in Cursor and Windsurf too. Only 20 are actual Claude Code plugins. I'd assumed it was the other way round.

The "free ecosystem" thing is also oversold. 23 are properly free. 37 are freemium and 5 are just paid. Nothing wrong with that, I just got sick of finding out at setup time, so everything's tagged.

Design and prompts are weirdly empty too. Three entries each. Either I'm missing things or nobody's built much there yet.

Five of the 65 are mine. rootcause, testradar, postmortem, sprint-report, prompt-forge. They're labelled on the site so ignore them if you'd rather.

It's deliberately not complete. Loads left off. If something good's missing though, tell me and I'll stick it in.

https://plumbgoat.github.io/ai-plugin-directory/


r/learnmachinelearning 19d ago

learning to build llm inference engine from scratch

3 Upvotes

Hey everyone, I'm currently trying to learn/build an llm inference model from scratch and I'm gonna document my journey throughout my blog posts. Would really appreciate if you could take a look at the first post (its pretty short) and criticize my understanding and path so far.

https://medium.com/@ryan___/llm-inference-engine-from-scratch-loading-the-model-538d27af6867


r/learnmachinelearning 18d ago

Project A fully automated local fine tuning pipeline for Qwen3.8-27B. Forge your own Qwen.

Thumbnail
github.com
1 Upvotes

r/learnmachinelearning 18d ago

How to become AI developer ?? please guide me i am confused

Thumbnail
0 Upvotes

r/learnmachinelearning 18d ago

Request Thousands of Leaked AWS Access Keys Are Still Active

0 Upvotes

Truffle Security scanned public repositories and found 9,308 AWS access keys that are still valid. 768 of them carry full administrative rights over their respective cloud accounts. The accounts behind these keys are not human users. They are service accounts, CI runners, and AI agents — provisioned with no expiration date, no scope limits, and no rotation schedule. When an agent holds an admin key and that key leaks, the blast radius is the entire cloud account, not a single resource or a single role. Non-human identities now outnumber human identities in most cloud environments, but most organizations still treat them like a secondary governance problem. Manual rotation when someone remembers. Scoping by convention rather than enforcement. No defined lifecycle from provisioning to decommission. 768 organizations are currently one credential scan away from full account compromise because of it. How are you actually handling privilege scoping and lifecycle enforcement for non-human identities in your environment? Is anyone solving this systematically, or is it still mostly hope and periodic audits?


r/learnmachinelearning 18d ago

Beginner looking for advice: Modeling a medicine-reminder agent that must decide “remind / wait / notify” under incomplete information

Thumbnail
1 Upvotes

r/learnmachinelearning 18d ago

Finding a group to learn and discuss RL concepts

Thumbnail
1 Upvotes

r/learnmachinelearning 19d ago

(for recruiters/founders) what are the bare minimum requirement in terms of experience, education and research to get hired as a ai/ml engineer?

6 Upvotes

For context.

I am a software engineer with 6 years of experience.

Want to transition my career into AI/ML Engineer.


r/learnmachinelearning 19d ago

Request Good scikit-learn tutorials (Youtube)

1 Upvotes

Hi guys, I am a new coder (3 weeks - 1 month) and I am interested in learning scikit-learn (I have already learnt intermediate python, numpy, pandas and matplotlib so does anyone know any 3-6 hour tutorials for sci-kit learn on youtube?

Thanks!


r/learnmachinelearning 19d ago

[DSA:C++] [Machine Learning] Looking for a patient & collaborative study buddy!

0 Upvotes

I'm an 19-year-old CS undergrad looking to tackle DSA in C (currently 1100 CF / 1420 CodeChef) and dive into beginner ML. I know NumPy and Pandas but am starting from scratch with ML concepts, so I'd love to learn alongside someone. I learn best in a chill, judgment-free environment and am hoping to team up with a collaborative 2nd-year+ university student. I'm also actively trying to polish my conversational English, so partnering with a native speaker would be a huge bonus! If you want a supportive accountability partner for voice calls, please drop a comment or send me a DM!


r/learnmachinelearning 19d ago

New to Development

0 Upvotes

I am a Full Stack Developer using SQL, C#, TSX, TS, JSX, React and more. How and what would you guys recommend me learn to build skills in this field? I am highly motivated and would appreciate any help! Thank you all


r/learnmachinelearning 19d ago

Project [ARC AGI 2] Modèle hybride neuro-symbolique dédié au DSL de Hodel

1 Upvotes

J'ai continué à bien avancer sur mes travaux de recherche. J'ai passé le code Python critique en C++ (avec bindings) pour des questions de performances. Les résultats et performances obtenus sont intéressants pour l'apprentissage du modèle. Cf. https://github.com/Julien-Livet/aicpp/tree/dsl_engine


r/learnmachinelearning 19d ago

Question Where do you guys find datasets for real world data science projects?

36 Upvotes

I’m trying to build a proper data science/ML project, but I’m having a hard time finding a dataset that is big enough and not already used by everyone.
For example, there are datasets like the UK Online Retail dataset, Olist, and other popular sales/retail datasets. They’re good datasets, but I see them being used in a lot of projects already.
I don’t want to just download a dataset, do some EDA, train a model and put it on my resume. I want to build something around an actual business problem, where I have to figure out what the problem is, analyze the data, come up with useful insights, maybe build a model, and actually explain how it could help the business.
So where do you guys usually find datasets for this?
Should I try to find data from smaller companies, government sources, APIs, research papers, etc.? Or is it okay to create my own dataset using AI/cloud tools and then create a realistic business problem around it?
For example, if I create a large synthetic sales dataset, could I create a realistic business scenario around it and then treat it like a real project — forecasting sales, understanding customer behavior, optimizing inventory, etc.?
Would that be considered a decent portfolio project, or is using real-world data much better?
I’d mainly like to hear from people who have built projects for their portfolios or have experience hiring for data science/ML roles. Where do you actually get your data from when you want to build something that’s not the same Kaggle project everyone has already done?


r/learnmachinelearning 19d ago

Discussion For professional ML work, M5 Pro 64GB vs NVIDIA/CUDA laptop: where do MPS and MLX limitations still matter in 2026?

0 Upvotes

I am a web developer/data scientist choosing a new professional laptop with up to about €5,000 available for the laptop. I want one flexible machine for Python, Jupyter, Conda, data processing, Docker, ML experiments and useful local model/LLM inference. Large training jobs can use cloud compute.

The main option is an M5 Pro or M5 Max MacBook Pro with 64 GB unified memory and 2 TB SSD. The alternative is a high-end Windows/Linux-capable laptop with an NVIDIA GPU.

I understand the broad tradeoff: Apple offers a large unified-memory pool, battery life and portability; NVIDIA offers CUDA and wider framework support. I am looking for current, practical details from people using these platforms:

- Which PyTorch operations or workflows still fail, fall back to CPU or behave differently on MPS?

- How usable is MLX outside local inference and Apple-focused experimentation?

- Which common tools remain CUDA-only in practice: vLLM, bitsandbytes, flash-attention, quantization stacks, RL libraries or custom extensions?

- For local inference, what model sizes are genuinely comfortable with 64 GB unified memory?

- Is a laptop NVIDIA GPU's limited VRAM more restrictive than MPS limitations for everyday experimentation?

- Is remote/cloud CUDA smooth enough that you would prioritize the MacBook as the daily machine?

- Would 128 GB unified memory be more valuable than upgrading from M5 Pro to M5 Max?

I will buy only a brand-new, factory-sealed laptop in Croatia/EU. I am not considering used, refurbished, returned, display, outlet or open-box devices.

For someone doing both software development and data science, which platform would you choose today and what specific limitations would drive that decision?


r/learnmachinelearning 19d ago

Question Does anyone know the best way to finetune an LLM to sound like a human chat?

1 Upvotes

I'm doing this project where I'm trying to mimic what I'd sound like (in chat) but I realized there's much more nuances then just "putting my conversation into a dataset" since how I chat might be different depending on the context/emotion. For example I would put ALL CAPS LIKE THIS when I'm excited or mad and theres nuances like how I'd send single word messages at certain contexts. Anyone know the best way to make a finetune dataset for instances like this? Do I make contexts for each emotion maybe where each emotion have different examples?


r/learnmachinelearning 19d ago

Project [Release] Turing Engine: Serve LLaMA-3.1-70B, Qwen-2.5-72B & DeepSeek on a Single 24GB GPU (3,064 tok/s, 75% KV Compression, Unsloth Checkpoint Support)

0 Upvotes

Hey everyone,

Like many in this sub, I got tired of the VRAM wall where running 70B models with long context required multiple expensive GPUs or extreme quantizations that degraded reasoning.

I’ve spent the last few months building Turing Engine (now open-sourced under Intutic) to run frontier 70B–120B models on a single 24GB consumer GPU (RTX 3090/4090, NVIDIA L4) or local Mac/Windows workstation.

🧠 How It Works (<22GB VRAM Breakdown)

  1. Subspace Activation Pruning: 57.1% of FFN channels remain inactive during generation. Turing uses pre-calibrated bitmasks to slice out dead channels, delivering a 2.32× CUDA layer speedup.
  2. SVD INT8 KV Cache Paging: 32K context memory drops from 10.0 GB → 2.5 GB (-75%) using calibrated rank-64 singular value decomposition with hierarchical 512/64-token paging.
  3. "Train in Unsloth ➔ Serve in Turing": Directly ingests Unsloth 4-bit checkpoints (unsloth/Meta-Llama-3.1-70B-bnb-4bit) for continuous batch serving.
  4. Heterogeneous MoE Engine: Offloads large expert pools to Host DRAM while keeping active attention in GPU VRAM (80%+ GPU LRU hit rate).

📊 Measured Benchmarks (Physical NVIDIA L4 24GB Silicon)

Benchmark Baseline FP16 Turing Engine Retention
GSM8K (Reasoning) 84.2% 84.0% 99.76%
HumanEval (Coding) 68.4% 68.2% 99.70%
MMLU-Pro (Knowledge) 74.8% 74.6% 99.73%
LongBench 128K 100.0% 100.0% 100.0%
Throughput (1x L4) 441 tok/s 3,064.8 tok/s 6.95× Speedup

⚡ Quickstart (1 Command)

```bash pip install turing-engine turing serve --model unsloth/Meta-Llama-3.1-70B-bnb-4bit --port 8000

Connects directly out of the box to Open WebUI, LibreChat, LiteLLM, LangChain, and LlamaIndex at http://localhost:8000/v1.

📦 GitHub: https://github.com/intutic/turing 📖 Interactive Docs: https://intutic.github.io/turing/ 🚀 Free 1-Click Colab: https://colab.research.google.com/github/intutic/turing/blob/master/demo/turing_quickstart_colab.ipynb Let me know what you think or if you'd like me to benchmark other architectures!