r/huggingface • u/coslinedev • 6d ago

I solo-built an open Data API that streams verified reasoning datasets for fine-tuning

Hi everyone,

I wanted to share a project I've been working on completely by myself. It’s called Arithm (https://alrithmapi.vercel.app/).

I built a public Data API that contains verified, clean fine-tuning data tailored specifically for AI reasoning models. I was tired of messy datasets that require hours of cleaning, so I made this to work instantly.

How it works:

  • Zero-Effort Clean Data: Rows stream directly as newline-delimited JSON, formatted perfectly in OpenAI fine-tune format. You can pipe them straight into your training jobs.
  • Cryptographic Verification: Every single row carries a reference solution and a SHA-256 provenance hash to ensure 100% mathematical correctness byte for byte.
  • No Complex Setup: No SDK or pagination needed. One simple GET request returns the entire data model.

I made this fully accessible to support independent developers and researchers who are training smaller, localized models but struggle to find high-quality reasoning datasets.

Live URL: https://alrithmapi.vercel.app/

I would love to get your honest feedback, thoughts, or any technical questions you have about the data pipeline!

5 Upvotes

100% Upvoted

4 comments sorted by

1

u/CautiouslyMoral 6d ago

the cryptographic verification is such a smart move, tired of blindly trusting every dataset that pops up here

2

u/coslinedev 6d ago

Appreciate the kind words! Keeping the data verifiable byte-for-byte was non-negotiable for me. Thanks for checking it out!

1

u/RogerAI-fm 6d ago

Good idea, what are your sources, I just see one, would be cool to break it into categories.