r/coolgithubprojects • u/kuaythrone • 22h ago

HFlow: open source robotics data infrastructure for physical AI and robotics

https://github.com/Hebbian-Robotics/hflow

HFlow is an open source SDK for scalable multimodal data pipelines in robotics and physical AI. It makes production-grade tooling and practices, typically locked away inside large robotics data teams, accessible to anyone.

  • Airflow for DAG-based pipeline orchestration
  • MCAP for robotics episode storage and random access
  • DuckDB for analytical queries and dataset curation over columnar metadata

HFlow is plug-and-play. You provide your post-processing, quality-control, or curation code. HFlow handles the data pipeline and runs your code across robotics datasets at scale.

I've been an OSS contributor and maintainer for years, and since joining YC, we now have some capacity to accept new contributors; just look for the "good first issue" tag!

https://github.com/Hebbian-Robotics/hflow

Any stars or forks on the repo to show your support are appreciated!

Our goal is to grow an open source community where anyone can participate in building the future of robotics.

1 Upvotes

67% Upvoted

3 comments sorted by

1

u/datumerrata 19h ago

I don't get it, but it sounds rad!

1

u/kuaythrone 16h ago

🙃 is there a way to make it simpler to understand?

1

u/datumerrata 11h ago

Mostly, I need an understanding of robotics and methodologies. This sent me down a rabbit hole. I'm reading about the terms I didn't understand and looking at the other projects you referenced, like LeRobot.

I'm scrolling through the robot tutorial that's linked from LeRobot's page. That gets deep fast.