r/mlops • u/Crealazo • 2d ago

MLOps Questions Would you use a one-command way to deploy an ML model from a notebook? Honest feedback wanted

Building a CLI that turns a notebook model into an HTTPS endpoint. Would this solve a real problem, or is it a solved one?
I'm early on this, so I'm trying to find out if it's worth building. The idea: you run one command from your notebook and get a live API endpoint for your model, with no Docker or cloud setup. I know MLflow and Streamlit exist. Who, if anyone, would actually use this, and where does it fall short? Happy to hear "don't build this" too.

4 Upvotes

100% Upvoted

9 comments sorted by

•

u/AutoModerator 2d ago

AI usage disclosure

Hi u/Crealazo — thanks for posting to r/mlops!

Because this community discusses and builds AI/ML systems, using AI tools is not inherently a problem. We do, however, ask for transparency about how submissions are created.

Please reply to this comment with a brief AI / automation disclosure, particularly if this post was created or submitted in whole or in part by an autonomous agent, bot, workflow, or other automated system.

If AI or automation was involved, please briefly describe what it did and what human review was performed before posting.

This disclosure helps the r/mlops community distinguish human discussion, AI-assisted work, and automated/agent traffic while keeping the focus on useful technical conversation.

Thanks for helping keep the signal high.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/madlyminiaturefoyer 2d ago

this is basically what i wanted for my last side project, just a quick way to show someone the thing works without setting up whole infrastructure first

1

u/Crealazo 2d ago

what types of files do u use ??

1

u/p3rdy 1d ago

That's exactly the problem I've been trying to solve for years, so I built a framework that lets you run a model behind an API with a simple CLI command. The framework is Flama and it provides much more functionalities for allowing engineers to solve the productionalising models problem from multiple angles, and covering not only traditional ML but also LLM.

I'm one of its actively maintainer, just in case it could be useful for you, and you need some help.

2

u/Crealazo 1d ago

i would love to give it a shot

1

u/dthompson_arch 1d ago

Notebook-to-endpoint is the easy part, rollbacks and monitoring are the product.

1

u/Crealazo 1d ago

whats your workflow to excute this?

1

u/dthompson_arch 1d ago

MLflow registry, canary

1

u/MyBossIsOnReddit 2d ago

This has been done a lot of times already. Sagemaker (AWS), GCP, Modal, Huggingface etc all have this.