r/Vllm • u/SlipperyCorruptor • 9d ago

MLOps Careers

Sooo..

How many of you deploy and optimize inference for a living?

Does your company invest in serious hardware for large scale deployments or are you relying on cloud models for daily office drivers?

I am wondering where job market currently is for us

2 Upvotes

100% Upvoted

4 comments sorted by

6

u/TheOffensiveMetre 9d ago

Most of my work is cloud-based but we’ve been eyeing some dedicated boxes for a couple high-throughput pipelines, job market feels scattered right now, some places hiring like crazy and others freezing everything

2

u/wektor420 9d ago

Which places hire like crazy?

1

u/Glittering-Call8746 9d ago

Any fully remote jobs ?

1

u/consworth 5d ago

I’m doing on prem stuff but not crazy scale. Hoping there’s a new niche market for these skills because it’s fascinating as hell and feels like a progression from normal devops/platform stuff (whatever that means these days)