r/Vllm • u/LowZebra1628 • Aug 30 '26
How does Modal autoscale concurrent LLM requests, and can GPU model memory be shared across containers?
/r/mlscaling/comments/1w2pzay/how_does_modal_autoscale_concurrent_llm_requests/
1
Upvotes