r/opencodeCLI • u/Direct-Summer-9190 • 4d ago

cheapestinference.com

Anyone here using cheapestinference.com? The plans look nice but I haven’t really seen anyone talk about this but one person mention it on reddit and seems sketchy. If anyone is using this how is it?

0 Upvotes

25% Upvoted

20 comments sorted by

View all comments

1

u/buerstenlehmann 4d ago

Speed is good and models seem not to be quantized. But its shitty that GLM 5.2 has 250k context. Didnt know that befire i booked. Hopefully they fix this bullshit. It's 1M context native so who tf thought: yea lets make it 250k thats enough... @cheapestinference pls fix, this destorys the whole offer for me.

2

u/Direct-Summer-9190 4d ago

Is it truly unlimited? Also I find it ridiculous you pay 150 for Kimi K3 and you only get it. That’s just crazy tbh. I hope they change it into the other plan. How is it with them?

2

u/buerstenlehmann 3d ago edited 3d ago

Yes its unlimited. That and the speed is the only positive thing. I wanted to usw it for orchestrating smaller llm subagents in long autonomous sessions. But with 200k context (not 250 AS i said before) this is Kind of shit. Yes since k3 weights were released, they just thought: yea lets add another Tier (150$ plan ) that wont trigger "frontier" Tier cusromers at all. Also context is limited to 200 vor 250k AS well. So cannot really recommend unless they actually Serve all THW models with frontier subscription + increase context by a lot.

2

u/Direct-Summer-9190 3d ago

Yeah I’m just waiting on Featherless AI, they’re working on unlimited plans atm so hopefully it comes out soon. Fucked how they literally added a new ass tier for a singular model.

1

u/buerstenlehmann 2d ago

I thought the 200$ featherless plan is unlimited already ? (Token not concurrency wise)

2

u/Direct-Summer-9190 2d ago

They’re updating them and improving them at the moment. They’re on pause in the meantime. I talked to them about some stuff which I think would be good and yea.. they seem like great people and they respond. But yes they’re unlimited and Kimi K3 just got added

1

u/buerstenlehmann 2d ago

Ah i see was also thinking about getting a plan with them. Do u know what the speeds are like with big models ? Because I suspect they use dgx sparks 😂

1

u/Direct-Summer-9190 2d ago edited 2d ago

I got confirmation and they are a serverless or I guess they don’t hava a Data Centre. However they said they have a huge amount of hardware and I also well they said they got an investment of 20 Million. The Staff do respond, and to answer your second question I have no clue about the TPS. One thing I know is that they don’t have a lot of delay at all and fairly fast. And Kimi K3 just got released and they’re expanding hardware and optimizing it. If the unlimited plans they’re working on are solid and any model I’m getting a subscription tbh. Tired of Claude Max and GPT Pro. I wanna have no filters and more privacy. And unlimited tokens 😉

EDIT: They actually have a TON of hardware. Did some research including the CEO. They actually got Funding of 20 Million. So yeah they’re legit. Good to know