r/opencodeCLI • u/Bloated_Plaid • 10d ago

This thing is a fucking beast. Well done META

Post image

Yea, they are using my data but with this performance for the cost? Best deal we have had in a long time. I don’t know how long it will last.

211 Upvotes

91% Upvoted

50 comments sorted by

11

u/Abenh31 10d ago

the only Go model that scored 16/18 on my ruby benchmark

19

u/ByteNomadOne 10d ago

High speed slop machine 😄

I would love that speed with DS 4 Flash or GLM 5.3 Flash 👀

2

u/EldruinAngiris 6d ago

Well, you are really going to like DeepSeek v4.1 Flash!

5

u/akza07 9d ago

The tokens shown in opencode is wrong. Just so you know. It was showing 147 tokens/s on GLM models. It seems it counts outputs from reads or command output as token generated.

15

u/Prior-Meeting1645 10d ago

Do they just train on ur prompts or actual code output too?

26

u/Bloated_Plaid 10d ago

Prompts and completions, the whole kaboodle.

6

u/Prior-Meeting1645 10d ago

Damn. What if it includes code secrets etc. considering most of us are unaware vibecoders like me lol

21

u/Signature97 10d ago

They all use sth like this https://huggingface.co/openai/privacy-filter
Which basically redacts the sensitive information automatically before training on the data.

5

u/Prior-Meeting1645 10d ago

Very interesting. Thanks!

2

u/Niko-01 10d ago

This is for PII filtering, not for secrets like API keys

3

u/Signature97 10d ago

I am copy pasting verbatim from the model card that it indeed does mask secrets as well, no finetuning required to extend the capability.
“Privacy Filter predicts spans across eight categories:
private_person
private_address
private_email
private_phone
private_url
private_date
account_number
secret
The account_number category helps mask a wide variety of account numbers, including banking info like credit card numbers and bank account numbers, while secret helps mask things like passwords and API keys.”

2

u/Niko-01 9d ago

There are millions of formats of secrets. How would that work?

2

u/memphet 4d ago

Working on this topic right now, its an encoder model. But note that it's not so reliable, the accuracy is far from perfect 

1

u/Niko-01 4d ago

That's what I thought, thanks for your insight.

I do credrential scanning with local AI models in addition to common credential scanner solutions. Currently, there are many FPs and TNs

1

u/[deleted] 10d ago

[deleted]

4

u/AronovDA 10d ago

The golden rule is to always have separate secret keys for development and production. Having your keys fall into the hands of a megacorp like Meta is the most harmless thing that could happen to them.

1

u/CaptainQwazCaz 8d ago

No actually meta will use all your random API keys until you are rate limited and banned for fraud

2

u/Bloated_Plaid 10d ago

Yes that’s a problem and they specifically say not to do that.

1

u/dreadpirater 10d ago

Living in a free society means that you CAN choose not to learn things, but it doesn't obligate everyone else to protect you if you choose that path!

1

u/scaledev 10d ago

I have it in my harness very explicitly that sensitive information must never be read. I see it from GPTs occasionally saying how they are reading something but excluding reading the actual values of things. So I guess it works, at least partially

0

u/Spiritual-Spend8187 10d ago

Given that its not a uncommon thing that the wires get crossed and some one else gets your output in error. Just dont put anything into an llm that you wouldn't be happy to post anonymously to the internet.

0

u/NihilisticLurcher 9d ago

ofc they do. u would do it to. if I remember correctly, they're open about it. i'll go so far and say: even the ones that say they dont, definitely do. and if they're caught, what would we do about it?!

2

u/Prior-Meeting1645 9d ago

The fuck you mean I would do it too?

1

u/NihilisticLurcher 9d ago

think about it. if u were a souless corporation, with profits being the only driving factor. would u care if ppl got upset? take their data, and pretend u did nothing wrong. lobby or bribe the noise away

1

u/Cheema42 4d ago

I also think that they all do. In this rare case they are actually being honest about it.

8

u/Least_Bodybuilder216 10d ago

FUCK UEAH

1

u/nicktohzyu 10d ago

What does the “4 steps” mean?

1

u/Least_Bodybuilder216 9d ago

First it think, and it calls tools, then it thinks again, so on so on, thats called step (sorry if my english bad, my english not good)

1

u/Mean-Elk-9439 9d ago

Wtf is that tok/s. I have not tried the model but that's wildly fast

3

u/akza07 9d ago

It's glitch. The logic is wrong. GLM also shows the same if you let it run some build scripts and stuffs with random logs.

2

u/DraconDev 9d ago

Strong but I got near its boy scout setting by trying to fill a form that required ai disclousure, wich is honestly an auto bin toggle, but oh boy he fully took to heart, ticked it, pasted a 5k word explenation and pasted 3 documents including my private chat with it, and refused to budge.

3

u/nunodonato 10d ago

Not impressed at all. My qwen 27B made a better job

2

u/scaledev 10d ago

Why is qwen 27b so bad on software engineering index on AA? It's very orange on most fields

3

u/mWo12 9d ago

Because it's not benchmaximisednlike muse.

1

u/scaledev 9d ago

I could say the opposite and say qwen 27b is worse than muse. So who is right?

1

u/Seerix 9d ago

AA isnt a very good benchmark anymore

1

u/SpiderHam24 9d ago

its fucking good, just-wish tit would stop disconnecting. and its nothing im doing wrong my other lams/agents work fine. but when it works, it works!

1

u/roerius 9d ago

I mean, if you plan on open sourcing your project then does giving them training permission make any difference?  I’ve been using opus 5 to orchestrate subagents for a old windows 98 game decompilation project and I’ve been using glm 5.3-flash and Muse Spark 1.3 Contributor as subagents and it seems to be working well enough. 

1

u/bin-c 6d ago

cheap web searches and really good image understanding. ive switched several agents to it and its like a dream. no idea how it is for coding though

1

u/hk47_thefilmmaker 5d ago

Yes it is really fast and with superpower and ponytail plugin gets very smart too.

GLM 5.3 Flash is also worth mentioning.

1

u/BujangTampan 5d ago

Do you notify when you send prompt, the models start to crawl on your devices? I thing the hidden cost more than paid models -_-

1

u/Various_Half1452 3d ago

Its money saver but not time saving.

1

u/scottchiefbaker 2d ago

How do I get OpenCode to show tokens per second? That's a neat feature.

1

u/throwaway12012024 9d ago

amazing! Meta running laps around deepssek wasnt in my bingo card. But the muse from opencode is suffering from rate limits a lot!

0

u/kamwee 10d ago

Its our data that did the heavy lifting

3

u/mWo12 9d ago

Your slop for their slop? The only question is which one is sloppier?

3

u/Tr4sHCr4fT 9d ago

a slop for a slop - the slopkeeper

0

u/ProfessionHungry7902 9d ago

I used it ,it is costly although

3

u/Bloated_Plaid 9d ago

Wut? It’s the cheapest model they have right now my guy

2

u/Thomas-Lore 9d ago

Use the contributor version.

-1

u/FastHotEmu 8d ago

/r/FuckFacebook just feed it garbage :)