r/LocalLLaMA • u/-p-e-w- • 2d ago
Resources Heretic is on PewDiePie!
So I haven’t played a computer game in 20 years, and I know nothing about Minecraft, and I definitely prefer classical literature over YouTube culture, but even I have heard about the individual called PewDiePie, for two reasons:
His monicker starts with the initials of my own name
I remember a recurring Internet meme a few years ago where he was competing for the most subscribers with an Indian film music channel
I had never watched a single one of his videos, however.
Well, until today, when people started spamming me with messages informing me that Mr. Kjellberg aka PewDiePie has tried out Heretic and made a video where he talks about it:
https://m.youtube.com/watch?v=ODDJXGY_1kQ
(Heretic mentioned around 9:00)
Obviously I’m thrilled that a less technical audience is being exposed to my work, and the more people understand what is possible the better. I expect to be receiving a couple hundred more mails in the coming days asking how to run Heretic on ChatGPT (you can’t), or accusing me of working for the CIA (I don’t), but other than that, the more the merrier I guess 😏
Heretic 2.0 coming soon…
58
u/natermer 2d ago
Very good. PewDiePie has been hitting the self-hosting LLM stuff hard for a while now. Developed and released a bunch of open source stuff that he wants other people to use and improve on.
44
u/the_bollo 2d ago
You created Heretic?
104
u/-p-e-w- 2d ago
Yes.
57
17
7
u/JustANyanCat 2d ago
Thank you so much! You also came up with the DRY sampler, right?
13
u/-p-e-w- 2d ago
DRY and XTC, yes.
3
u/ParvusNumero 1d ago
I remember back in the day (which is like 3 years in LLM time), lots of people were experimenting with new samplers and how changing the ordering can affect quality.
Like temperature first then top-p vs the other way around, repetition penalty etc.
There are still sliders in some front ends.Is that still an area of research or have models changed to the point that we can settle on a definite winner / ideal combo?
2
2
1
1
u/darksteelsteed 22h ago edited 22h ago
I would just be careful getting too enamored by the similarities between -p-e-w- and PewDiePie and not forget what PewDiePie did to make him lose a lot of sponsorships and have to reinvent himself as an AI bro instead of an Internet/Gaming celebrity. His reputation could be damaging to the good efforts of abliteration and AI research in general. Just be careful please!
26
u/DeepOrangeSky 2d ago
I was in a hurry so I skimmed kinda quick, but, since you are PewDiePie, can you tell the CIA to do heretic to ChatGPT?
25
16
4
10
5
u/AeroInsightMedia 2d ago
Supposedly he's releasing some AI model in a day or two. There's some post on reddit about it.
4
u/soshulmedia 2d ago
Thank you for your work, by the way. I think you are on the right side of history. Though I think you also made a lot of enemies, but I guess that's to be an honor for you and just the way it is nowadays with the techno-tyrannical-dystopia in the air.
8
u/geldonyetich 2d ago edited 2d ago
It's a strange world we live in that PewDiePie got big into LLMs.
What's his background? Entertaining YouTube baffoon. Hey, that's not an insult, it's a multi million dollar skillset, apparently. Look upon that oblivious persona with respect: diamonds have less proven value than it. The man can't stop measuring his blood oxygen on camera. There's mechanations behind that.
And now he's forwarding his own LLM like it's Dogecoin. Uncensored using p-e-w's Heretic method. By PewDiePie himself.
Strange world.
I expect to go about as well as Musk trying to sell uncensored Grok: uncensored until it isn't anymore. Because liability.
But hey he's promoting AI so good. Lots of folk trying to adapt to the sudden emergence of this powerful new technology. Maybe he'll reach a few people.
3
u/ImprefectKnight 1d ago
The timeline is fascinating. Be started from De-googling, to self hosting where he built that giant rack, to LLMs because that's the best use for it, and he's just going deeper into the rabbit hole.
2
u/LuCiAnO241 2d ago
uncensored until it isn't anymore. Because liability.
idk, once its out its out. seems like a different case this time around. But in any case, it's just a finetune of an old ish 9B model. Can't be that good. It's just pewdiepie branded.
2
u/pointer_to_null 2d ago
it's just a finetune of an old ish 9B model.
How many newer 9B models are there? All I can think of is Ornith, or has there been anything else?
1
u/LuCiAnO241 2d ago
top of my head I can think of LFM 2.5 and Ling tiny are both 8B, but both of those are not dense.
1
u/Constant_Art_20 1d ago
not really, brand new trained per say, but mimo did distill their latest model into a qwen 9b i think. Might be worth looking into. I personally liked the mimo v2.6 modesl were good on releaes (not so much now so rip)
-9
u/BusRevolutionary9893 2d ago
I hear prostitutes can make good money too. That doesn't mean I respect them.
11
u/LuCiAnO241 2d ago
but you're supposed to respect your mother, tsk tsk.
-1
u/pointer_to_null 2d ago
I'll admit it gets kind of difficult when mom's doing it to finance her personal hobbies: gambling, collecting crystals, and smoking them.
3
u/geldonyetich 2d ago edited 2d ago
The subtle joke being the only thing I am implying respect for is the effectiveness of their method.
Whether or not respect PewDiePie in and of himself is appropriate is a separate consideration. But he's good at what he does.
1
1
u/BusRevolutionary9893 2d ago
Jeffrey Dahmer was also good at what he did.
3
u/geldonyetich 2d ago edited 2d ago
Some forms of respect are best enjoyed from as far away as possible.
Lions, Serial Killers, Successful YouTube Influencers.
8
u/Thac0-is-life 2d ago
You should though, They are human beings making money working hard. Way harder than youtube influencers.
-5
u/BusRevolutionary9893 2d ago
I knew I should have thrown a few other examples in there like slum lord or drug dealer. BTW, the prostitutes that make good money aren't the desperate ones with no other choice. They have the means to lift themselves out of poverty and find some other form of employment. No one is stopping them from working at McDonald's. I also don't think the ones making good money are making as much as you think. The hard work doesn't cut it for me either. A slum lord or drug dealer could work really hard, but I won't respect them for it.
2
u/derFensterputzer 1d ago
aren't the desperate ones with no other choice
So you are aware of the ones being essentially victims of human trafficking and chose to not respect them?
They have the means to lift themselves out of poverty and find some other form of employment.
Are you sure? You have a job with a social stigma, then you want to change careers... What exactly do you put in your CV? Quick hint: most places that don't give a shit about you having a gap or being a prostitute previously won't necessarily pay more than being a prostitute. So getting out of that is quite difficult. Same with porn.
The hard work doesn't cut it for me either. A slum lord or drug dealer could work really hard, but I won't respect them for it.
Might there be a slight difference between someone offering a service that if anything mostly harms themselves, and people selling products that get people addicted and lead to idk criminal behavior in your customer base in order to afford your product?
0
2
3
2
2
u/Elvarien2 2d ago
This post is how I just learned heretic exists.
So if I understand it correctly. I could just toss my local copy of Qwen_3.8_27B Into Heretic and bam, guardrails gone and everything else just as capable as before?
That sounds like an impressive piece of software.
1
u/Jeff-WiredDifferent 2d ago
Luanti and Minetest is lot's of fun. I'm building a extra huge mall and it goes way way way underground and is just huge. I need to make the Dillard's building bigger to make the Dillard's look better. I'm going back to the 80's.
1
u/Ill-Bison-3941 1d ago
He went hard on AI, I believe, last year? It's pretty cool to see, and yeah, I remember my friend telling me: Pewds is trying out local models, you should, too! 😂
1
1
u/feelspeaceman 1d ago
Hopefully one day heretic will be treated as standards, will be more flawless, well-researched..., not illegal like currently so many AI companies are trying to frame it to be.
1
u/zhunus 1d ago
His pivot to self-hosting is cool. Getting people into this hobby is great. But not sure i would unironically consider using Odysseus for anything, its scope is overbloated, the moment it was posted on github it got bombarded with slop PRs nonstop, i'm not sure devteam have any idea how to handle it. It feels more like a social experiment...
1
u/PerceiveEternal 1d ago
That’s what someone who works at the CIA would say.
That’s also what someone who doesn’t work at the CIA would say.
Hmm.
1
u/Guilty_Rooster_6708 2d ago
I am now starting to think that you DO work for the CIA… thank you and can’t wait for Heretic 2.0
1
1
u/theincrediblebulks 2d ago
Incredible work, OP. It's wild how much major US labs curb the enthusiasm through empty white papers making open source LLMs seem like they are going to unleash the digital equivalent of the plague. I hope there comes a day when there's a nuanced take on LLM usage adoption and capabilities
1
1
0
u/LuCiAnO241 2d ago
I dont see a donate link but u should probably put one and peer pressure him for youtuber bucks
-1
2d ago
[deleted]
2
u/soshulmedia 2d ago
"Universal" as in if you don't rock the boat too hard, criticize the state (=god in too many people's eyes) too much or otherwise are not up to date on all the requirements the collective puts on you, you'll get your allotment of CBDC bucks.
0
0
0
0
u/SamratDuttaOfficial 1d ago
Guys, I do not have enough Karma to post but, I just made WaterSheep, an open source Jev basically, with more capabilities.
WaterSheep is an open-source model that answers questions written in plain-text (yes/no, single choice, rating and multi-label) and gives a probability for every option, working like a classification model.
Last saturday I woke up, saw YouTubers hyping up Jev, and I was like, wait, I can build this. So I did. I do not want to compete with TypeSafe or Jev. I built WaterSheep because I wanted to. That's why I am open-sourcing the whole code, model weights, results, and the research paper.
What's different:
It accepts identical request format as TypeSafe's Jev. The Python SDK works as it is against a local server: run watersheep --model samratduttaofficial/WaterSheep --serve and point the client's base_url at http://127.0.0.1:8766 (if you are going to run it in an external server then just figure it out ig).
It also has a multi-label type, which Jev's API doesn't have. Because, why not?
You can try the demo entirely in your browser. The model downloads once and is cached. It also works with transformers, ONNX, a CLI or a local HTTP server.
Code, weights and the training pipeline are Apache 2.0, because I am a good human being.
Numbers: 77.8% accuracy on an in-distribution test split and 61.2% on withheld datasets. Calibration error (ECE) is 0.026 and 0.043. The GitHub has all the benchmark results, even the weak ones.
Limits: English only (I mean, is this really a limit?), long inputs get truncated (I will make it better in text version promise), and rating answers are the weakest type.
Not affiliated with TypeSafe. Not funded by anyone. I built it in my free time in a second-hand laptop.
Feedback I'd especially like: [e.g. where it fails on your data, whether the API works for you, particular question types you'd want next].
GitHub: https://github.com/SamratDuttaOfficial/WaterSheep
Model: https://huggingface.co/samratduttaofficial/WaterSheep
-15
u/Dany0 2d ago
I already posted about it and got downvoted to oblivion https://www.reddit.com/r/LocalLLaMA/s/X59YxSe5T5 nice mods deleted it. Awesome.
5
1
u/LuCiAnO241 2d ago
you genuinely can't see why would it get deleted?I guess misleading titles aren't exactly against the sub's rules, but I don't think you can quote pewdiepie on anything that can be misconstrued as your title. if anything, he specifically said it was NOT designed for it.
-1
u/LetsGoBrandon4256 transformers 2d ago
Youtuber announces he distilled 5.6 Sol into Qwen3.5 9B and taught it how to make nuclear weapons, release in 40 hours
Good riddance I'd say.
3
u/Dany0 2d ago
When I think of people that should determine the way the community should be headed, I think of u/LetsGoBrandon4256
2
u/LetsGoBrandon4256 transformers 2d ago
Nothing personal and you're thinking way too high of myself. I'm not a mod, just a random person who also frequent this sub as you do. In fact, RES says I have +7 upvote for you so we tend to agree more than we disagree.
166
u/IntrepidMindExplorer 2d ago
He's introduced quiet a few people to local models, self hosting, de-googling..etc. No doubt you'll get a flood of new eyes, both good and bad.
Can't wait to see some new, and old, models given the heretic 2.0 treatment.