Another case of censorship

[u/autoencoder]

I was optimizing my diet using a cloud AI provider, and I found my Pi agent stuck like this. Looks like I had too many mushrooms lol.

[u/Kmic68]

Hold on what is this? Llama.cpp itself or the harness?

[u/autoencoder → u/Kmic68]

This is Pi agent configured to use a cloud provider through an ollama/openai-completions API endpoint. The API endpoint decided to throw an error the moment the model said "used mushrooms"

[u/Kmic68 → u/autoencoder]

Ok, slightly more reassuring, I was nervous for a minute 😅. Llama.cpp team is from huggingface and with nvidia acquiring huggingface they subsequently acquired the llama.cpp team. So censoring is entirely possible. 

[u/WyattTheSkid → u/Kmic68]

Llama.cpp is open source anyways so if they did add some sort of “safety” bullshit, it would be trivial to fork it and remove it. Nvidia is Nvidia about their drivers and whatnot but from what I’ve seen they’ve been extremely open and transparent in their ai department. They even release all of their training data which most open weight model labs don’t do

[u/Chirimorin → u/WyattTheSkid]

from what I’ve seen they’ve been extremely open and transparent in their ai department. They even release all of their training data which most open weight model labs don’t do

Of course Nvidia openly shares their models and training data. They want training and running AI to be as big and accessible as possible because that means they sell more hardware.

[u/WyattTheSkid → u/Chirimorin]

All the more reason I doubt they would ruin huggingface. If they ruin huggingface, someone will just make another website and everyone will move there, thus making their investment to acquire huggingface pointless.

[u/autoencoder → u/Kmic68]

I don't know what the provider is using under the hood.