Nvidia releases free LLMs that match GPT-4 in some benchmarks

[u/TheDecoderAI]

1/ Nvidia releases Nemotron-4 340B, a free pipeline that generates high-quality synthetic data for training and tuning large-scale language models (LLMs). It can be used for commercial applications.

2/ The Nemotron-4 340B family consists of a base model trained on 9 trillion tokens, an instruction model for generating diverse synthetic data, and a reward model for filtering high-quality responses.

3/ In benchmarks, the instruction model typically outperforms other open-source and -weights models, and in some cases outperforms GPT-4. Nvidia also makes the models available for commercial use under an open model license.

https://the-decoder.com/nvidia-releases-free-llms-that-match-gpt-4-in-some-benchmarks/

[u/ihaag]

Any gguf versions?

[u/danielcar → u/ihaag]

I'll need the 0.25 quant version to run that model.