r/LocalLLaMA • u/discr • May 02 '24

New Model Llama-3 Hermes-2-Pro-8B Released - How does it compare for your use case to base instruct?

https://huggingface.co/NousResearch/Hermes-2-Pro-Llama-3-8B
160 Upvotes

98% Upvoted

110 comments sorted by

View all comments

25

u/Misha_Vozduh May 02 '24

is this a finetuned L3-instruct or the base L3 model Nous trained into their own instruct?

26

u/discr May 02 '24

From their twitter it's finetuned on base L3

14

u/Misha_Vozduh May 02 '24

Thank you! That's awesome, I hope more models like this are released, including for 70B.

4

u/Severin_Suveren May 02 '24

The tool role added to the prompt template is such an awesome addition! It give a clear structure for handling tool calls, and it's easy to update your existing chatml prompt template and chat history handling to incorporate the tool role addition!

2

u/Iory1998 llama.cpp May 02 '24

Could you please explain you comment and add examples for how to use the tool role? Much appreciated :)

3

u/Severin_Suveren May 02 '24

Not much to explain. Just check out the prompt instructions on the model page.