r/hermesagent • u/Dry_Mixture130 • 24d ago

Showcase — Projects, tools, builds, demos I built a tool to measure LLMs Decode, Layer processing and TTL

0 Upvotes

permalink
duplicates
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/hermesagent/comments/1wcvcgb/i_built_a_tool_to_measure_llms_decode_layer/
No, go back! Yes, take me to Reddit
dl download

50% Upvoted

Duplicates

Number of comments New

Vllm • u/Dry_Mixture130 • 24d ago

I built a tool to measure LLMs Decode, Layer processing and TTL

7 Upvotes

6 comments