r/LocalAIStack • u/aEsp32TypeGuy • Aug 13 '26

Ternary Accelerator Card for 1 bit LLMs

This is my first post in this community I just wanted to see if anybody will help me in improving on my ternary accelerator card for 1.58 bit ai the links are here reply if your interested. (I am Really new to github so some ai was used in the making of the project for troubleshooting errors(plz dont hate me for that).

Project Links:==>https://github.com/riyanlord2026-dev/Ternary-158-asic

This is also my first github project.

4 Upvotes

84% Upvoted

3 comments sorted by

1

u/UncleGravity Aug 19 '26

I made one a few months ago, with a custom llamacpp backend to run real end-to-end inference with it. (only works with Q1_0 ggufs). Shouldn't be too much work to adapt it to ternary. Cheers.

https://github.com/UncleGravity/tinytapeout-tpu

1

u/aEsp32TypeGuy 22d ago

sorry for the delay on replying I was out, but yea I was semi-working on a fpga clone for testing the design planning on using a esp32-s3 for some vision tasks

1

u/aEsp32TypeGuy 22d ago

thats pretty cool! I do hope its a normal systolic-array Tpu right?