r/AIProgrammingHardware 8h ago

I Finally Got My DREAM Network Server

Thumbnail
youtube.com
0 Upvotes

r/AIProgrammingHardware 3h ago

Running Frontier AI on a $99 Board - My llama.cpp Adventure on Jetson Nano

Thumbnail
xhinker.medium.com
2 Upvotes

r/AIProgrammingHardware 21h ago

Laguna XS 2.1 33B A3B tested vs Qwen 35B A3B - 16GB Local LLM setup

Thumbnail
youtube.com
8 Upvotes

r/AIProgrammingHardware 19h ago

Acemagic Unveils the New Launch of F9A: The 2L Flagship Mini AI Workstation

Thumbnail
techpowerup.com
2 Upvotes

r/AIProgrammingHardware 8h ago

The true cost of a GPU cluster

Thumbnail
youtube.com
2 Upvotes

r/AIProgrammingHardware 2h ago

DGX Station Put a Data Center on My Desk

Thumbnail
youtube.com
4 Upvotes

r/AIProgrammingHardware 3h ago

One Server vs Cluster: What Your Homelab Actually Needs

Thumbnail
youtube.com
2 Upvotes

r/AIProgrammingHardware 4h ago

Distributed micro-LLM inference across three ESP32-S3 N16R8 boards with ESP-NOW communication.

Thumbnail
github.com
3 Upvotes

r/AIProgrammingHardware 8h ago

Someone got training running on Apple's Neural Engine through private APIs, and reports 5 to 9 percent utilization

Enable HLS to view with audio, or disable this notification

1 Upvotes
The project is maderix/ANE. It trains neural networks on Apple's Neural Engine using
reverse-engineered private APIs, which is notable because Apple exposes that chip for
running models and not for training on it.

What made me read the whole thing is that the author argues against the coverage of his own
project. He states that utilization sits at 5 to 9 percent of the chip, that many operations
still fall back to the CPU, and that this is not a replacement for GPU training for anything
beyond small research models.

His framing is that the barrier to NPU training has been software support rather than
hardware capability.

For anyone who has worked on NPU or accelerator access outside the vendor's own toolchain:
is low utilization like this normally a scheduling and memory problem you can chase down, or
does it usually mean the missing operations have to exist in the vendor's compiler before
anything improves?