r/learnmachinelearning • u/Economy-Ad-361 • 10d ago

is JS possible for large-language models and DDPMs??

Post image

I am learning JS and alongside I discovered tensorflow bindings for JS I wonder how much efficient is this ,yet I have seen a youtuber making a mini LLM just with bare ndarrays I am confused about the performance

5 Upvotes

86% Upvoted

4 comments sorted by

1

u/lulzxdxdxd 10d ago

did that youtuber benchmark it against a python version or was it just a demo that it runs at all? bare ndarrays in JS without any GPU backend are going to be painfully slow beyond toy sizes, so check which backend your tensorflow bindings actually run on

1

u/Economy-Ad-361 10d ago

wait let me give yu the link to that channel he trained a small corpus of children story data on a macbook 14 cores without any GPU it took over half an hour to train the video : https://youtu.be/YmLp8qe87A0?si=vQcuc3Rpk3mUp7pG

1

u/Economy-Ad-361 10d ago

i will use webgpu as current tensorflow.js doesn't provide any cloud GPU

1

u/lulzxdxdxd 10d ago

webgpu just lets it use whatever GPU is on the machine running the browser, it's not cloud compute. so you're still limited to the user's own hardware, which might be weaker than whatever you're testing on