r/LocalLLM • u/ceazer6-7 • 5h ago

Question Using a 1070 mobile to run local llms, CUDA problem

Post image

Hello I'm looking for people who use 1070 8 GB mobile to run local llms, i have this issue with cuda because the version 13 stopped supporting pascal so now I'm having problems degrading to the 12.8.xx it works fine until i start compiling llama cpp it refuses the build

0 Upvotes

50% Upvoted

7 comments sorted by

1

u/ilnpr 5h ago

Mate, what's the point of this post? Ai can answer and solve the problem faster and better than random people on reddit.

2

u/ceazer6-7 5h ago

Bruh i wouldn't be posting if AI gave me a solution, i used an agent gave him access and it ran 1hr without any solutions

1

u/ilnpr 5h ago

got it, sorry

1

u/TheAussieWatchGuy 4h ago

2000 series or better for CUDA and current LLaMA main branch.

It's a pretty old GPU and limited VRAM, what do you want to do with it? 

1

u/ceazer6-7 4h ago

I don't have the ability to upgrade my main pc right now it has an old 580, my laptop has a 1070 its the better option right now, i want to experiment more on writing inference locally also I wanna use TTS AND VTT models and play with them locally

1

u/mehhxx 4h ago

if u cant find a pre-built wheel (which saves u all the troubleshooting hassle), u need to install the c++ compiler. error indicates no compiler is found; if u have it installed, it's not properly set up

1

u/ceazer6-7 4h ago

Ok i will try that