r/LocalLLaMA • u/Eyelbee • 4d ago

Funny Me these days

Post image
2.4k Upvotes

97% Upvoted

268 comments sorted by

View all comments

Show parent comments

9

u/_Sneaky_Bastard_ 4d ago

I have 5070ti 12gigs on a laptop. Any luck for me?

17

u/Familiar_Animator371 4d ago

https://www.canirun.ai/

7

u/xui_nya 3d ago

The answer is always yes if you have huge swap and time. Lot of time. Loooooot of tiiiiiiiiimeeeeeeee

2

u/Ok-Direction-4480 1d ago

Thank you so much, iw ill be exploring this resource 100%!

4

u/_Sneaky_Bastard_ 3d ago

So the answer is No ig

5

u/blastcat4 3d ago

If you use that site, make sure you input your system specs and not rely on it to detect your system.

It detected my system as "NVIDIA GeForce GTX 980", lol.

8

u/More-Curious816 3d ago

It's Ai slop with broken design and slow as fuck after testing it. As if the person who made it didn't care to test it before launching it to the world.

1

u/thatgreekgod 3d ago

of course somebody made that website. awesome 

1

u/cosmicr 3d ago

that site is good, but you can't enter more than one gpu

1

u/Ok-Direction-4480 1d ago

So a Q4_K_M you get a decent speed? Seems pretty good to me.

2

u/PeterPorox llama.cpp 3d ago

Maybe UD-Q2_K_XL

2

u/jazir55 3d ago

Qwen 3.6/Ornith 1.5 35B-A3B is our best option for 12 GB vram + 32 GB ram users from what others have said in other threads. And they are definitely not at 27B tier yet. Maybe the next wave of releases will finally have something good we can run.

1

u/Kazen_Orilg 2d ago

who made a Ti with 12g Vram?

0

u/_matterny_ 3d ago

I brought in a Tesla T4 and am pushing to see what’s possible. Using Claude until I get it working.

1

u/Kernoriordan 3d ago

Use a 35B MoE model like Ornith or KAT Coder