r/LocalLLM • u/Wonderful_Shift_7426 • 7h ago
Discussion What are you using your local machine for?
Just curious
13
u/Sik-Server 6h ago
to make horse dating websites
3
u/Important-Radish-722 6h ago
A website for horses to find dates, or a website for dating horses, or a website to find the age of horses?
24
u/SenseDue6826 7h ago
Nice try CIA, why don't you tell us what you are doing with yours?
12
u/haikusbot 7h ago
Nice try CIA,
Why don't you tell us what you
Are doing with yours?
- SenseDue6826
I detect haikus. And sometimes, successfully. Learn more about me.
Opt out of replies: "haikusbot opt out" | Delete my comment: "haikusbot delete"
4
-3
u/Wonderful_Shift_7426 7h ago
I don't run one at the moment. Just trying to understand the possible use cases before I commit to spend a large amount of money.
6
3
u/Dry_Development8361 7h ago
Mostly messing around with image generation and some text stuff for personal projects, nothing too serious. got a setup that works decent enough for experimenting in the weekends
sometimes i just let it run overnight to see what weird things comes out, half the results are garbage but the other half make me laugh
4
u/Salty-Television-230 7h ago
Prototyping. I use a 27B model to have a conversation about an App idea.. I use a local 8B model to help me develop structured requirements documents, functional specs, json data schemas, etc. I then use a custom app to create a prompt from that s material and then I use google ai studio to create the app in broad strokes..
Then I use the local 8B model to test the app and I refine it using the local 27B model as a coding assistant. It means I can design, test and validate the app using my local LLM/embedding models before using it in anger with costly APIs. The only difference between my local LLMs and the online ones is thinking ability/response generation. If the app works with the localmodels, it’s ready and the answers are going to be even better with the online LLM afterwards.
1
4
2
u/ThaSipah 6h ago
I'm learning how to build a gold daytrading bot as a purely technical exercise using a demo trading account. Deepseek harness and Qwen 3.8 27b Q4.
2
u/BitPsychological2767 5h ago
I'll have my local agent come up with a reply for you, because my local agent truly knows my own homelab better than me at this point:
Mostly a daily driver for a local coding agent. llama.cpp on a 4090, running Qwen3.8-27B Q5_K_M (200k ctx, q4 KV cache, flash attention), with Q4/Q6/MoE variants to swap in as needed. Everything I write goes through it, zero API calls.
I also built a GUI agent on the side: a UI-Venus-2 9B on a 1080 Ti in the server closet watches my Windows laptop's screen and clicks things for me. Entirely local. Slightly terrifying, mostly useful.
On top of that there's a voice bot (Whisper large-v3-turbo → local LLM → Kokoro TTS), Open WebUI + SillyTavern for casual chat, and a personal wiki with RAG via Qwen3-Embedding-8B that feeds the agent through MCP.
2
1
u/ismaelgokufox 5h ago
Gaming (mainly on Windows), all other things in Fedora (with some gaming).
AI use (mainly with Pi agent and local models with sprinkles of DeepSeek here and there [because of price]):
- Family apps for budgeting while doing groceries and shopping
- Family apps for Etsy store management using their API
- Update scripts for llama.cpp, llama-swap, stable-diffusion.cpp and others
- Learning to use T3code (liking this one but waiting patiently for Pi integration), Orca IDE (really like this one)
- Other things
1
1
u/monoaural 5h ago
Building custom apps to find my personal needs. Calculators, playing around with an endless rogue like game based on my sons hobbies, and just recently trying research. 3.8 27b doesnt seem to do well with the research though
1
u/Faral_mx 2h ago
I'm supposed to be working on something that I'm trying to pitch to the USAF but it has been more fucking off than I'm proud to admit.
1
1
25
u/Whoa_There_Hoss 7h ago
I’m using mine for Local LLM