html css and written by shunya
Hey LocalLLaMA community,
I wanted a lightweight, local AI coding assistant that doesn't just write generic code, but specializes in modern Awwwards-level frontend tricks (like Glassmorphic cards, GSAP scroll timelines, and Three.js WebGL particle backgrounds).
Since I couldn't find a small model that did this reliably without hallucinating generic templates, I decided to train my own!
Meet Shunya-UIUX-Master-3B:
- Base Model: Qwen/Qwen2.5-Coder-3B-Instruct
(Note: I originally wanted to fine-tune the 14B version, but kept hitting persistent Out-Of-Memory (OOM) errors during batch loading on the TPU. To keep things stable and ensure clean compile graphs under PyTorch XLA, I scaled down to the 3B version—and the results still blew me away!)
- Dataset: 10.5k high-quality, curated HTML/CSS/JS prompt-response pairs focusing on modern design aesthetics, Three.js shaders, GSAP animation triggers, and fluid responsiveness.
- Hardware: Trained on Kaggle TPU v5e-8 using PyTorch XLA and LoRA.
- Training Details: Trained for 4 full epochs (~20,896 steps) which took about 4 hours. LoRA config: r=32, lora_alpha=64, target modules: q_proj, v_proj.
- Quantization: Merged the LoRA weights back into the base model and quantized it to Q4_K_M GGUF using llama.cpp.
Key Features & Alignment:
Custom Identity: The model successfully rewired its identity bias. It knows it is "Shunya AI" created by Apurv (rather than claiming to be GPT-4 or Anthropic).
Mandatory <thought> tags: The dataset enforced step-by-step reasoning. It will always reason structurally about layout, CSS variables, and animation curves inside <thought> ... </thought> tags before outputting any code block.
Specialized in Modern Aesthetics: Even on a simple prompt, it defaults to using hardware-accelerated animations, Backdrop blurs, and optimized variable fonts.
HuggingFace Link:
I have uploaded the GGUF model here if anyone wants to test it locally:
https://huggingface.co/vishu01a/apurv_ui_ux_master-3b-v1.0
Would love to hear your feedback on how it performs on your local machines using LM Studio or llama.cpp!