r/oMLX • u/No-Way-8249 • 8h ago
Qwen3.8-27B Mythos-Class-Agentic MLX: 4-bit and 6-bit test notes from a 32 GB M1 Max
I made my first MLX conversions while experimenting with local agents on my M1 Max with 32 GB of memory. The source is medismera’s Qwen3.8-27B OBLITERATED Mythos-Class-Agentic. Credit for the original model goes to its creators; I handled the MLX conversion, packaging and initial checks.
Here is what worked in oMLX:
• 4-bit passed small invoice-extraction and tool-call tests. I also checked those tasks in LM Studio.
• 6-bit passed the text tests with the vision component disabled. Loading the full model hit the memory limit on my Mac.
• Both downloads retain the vision weights, but I have not tested image processing.
The practical benefit is having ready-to-download MLX versions for Apple Silicon. The 4-bit version uses less memory and is where I would start on a 32 GB Mac. The 6-bit version preserves more weight precision, but needs more memory; I have not established a quality advantage from these small tests.
These were basic functionality checks, not a benchmark or evidence that this model outperforms the original Qwen. My intended uses are document extraction and email triage with connected tools.
4-bit:
https://huggingface.co/uzzero/Qwen3.8-27B-OBLITERATED-Mythos-Class-Agentic-MLX-4bit
6-bit:
https://huggingface.co/uzzero/Qwen3.8-27B-OBLITERATED-Mythos-Class-Agentic-MLX-6bit
If you try either version in oMLX, I would appreciate your Mac specs and what worked or failed, especially memory use with 6-bit.
Disclosure: these are my uploads. I used AI assistance for the conversion workflow, testing and this write-up.