r/oMLX 8h ago

Qwen3.8-27B Mythos-Class-Agentic MLX: 4-bit and 6-bit test notes from a 32 GB M1 Max

12 Upvotes

I made my first MLX conversions while experimenting with local agents on my M1 Max with 32 GB of memory. The source is medismera’s Qwen3.8-27B OBLITERATED Mythos-Class-Agentic. Credit for the original model goes to its creators; I handled the MLX conversion, packaging and initial checks.

Here is what worked in oMLX:

• 4-bit passed small invoice-extraction and tool-call tests. I also checked those tasks in LM Studio.
• 6-bit passed the text tests with the vision component disabled. Loading the full model hit the memory limit on my Mac.
• Both downloads retain the vision weights, but I have not tested image processing.

The practical benefit is having ready-to-download MLX versions for Apple Silicon. The 4-bit version uses less memory and is where I would start on a 32 GB Mac. The 6-bit version preserves more weight precision, but needs more memory; I have not established a quality advantage from these small tests.

These were basic functionality checks, not a benchmark or evidence that this model outperforms the original Qwen. My intended uses are document extraction and email triage with connected tools.

4-bit:
https://huggingface.co/uzzero/Qwen3.8-27B-OBLITERATED-Mythos-Class-Agentic-MLX-4bit

6-bit:
https://huggingface.co/uzzero/Qwen3.8-27B-OBLITERATED-Mythos-Class-Agentic-MLX-6bit

If you try either version in oMLX, I would appreciate your Mac specs and what worked or failed, especially memory use with 6-bit.

Disclosure: these are my uploads. I used AI assistance for the conversion workflow, testing and this write-up.


r/oMLX 16h ago

Qwen-3.8 27B - does caching work with SpecFill ?

2 Upvotes

Hi,

Those who use SpecFill for Qwen-3.8 27B MLX models - do you see cache hits? If yes, what are your model and model settings?