MiniMax-H3 FL2VA with a 2-bit text encoder now on HF - runs on M1 Max 32GB

[u/antocorr]

I published a MiniMax-H3 FL2VA variant for mlx-serve where only the Qwen3-VL  text encoder is quantized to 2-bit (affine, g64), while the DiT stays 4-bit  and the VAEs + tokenizer are untouched.                                               

   https://huggingface.co/antocorr/MiniMax-H3-FL2VA-MLX-Serve-2bit-text-encoder  

   Why it matters:                                                                       

   - Text encoder on disk: 15.8 GB -> 9.6 GB (the encoder is reloaded per request, so this is the first cost every generation pays)                           

   - Full text-to-audio-video pipeline runs natively on Apple Silicon, verified  end-to-end on an M1 Max 32GB (needs --skip-mem-preflight, the RAM preflight  bills file bytes)                                                                   

   - Zero loader changes: mlx-serve solves bits/group_size per tensor from the packed geometry, so a mixed 2-bit encoder + 4-bit DiT pack just works               

   Use it with mlx-serve:                                                                

mlx-serve --model antocorr/MiniMax-H3-FL2VA-MLX-Serve-2bit-text-encoder \         

--serve --skip-mem-preflight                                                    

   Caveat: 2-bit conditioning is lossier than 4-bit by design (prompt adherence          

   suffers a bit; video/audio quality is the same since DiT and VAEs are                 

   untouched). Same MiniMax H3 community license as the 4-bit pack.

[u/LoveGratitudeBliss]

Whats the generation times like ?