[ Converted with mlx-lm 0.30.0 {earlier versions encountered errors} ]

% mlx_lm.convert --hf-path tencent/HY-MT1.5-1.8B -q --quant-predicate mixed_4_6 --dtype float16 --mlx-path ~/HY-MT1.5-1.8B-mixed_4_6-mlx/

========================================

% mlx_lm.generate --model ~/HY-MT1.5-1.8B-mixed_4_6-mlx/ --prompt "How do I say 'once upon a time in a land far far away there were people who spoke a foreign language?', in chinese?"

用中文来说，就是“从前，在一个非常遥远的地方，有一些人说着一种外语。”

% mlx_lm.generate --model ~/HY-MT1.5-1.8B-mixed_4_6-mlx/ --prompt "'从前，在一个非常遥远的地方，有一些人说着一种外语', translated to English?"

"Once upon a time, in a very distant place, there were some people who spoke a foreign language."

Peak memory: 1.102 GB