mlx-commuity/Qwe2-7B-Istruct-8bit

The Model mlx-commuity/Qwe2-7B-Istruct-8bit was coverted to MLX format from Qwe/Qwe2-7B-Istruct usig mlx-lm versio 0.14.0.

Use with mlx

pip istall mlx-lm

from mlx_lm import load, geerate

model, tokeizer = load("mlx-commuity/Qwe2-7B-Istruct-8bit")
respose = geerate(model, tokeizer, prompt="hello", verbose=True)

mlx-community/Qwen2-7B-Instruct-8bit The Model mlx-community/Qwen2-7B-Instruct-8bit was converted to