Skip to main content

Pixtral

Only the mistral-community/pixtral-12b version is supported right now. The official mistralai/Pixtral-12B-2409 config is rather incomplete.

Convert the model

eole convert HF --model_dir mistral-community/pixtral-12b --output ./pixtral-12b --token $HF_TOKEN

Run the test script

python3 test_inference.py

There are several examples in the test script (taken from pixtral blog posts). A single one is activated by default, but you can uncomment the others to test the various cases.

Finetuning

Finetuning is untested for now. Feel free to try it out and fix any arising issues.