Pixtral
Only the mistral-community/pixtral-12b version is supported right now. The official mistralai/Pixtral-12B-2409 config is rather incomplete.
Convert the model
eole convert HF --model_dir mistral-community/pixtral-12b --output ./pixtral-12b --token $HF_TOKEN
Run the test script
python3 test_inference.py
There are several examples in the test script (taken from pixtral blog posts). A single one is activated by default, but you can uncomment the others to test the various cases.
Finetuning
Finetuning is untested for now. Feel free to try it out and fix any arising issues.