Skip to main content

Recipes

Choose a task below. Each recipe documents its working directory, model/data requirements, commands, and expected output. Model weights and datasets are separate downloads; check their licenses before use.

See the README recipe audit for what was checked, fixed, and actually executed on the current checkout.

Generation and serving​

WorkflowRecipe
Direct inference from a supported Hugging Face model IDHF inference
Cloud Qwen Chat with automatic preparation and authenticationRunPod deployment
FastAPI server, native inference, OpenAI-style chat, Anthropic-style MessagesServer
Qwen3.8-27B text inference, MTP verification, and baseline comparisonQwen3.8 / MTP
Claude Code CLI backed by local Qwen3.8Claude Code
Qwen3.5 text, vision, streaming, and servingQwen3.5
Llama inference and fine-tuningLlama2, Llama3
Mistral and Mixtral inferenceMistral, Mixtral

Translation and training​

WorkflowRecipe
Translation workspace: text, documents, subtitles and glossariesHy-MT2 workspace
EuroLLM model and legacy Gradio exampleEuroLLM
Train an encoder-decoder translation modelWMT17 English–German
NLLB conversion and translationNLLB
Translation with Tower and LlamaTower / Mistral, Tower / Llama2, Llama3.1
Language-model trainingGPT-2, WikiText-103, FineWeb
Synthetic dataNewsPalm
Scorer-reward fine-tuning (REINFORCE)RL

Multimodal models​

WorkflowRecipe
Image understandingPixtral, Qwen3.5
OCR and document extractionHunyuanOCR, DeepSeek-OCR
Speech recognition and timestampsWhisper

Evaluation and performance​

WorkflowRecipe
Native COMET, KIWI, XCOMET, MetricX; training validation and custom scorersScoring overview
Smoke-test conversion, generation, and MMLUModel validator
Python code generation graded by executable testsLiveCodeBench
Knowledge benchmarkMMLU
Reproduce inference measurementsGeneration benchmarks

Contributing a recipe​

Use a single README.md so the documentation build can include the recipe. Specify the working directory, exact checkpoint, dependencies, expected output, and limitations. Keep scripts configurable, avoid machine-specific paths, and state what was actually tested. Link the recipe here and from the main README when it is a useful starting point. Respect model and dataset licenses.