Command Line
eole is the single command line utility used to run various tools. These tools are categorized into several groups:
Categories of Tools
Main Entrypoints
build_vocabtrainpredict
Model Conversion Tools
convert- Flavors:
HF(universal Hugging Face converter),T5,onmt_config(legacy OpenNMT-py config migration)
- Flavors:
Model Management Tools
model- Subcommands:
lora,release,extract_embeddings,average
- Subcommands:
Miscellaneous Tools (Mostly Legacy)
tools- Subcommands:
LM_scoring,oracle_comet,run_mmlu,spm_to_vocab,mbr_bleu,embeddings_to_torch,oracle_bleu,hellaswag
- Subcommands:
Usage
The main entrypoints are typically used with a yaml configuration file. Most parameters can also be overridden via corresponding command line flags if needed.
Examples
eole build_vocab -c your_config.yaml
eole train -c your_config.yaml
eole predict -c your_config.yaml
Additional Tools
All other tools have specific arguments that can be inspected via the command helpstring -h.