Skip to main content

Initialize pretrained word embeddings

Eole prepares pretrained embeddings during eole train initialization. Supply the embedding text file and type in a complete training YAML:

save_data: run/embeddings
both_embeddings: glove_dir/glove.6B.100d.txt
embeddings_type: GloVe
model:
architecture: transformer
embeddings:
word_vec_size: 100
freeze_word_vecs_enc: false
freeze_word_vecs_dec: false

Use src_embeddings and tgt_embeddings for separate files. GloVe and word2vec text formats are supported. Embedding dimensions must match the model; set the freeze fields under model.embeddings to keep those weights fixed. Matched tensors are saved as <save_data>.enc_embeddings.pt and <save_data>.dec_embeddings.pt. Download and extract the selected vectors before training; the placeholder path above is not a bundled asset.