Pretrain & SFT trainer#
Trainer class for fine-tuning transformer models with FSDP support. |
|
A simple byte-level tokenizer that encodes text as UTF-8 bytes with special token handling. |
Trainer class for fine-tuning transformer models with FSDP support. |
|
A simple byte-level tokenizer that encodes text as UTF-8 bytes with special token handling. |