Skip to main content

Ctrl+K

XTuner 0.2.0 documentation

Getting Started

Installation
Language Model Fine-tuning
Multimodal Large Model Fine-tuning
[Beta] RL: GRPO Training GSM8K

Pretraining & Fine-tuning

Fine-tuning Large Models with Trainer
Fine-tuning Multimodal Large Models with Trainer
Training Configuration
Dataset
Chat Template Description

Reinforcement Learning

[Beta] Customizing GRPO Training with Python Code

Advanced Tutorial

Fine-tuning & Pretraining
Reinforcement Learning

Benchmark

Megatron MoE Training Benchmark and Tuning Guide

Legacy Documentation

Welcome to XTuner Chinese Documentation

API

Pretrain & SFT Trainer
- xtuner.v1.train.trainer.Trainer
- xtuner.v1.train.toy_tokenizer.UTF8ByteTokenizer
Config
RL Trainer
- xtuner.v1.train.rl_trainer.RLTrainer
RL Config
Loss Context

.rst

xtuner.v1.loss.ce_loss.CELossContext

Contents

CELossContext

xtuner.v1.loss.ce_loss.CELossContext#

xtuner.v1.loss.ce_loss.CELossContext#: alias of LMHeadLossContext

previous

xtuner.v1.loss.ce_loss.CELossKwargs

next

xtuner.v1.rl.grpo.loss.GRPOLossConfig

Contents

CELossContext

By XTuner Contributors

© Copyright 2024, XTuner Contributors.