Skip to main content
Ctrl+K

XTuner 0.2.0 documentation

Getting Started

  • Installation
  • Language Model Fine-tuning
  • Multimodal Large Model Fine-tuning
  • [Beta] RL: GRPO Training GSM8K

Pretraining & Fine-tuning

  • Fine-tuning Large Models with Trainer
  • Fine-tuning Multimodal Large Models with Trainer
  • Training Configuration
  • Dataset
  • Chat Template Description

Reinforcement Learning

  • [Beta] Customizing GRPO Training with Python Code

Advanced Tutorial

  • Fine-tuning & Pretraining
    • Model
    • Custom Dataset
    • Loss Function
    • FP8 Training
    • Performance Analysis
  • Reinforcement Learning
    • Model
    • Custom Dataset
    • Loss Function

Benchmark

  • Megatron MoE Training Benchmark and Tuning Guide

Legacy Documentation

  • Welcome to XTuner Chinese Documentation

API

  • Pretrain & SFT Trainer
    • xtuner.v1.train.trainer.Trainer
    • xtuner.v1.train.toy_tokenizer.UTF8ByteTokenizer
  • Config
    • xtuner.v1.config.FSDPConfig
    • xtuner.v1.config.OptimConfig
    • xtuner.v1.config.AdamWConfig
    • xtuner.v1.config.LRConfig
    • xtuner.v1.config.GenerateConfig
  • RL Trainer
    • xtuner.v1.train.rl_trainer.RLTrainer
  • RL Config
    • xtuner.v1.ray.base.accelerator.AcceleratorResourcesConfig
    • xtuner.v1.ray.base.cpu.CPUResourcesConfig
    • xtuner.v1.ray.config.worker.RolloutConfig
    • xtuner.v1.ray.judger.JudgerConfig
    • xtuner.v1.ray.dataflow.ReplayBufferConfig
    • xtuner.v1.ray.dataflow.DataFlowConfig
    • xtuner.v1.ray.evaluator.EvaluatorConfig
    • xtuner.v1.rl.base.worker.WorkerConfig
    • xtuner.v1.rl.base.loss.BaseRLLossConfig
  • Loss Context
    • xtuner.v1.loss.ce_loss.CELossConfig
    • xtuner.v1.loss.ce_loss.CELossKwargs
    • xtuner.v1.loss.ce_loss.CELossContext
    • xtuner.v1.rl.grpo.loss.GRPOLossConfig
    • xtuner.v1.rl.grpo.loss.GRPOLossKwargs
    • xtuner.v1.rl.grpo.loss.GRPOLossContext
  • .rst

Getting Started

  • Installation
  • Language Model Fine-tuning
  • Multimodal Large Model Fine-tuning
  • [Beta] RL: GRPO Training GSM8K

previous

Welcome to XTuner V1 English Documentation

next

Installation

By XTuner Contributors

© Copyright 2024, XTuner Contributors.