Skip to main content

Ctrl+K

XTuner 0.2.0 documentation

Getting Started

Installation
Language Model Fine-tuning
Multimodal Large Model Fine-tuning
[Beta] RL: GRPO Training GSM8K

Pretraining & Fine-tuning

Fine-tuning Large Models with Trainer
Fine-tuning Multimodal Large Models with Trainer
Training Configuration
Dataset
Chat Template Description

Reinforcement Learning

[Beta] Customizing GRPO Training with Python Code

Advanced Tutorial

Fine-tuning & Pretraining
Reinforcement Learning

Benchmark

Megatron MoE Training Benchmark and Tuning Guide

Legacy Documentation

Welcome to XTuner Chinese Documentation

API

Pretrain & SFT Trainer
- xtuner.v1.train.trainer.Trainer
- xtuner.v1.train.toy_tokenizer.UTF8ByteTokenizer
Config
RL Trainer
- xtuner.v1.train.rl_trainer.RLTrainer
RL Config
Loss Context

.rst

xtuner.v1.config.AdamWConfig

Contents

AdamWConfig

xtuner.v1.config.AdamWConfig#

xtuner.v1.config.AdamWConfig[source]#: alias of AdamWConfig

previous

xtuner.v1.config.OptimConfig

next

xtuner.v1.config.LRConfig

Contents

AdamWConfig

By XTuner Contributors

© Copyright 2024, XTuner Contributors.