Trainer Interface ================================ 最后更新:06/08/2025 (API 文档字符串为自动生成)。 训练器负责驱动训练循环。在引入新的训练范式时,鼓励创建新的训练器类。 .. autosummary:: :nosignatures: verl.trainer.ppo.ray_trainer.RayPPOTrainer 核心 API ~~~~~~~~~~~~~~~~~ .. autoclass:: verl.trainer.ppo.ray_trainer.RayPPOTrainer :members: __init__, init_workers, fit .. automodule:: verl.utils.tokenizer :members: hf_tokenizer .. automodule:: verl.trainer.ppo.core_algos :members: agg_loss, kl_penalty, compute_policy_loss, kl_penalty .. automodule:: verl.trainer.ppo.reward :members: load_reward_manager, compute_reward, compute_reward_async .. autoclass:: verl.workers.reward_manager.NaiveRewardManager .. autoclass:: verl.workers.reward_manager.DAPORewardManager