High-performance RLHF framework with Ray+vLLM acceleration. Use for PPO, GRPO, RLOO, DPO training of large models (7B-70B+). Built on Ray, vLLM, ZeRO-3. 2x faster than DeepSpeedChat with distributed architecture and GPU resource sharing.
/plugin marketplace add zechenzhangAGI/AI-research-SKILLs/plugin install openrlhf-training@zechenzhangAGI/AI-research-SKILLs