mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2025-10-27 11:31:25 +00:00
* adjust to dynamic prompt bs * remove debug * update pad seq (#6303) Co-authored-by: Tong Li <tong.li35271158@gmail.com> * adjust to dynamic prompt bs * remove debug * fix dp issue * fix * fix default settings --------- Co-authored-by: Tong Li <tong.li35271158@gmail.com>
Applications
This directory contains the applications that are powered by Colossal-AI.
The list of applications include:
- Open-Sora: Revealing Complete Model Parameters, Training Details, and Everything for Sora-like Video Generation Models
- ColossalChat: Replication of ChatGPT with RLHF.
- Colossal-LLaMA: Continual Pre-training and Supervisied Fine-tuning of LLaMA2 / LLaMA3.
- ColossalEval: Evaluation Pipeline for LLMs.
- FastFold: Optimizing AlphaFold (Biomedicine) Training and Inference on GPU Clusters.
- ColossalQA: Document Retrieval Conversation System
- SwiftInfer: Breaks the Length Limit of LLM Inference for Multi-Round Conversations
Please note that the
Chatbotapplication is migrated from the originalChatGPTfolder.
You can find more example code for base models and functions in the Examples directory.