ColossalAI/applications

Applications

This directory contains the applications that are powered by Colossal-AI.

The list of applications include:

• Colossal-LLaMA-2: Continual Pre-training of LLaMA-2.
• ColossalEval: Evaluation Pipeline for LLMs.
• ColossalChat: Replication of ChatGPT with RLHF.
• FastFold: Optimizing AlphaFold (Biomedicine) Training and Inference on GPU Clusters.
• ColossalQA: Document Retrieval Conversation System
• SwiftInfer: Breaks the Length Limit of LLM Inference for Multi-Round Conversations

Please note that the Chatbot application is migrated from the original ChatGPT folder.

You can find more example code for base models and functions in the Examples directory.