github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-01-14 12:10:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
822241a99cca799e1fca250ff2fb7f54ea0f8dcd
ColossalAI/applications
History
binmakeswell 822241a99c [doc] sora release (#5425) 
* [doc] sora release

* [doc] sora release

* [doc] sora release

* [doc] sora release
2024-03-05 12:08:58 +08:00
..
Chat
[Chat] fix sft loss nan (#5345)
2024-02-01 14:25:16 +08:00
Colossal-LLaMA-2
fix sft single turn inference example (#5416)
2024-03-01 17:27:50 +08:00
ColossalEval
[eval] update llama npu eval (#5366)
2024-02-06 10:53:03 +08:00
ColossalMoE
[moe] fix mixtral optim checkpoint (#5344)
2024-02-07 19:21:02 +08:00
ColossalQA
fix auto loading gpt2 tokenizer (#5279)
2024-01-18 14:08:29 +08:00
README.md
[doc] sora release (#5425)
2024-03-05 12:08:58 +08:00

README.md

Applications

This directory contains the applications that are powered by Colossal-AI.

The list of applications include:

  • Open-Sora: Sora Replication Solution with 46% Cost Reduction, Sequence Expansion to Nearly a Million
  • Colossal-LLaMA-2: Continual Pre-training of LLaMA-2.
  • ColossalEval: Evaluation Pipeline for LLMs.
  • ColossalChat: Replication of ChatGPT with RLHF.
  • FastFold: Optimizing AlphaFold (Biomedicine) Training and Inference on GPU Clusters.
  • ColossalQA: Document Retrieval Conversation System
  • SwiftInfer: Breaks the Length Limit of LLM Inference for Multi-Round Conversations

Please note that the Chatbot application is migrated from the original ChatGPT folder.

You can find more example code for base models and functions in the Examples directory.

Reference in New Issue View Git Blame Copy Permalink