github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-09 04:50:17 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add padding llama model

Browse Source
This commit is contained in:
yuehuayingxueluo
2023-12-25 14:07:43 +08:00
committed by FrankLeeeee
parent 0e616462a7
commit 86853a37d5
5 changed files with 262 additions and 11 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
colossalai/inference/config.py
View File

@@ -1,7 +1,6 @@
"""
Our config consists of two parts:
Our config consists of one part:
1. inference_config: configs for inference, it is a unified api that wraps all the configs for inference.
2. generation_config: configs for generation, it is inherited from huggingface.
"""
import logging