This website requires JavaScript.
Explore
Help
Register
Sign In
github
/
ColossalAI
Watch
1
Star
0
Fork
0
You've already forked ColossalAI
mirror of
https://github.com/hpcaitech/ColossalAI.git
synced
2026-01-30 06:00:00 +00:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
Files
77a932830414374006ec951a3af7b62026897c84
ColossalAI
/
colossalai
/
inference
/
tensor_parallel
History
Xu Kai
77a9328304
[inference] add llama2 support (
#4898
)
...
* add llama2 support * fix multi group bug
2023-10-13 13:09:23 +08:00
..
modeling
[inference] add llama2 support (
#4898
)
2023-10-13 13:09:23 +08:00
policies
[inference]fix import bug and delete down useless init (
#4830
)
2023-10-04 09:18:45 +08:00
__init__.py
[misc] update pre-commit and run all files (
#4752
)
2023-09-19 14:20:26 +08:00
batch_infer_state.py
[misc] update pre-commit and run all files (
#4752
)
2023-09-19 14:20:26 +08:00
engine.py
[inference] add llama2 support (
#4898
)
2023-10-13 13:09:23 +08:00
kvcache_manager.py
[misc] update pre-commit and run all files (
#4752
)
2023-09-19 14:20:26 +08:00