Jianghai ce7ade3882 [inference] chatglm2 infer demo (#4724) ...

* add chatglm2

* add

* gather needed kernels

* fix some bugs

* finish context forward

* finish context stage

* fix

* add

* pause

* add

* fix bugs

* finish chatglm

* fix bug

* change some logic

* fix bugs

* change some logics

* add

* add

* add

* fix

* fix tests

* fix

2023-09-22 11:12:50 +08:00

..

cuda_native

[feature] add gptq for inference (#4754)

2023-09-22 11:02:50 +08:00

jit

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

triton

[inference] chatglm2 infer demo (#4724)

2023-09-22 11:12:50 +08:00

__init__.py

[hotfix] Fix import error: colossal.kernel without triton installed (#4722)

2023-09-14 18:03:55 +08:00

op_builder

[builder] reconfig op_builder for pypi install (#2314)

2023-01-04 16:32:32 +08:00