yingliu-hpc 1467e3b41b [coati] add chatglm model (#4539) ...

* update configuration of chatglm and add support in coati

* add unit test & update chatglm default config & fix bos index issue

* remove chatglm due to oom

* add dataset pkg in requirement-text

* fix parameter issue in test_models

* add ref in tokenize & rm unnessary parts

* separate source & target tokenization in chatglm

* add unit test to chatglm

* fix test dataset issue

* update truncation of chatglm

* fix Colossalai version

* fix colossal ai version in test

2023-08-29 17:58:51 +08:00

..

__init__.py

[Coati] first commit (#3283)

2023-03-28 20:25:36 +08:00

test_benchmarks.sh

[chat] fix bugs and add unit tests (#4213)

2023-08-02 10:17:36 +08:00

test_checkpoint.py

[chat] fix bugs and add unit tests (#4213)

2023-08-02 10:17:36 +08:00

test_dataset.py

[coati] add chatglm model (#4539)

2023-08-29 17:58:51 +08:00

test_experience.py

[chat] fix bugs and add unit tests (#4213)

2023-08-02 10:17:36 +08:00

test_inference.sh

[chat] fix bugs and add unit tests (#4213)

2023-08-02 10:17:36 +08:00

test_models.py

[coati] add chatglm model (#4539)

2023-08-29 17:58:51 +08:00

test_train.sh

[chat] fix bugs and add unit tests (#4213)

2023-08-02 10:17:36 +08:00