Jianghai ce7ade3882 [inference] chatglm2 infer demo (#4724) ...

* add chatglm2

* add

* gather needed kernels

* fix some bugs

* finish context forward

* finish context stage

* fix

* add

* pause

* add

* fix bugs

* finish chatglm

* fix bug

* change some logic

* fix bugs

* change some logics

* add

* add

* add

* fix

* fix tests

* fix

2023-09-22 11:12:50 +08:00

..

components_to_test

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

kit

[inference] chatglm2 infer demo (#4724)

2023-09-22 11:12:50 +08:00

test_analyzer

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_auto_parallel

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_autochunk

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_booster

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_checkpoint_io

[shardformer] fix master param sync for hybrid plugin/rewrite unwrapping logic (#4758)

2023-09-20 18:29:37 +08:00

test_cluster

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_config

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_device

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_fx

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_gptq

[feature] add gptq for inference (#4754)

2023-09-22 11:02:50 +08:00

test_infer

[inference] chatglm2 infer demo (#4724)

2023-09-22 11:12:50 +08:00

test_infer_ops

[inference] chatglm2 infer demo (#4724)

2023-09-22 11:12:50 +08:00

test_lazy

[lazy] support torch 2.0 (#4763)

2023-09-21 16:30:23 +08:00

test_legacy

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_moe

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_optimizer

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_pipeline

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_shardformer

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_tensor

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_utils

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_zero

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

__init__.py

…