Jianghai ef4c14a5e2 [Inference] Fix bug in ChatGLM2 Tensor Parallelism (#5014) ...

* fix bug

* fix

* fix multiquery

* fix multiquery

---------

Co-authored-by: CjhHa1 <cjh18671720497outlook.com>

2023-11-07 15:01:50 +08:00

..

__init__.py

[hotfix] Add layer norm gradients all-reduce for sequence parallel (#4926)

2023-11-03 13:32:43 +08:00

_operation.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

dropout.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

embedding.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

linear.py

[Inference] Fix bug in ChatGLM2 Tensor Parallelism (#5014)

2023-11-07 15:01:50 +08:00

loss.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

normalization.py

[hotfix] Add layer norm gradients all-reduce for sequence parallel (#4926)

2023-11-03 13:32:43 +08:00

parallel_module.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

qkv_fused_linear.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

utils.py

[hotfix] Add layer norm gradients all-reduce for sequence parallel (#4926)

2023-11-03 13:32:43 +08:00