ColossalAI/examples/language/openmoe/model
Yuanheng Zhao 55cc7f3df7
[Fix] Fix Inference Example, Tests, and Requirements (#5688)
* clean requirements

* modify example inference struct

* add test ci scripts

* mark test_infer as submodule

* rm deprecated cls & deps

* import of HAS_FLASH_ATTN

* prune inference tests to be run

* prune triton kernel tests

* increment pytest timeout mins

* revert import path in openmoe
2024-05-08 11:30:15 +08:00
..
__init__.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
convert_openmoe_ckpt.py [devops] remove post commit ci (#5566) 2024-04-08 15:09:40 +08:00
convert_openmoe_ckpt.sh [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
modeling_openmoe.py [Fix] Fix Inference Example, Tests, and Requirements (#5688) 2024-05-08 11:30:15 +08:00
openmoe_8b_config.json [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
openmoe_base_config.json [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
openmoe_policy.py [shardformer, pipeline] add gradient_checkpointing_ratio and heterogenous shard policy for llama (#5508) 2024-04-01 11:34:58 +08:00