Edenzzzz 8cc8f645cd [Examples] Add lazy init to OPT and GPT examples (#5924) ...

Co-authored-by: Edenzzzz <wtan45@wisc.edu>

2024-07-19 10:10:08 +08:00

..

bert

[misc] refactor launch API and tensor constructor (#5666)

2024-04-29 10:40:11 +08:00

commons

[example] make gpt example directory more clear (#2353)

2023-01-06 11:11:26 +08:00

gpt

[Examples] Add lazy init to OPT and GPT examples (#5924)

2024-07-19 10:10:08 +08:00

grok-1

[misc] refactor launch API and tensor constructor (#5666)

2024-04-29 10:40:11 +08:00

llama

[plugin] support all-gather overlap for hybrid parallel (#5919)

2024-07-18 15:33:03 +08:00

openmoe

[MoE/ZeRO] Moe refactor with zero refactor (#5821)

2024-06-28 14:00:08 +08:00

opt

[Examples] Add lazy init to OPT and GPT examples (#5924)

2024-07-19 10:10:08 +08:00

palm

[misc] refactor launch API and tensor constructor (#5666)

2024-04-29 10:40:11 +08:00

__init__.py

[example]add gpt2 benchmark example script. (#5295)

2024-03-04 16:18:13 +08:00

data_utils.py

[devops] remove post commit ci (#5566)

2024-04-08 15:09:40 +08:00

model_utils.py

[example]add gpt2 benchmark example script. (#5295)

2024-03-04 16:18:13 +08:00

performance_evaluator.py

[zero] support all-gather overlap (#5898)

2024-07-11 18:59:59 +08:00