ColossalAI/tests/components_to_test/utils/__init__.py
Hongxin Liu 50793b35f4
[gemini] accelerate inference (#3641)
* [gemini] support don't scatter after inference

* [chat] update colossalai strategy

* [chat] fix opt benchmark

* [chat] update opt benchmark

* [gemini] optimize inference

* [test] add gemini inference test

* [chat] fix unit test ci

* [chat] fix ci

* [chat] fix ci

* [chat] skip checkpoint test
2023-04-26 16:32:40 +08:00

3 lines
96 B
Python

from .dummy_data_generator import DummyDataGenerator
from .executor import run_fwd, run_fwd_bwd