Frank Lee af88570f4b fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes

2021-11-10 10:47:58 +08:00

..

__init__.py

Migrated project

2021-10-28 18:21:23 +02:00

_base_schedule.py

Add gradient accumulation, fix lr scheduler

2021-11-08 16:30:24 +08:00

_no_pipeline.py

fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes

2021-11-10 10:47:58 +08:00

_pipeline.py

fix FP16 optimizer and adapted torch amp with tensor parallel (#18)

2021-11-08 16:47:32 +08:00

_utils.py

fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes

2021-11-10 10:47:58 +08:00