Frank Lee af88570f4b fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes

2021-11-10 10:47:58 +08:00

..

amp

fix FP16 optimizer and adapted torch amp with tensor parallel (#18)

2021-11-08 16:47:32 +08:00

gradient_handler

Migrated project

2021-10-28 18:21:23 +02:00

schedule

fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes

2021-11-10 10:47:58 +08:00

__init__.py

fix FP16 optimizer and adapted torch amp with tensor parallel (#18)

2021-11-08 16:47:32 +08:00

_base_engine.py

Add gradient accumulation, fix lr scheduler

2021-11-08 16:30:24 +08:00