zbian 7bc0afc901 updated flash attention usage

2023-03-20 17:57:04 +08:00

..

test_checkpoint

[hotfix] skipped unsafe test cases (#1282)

2022-07-13 00:08:59 +08:00

test_checkpoint_io

[CheckpointIO] a uniform checkpoint I/O module (#1689)

2022-11-08 15:15:13 +08:00

test_lazy_init

[lazyinit] add correctness verification (#3147)

2023-03-17 13:49:04 +08:00

test_activation_checkpointing.py

[utils] Add use_reetrant=False in utils.activation_checkpoint (#1460)

2022-08-16 15:39:20 +08:00

test_colo_checkpoint.py

[hotfix] fix a running error in test_colo_checkpoint.py (#1387)

2022-07-29 15:58:06 +08:00

test_commons.py

…

test_flash_attention.py

updated flash attention usage

2023-03-20 17:57:04 +08:00

test_lazy_init_ctx.py

[utils] integrated colotensor with lazy init context (#1324)

2022-07-15 17:47:12 +08:00

test_memory.py

…

test_norm_gradient_clipping.py

[Doc] add more doc for ColoTensor. (#1458)

2022-08-16 10:38:41 +08:00

test_zero_gradient_clippling.py

…