github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-03 10:06:44 +00:00
Code Issues Packages Projects Releases Wiki Activity

[pipeline]refactor ppschedule to support tensor list (#1050)

Browse Source 
* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4.

* refactor ppschedule to support tensor list

* polish
This commit is contained in:
YuliangLiu0306
2022-06-02 13:48:59 +08:00
committed by GitHub
parent e3fde4ee6b
commit b167258b6a
4 changed files with 259 additions and 215 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
tests/test_trainer/test_pipeline/test_p2p.py
View File

@@ -7,9 +7,9 @@ import pytest
import torch
import torch.distributed as dist
import torch.multiprocessing as mp
from colossalai.communication import (recv_backward, recv_forward, recv_tensor_meta, send_backward,
from colossalai.communication import (recv_backward, recv_forward, recv_obj_meta, send_backward,
send_backward_recv_forward, send_forward, send_forward_recv_backward,
send_tensor_meta)
send_obj_meta)
from colossalai.context.parallel_mode import ParallelMode
from colossalai.core import global_context as gpc
from colossalai.initialize import launch