github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-07-19 01:39:26 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix chunk move device (#1158)

Browse Source
This commit is contained in:
ver217 2022-06-22 18:07:10 +08:00 committed by GitHub
parent 07f9c781f9
commit 4e67b2a890
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
colossalai/tensor/chunk.py
View File

@ -455,7 +455,7 @@ class ChunkManager:
chunk (Chunk): the chunk to move to target device chunk (Chunk): the chunk to move to target device
device (torch.device): target device device (torch.device): target device
""" """
if chunk.data.device == device: if chunk.device_type == device.type:
return return
if chunk.can_move_device and not chunk.is_empty: if chunk.can_move_device and not chunk.is_empty:
self.total_mem[chunk.device_type] -= chunk.mem self.total_mem[chunk.device_type] -= chunk.mem