github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-05 11:02:05 +00:00
Code Issues Packages Projects Releases Wiki Activity

[Gemini] GeminiDPP convert to PyTorch Module. (#2151)

Browse Source
This commit is contained in:
Jiarui Fang
2022-12-20 10:19:36 +08:00
committed by GitHub
parent bdef9dfdbe
commit 2827f41898
3 changed files with 76 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
colossalai/tensor/colo_tensor.py
View File

@@ -103,7 +103,6 @@ class ColoTensor(torch.Tensor):
self.process_group = spec.pg
self._type = TensorType.NONMODEL
self._graph_node = None
def has_compute_spec(self) -> bool:
return self.compute_spec is not None