Files
ColossalAI/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py
Hongxin Liu 079bf3cb26 [misc] update pre-commit and run all files (#4752)
* [misc] update pre-commit

* [misc] run pre-commit

* [misc] remove useless configuration files

* [misc] ignore cuda for clang-format
2023-09-19 14:20:26 +08:00

9 lines
217 B
Python

import torch
from ...registry import meta_patched_function
@meta_patched_function.register(torch.nn.functional.relu)
def torch_nn_func_relu(input, inplace=False):
return torch.empty(input.shape, device="meta")