colossalai.utils.multi_tensor_apply.multi_tensor_apply

class colossalai.utils.multi_tensor_apply.multi_tensor_apply.MultiTensorApply(chunk_size)

Apply an operation to a list of tensors efficiently

Parameters

chunk_size (int) – Size of a chunk