colossalai.utils.multi_tensor_apply.multi_tensor_apply

class colossalai.utils.multi_tensor_apply.multi_tensor_apply.MultiTensorApply(chunk_size)[source]

Apply an operation to a list of tensors efficiently.

Parameters

chunk_size (int) – Size of a chunk.