Colossal-AI
feature/docs

API REFERENCE

  • Colossal-AI
    • colossalai.amp
    • colossalai.builder
    • colossalai.communication
    • colossalai.context
    • colossalai.engine
    • colossalai.kernel
    • colossalai.logging
    • colossalai.nn
    • colossalai.registry
    • colossalai.testing
    • colossalai.trainer
    • colossalai.utils
      • colossalai.utils.data_sampler
      • colossalai.utils.gradient_accumulation
      • colossalai.utils.memory_tracer
      • colossalai.utils.multi_tensor_apply
      • colossalai.utils.tensor_detector
      • colossalai.utils.activation_checkpoint
      • colossalai.utils.checkpointing
      • colossalai.utils.common
      • colossalai.utils.cuda
      • colossalai.utils.moe
      • colossalai.utils.timer
    • colossalai.zero
    • colossalai.initialize

Useful links for Colossal-AI

  • Colossal-AI Examples
  • Colossal-AI Benchmarks
  • Colossal-AI Tutorial
Colossal-AI
  • »
  • Colossal-AI »
  • colossalai.utils
  • Edit on GitHub

colossalai.utils

This part contains useful utils for colossalai

  • colossalai.utils.data_sampler
  • colossalai.utils.gradient_accumulation
  • colossalai.utils.memory_tracer
  • colossalai.utils.multi_tensor_apply
    • colossalai.utils.multi_tensor_apply.multi_tensor_apply
  • colossalai.utils.tensor_detector
  • colossalai.utils.activation_checkpoint
  • colossalai.utils.checkpointing
  • colossalai.utils.common
  • colossalai.utils.cuda
  • colossalai.utils.moe
  • colossalai.utils.timer
Previous Next

© Copyright 2022, HPC-AI Tech. Revision f52749bf.

Built with Sphinx using a theme provided by Read the Docs.