Colossal-AI
feature/docs

API REFERENCE

  • Colossal-AI
    • colossalai.amp
    • colossalai.builder
    • colossalai.communication
    • colossalai.context
    • colossalai.engine
    • colossalai.kernel
    • colossalai.logging
    • colossalai.nn
      • colossalai.nn.layer
      • colossalai.nn.loss
      • colossalai.nn.lr_scheduler
      • colossalai.nn.metric
      • colossalai.nn.model
      • colossalai.nn.optimizer
      • colossalai.nn.init
    • colossalai.registry
    • colossalai.testing
    • colossalai.trainer
    • colossalai.utils
    • colossalai.zero
    • colossalai.initialize

Useful links for Colossal-AI

  • Colossal-AI Examples
  • Colossal-AI Benchmarks
  • Colossal-AI Tutorial
Colossal-AI
  • »
  • Colossal-AI »
  • colossalai.nn »
  • colossalai.nn.optimizer
  • Edit on GitHub

colossalai.nn.optimizer

  • colossalai.nn.optimizer.colossalai_optimizer
  • colossalai.nn.optimizer.cpu_adam
  • colossalai.nn.optimizer.fused_adam
  • colossalai.nn.optimizer.fused_lamb
  • colossalai.nn.optimizer.fused_sgd
  • colossalai.nn.optimizer.hybrid_adam
  • colossalai.nn.optimizer.lamb
  • colossalai.nn.optimizer.lars
Previous Next

© Copyright 2022, HPC-AI Tech. Revision f52749bf.

Built with Sphinx using a theme provided by Read the Docs.