Colossal-AI
latest
API REFERENCE
colossalai
colossalai.amp
colossalai.builder
colossalai.communication
colossalai.context
colossalai.engine
colossalai.kernel
colossalai.logging
colossalai.nn
colossalai.registry
colossalai.testing
colossalai.trainer
colossalai.utils
colossalai.zero
colossalai.global_variables
colossalai.initialize
Colossal-AI
»
colossalai
»
colossalai.context
»
colossalai.context.process_group_initializer
»
colossalai.context.process_group_initializer.initializer_moe
Edit on GitHub
colossalai.context.process_group_initializer.initializer_moe