colossalai.context.random.seed_manager
- class colossalai.context.random.seed_manager.SeedManager
This class is a manager of all random seeds involved in the system.
- set_state(parallel_mode, state)
Sets the state of the seed manager for parallel_mode.
- Parameters
parallel_mode (
colossalai.context.ParallelMode) – The chosen parallel modestate (
torch.Tensor) – the state to be set
- Raises
AssertionError – Raises an AssertionError if parallel_mode is not found in the seed manager
- set_mode(parallel_mode)
Sets the current mode of the seed manager.
- Parameters
parallel_mode (
colossalai.context.ParallelMode) – The chosen parallel mode
- add_seed(parallel_mode, seed, overwrtie=False)
Adds a seed to the seed manager for parallel_mode.
- Parameters
parallel_mode (
colossalai.context.ParallelMode) – The chosen parallel modeseed (int) – The seed to be added
overwrtie (bool, optional) – Whether allows to overwrite the seed that has been set already
- Raises
AssertionError – Raises an AssertionError if parallel_mode is not an instance of
colossalai.context.ParallelModeor the seed for parallel_mode has been added