colossalai.utils.profiler.comm_profiler

class colossalai.utils.profiler.comm_profiler.CommEvent(count=0, comm_vol=0.0, cuda_time=0)

Communication Event. Used for communication time and communication volume recording.

class colossalai.utils.profiler.comm_profiler.CommProfiler(depth=0, total_count=0, total_comm_vol=0, total_cuda_time=0)

Communication profiler. Records all communication events.

class colossalai.utils.profiler.comm_profiler.CommHandler(profiler)

Communication handler. A dummy handler to wait aync operations.