WeightsBroadcastConfig¶

Module: fast_llm.engine.training.config

Fields¶

backend — feature

Type: DistributedBackend Default: "nccl"

Backend for the external NCCL process group.

external_world_size — feature

Type: int Default: 1

World size of the external NCCL process group.

host — feature

Type: str Default: "localhost"

Master address for the external NCCL process group.

port — feature

Type: int Default: 23456

Master port for the external NCCL process group.