Normalization

Synchronized Batch Normalization

Introduced by Zhang et al. in Context Encoding for Semantic Segmentation

Synchronized Batch Normalization (SyncBN) is a type of batch normalization used for multi-GPU training. Standard batch normalization only normalizes the data within each device (GPU). SyncBN normalizes the input within the whole mini-batch.

Source: Context Encoding for Semantic Segmentation

Papers


Paper Code Results Date Stars

Components


Component Type
🤖 No Components Found You can add them if they exist; e.g. Mask R-CNN uses RoIAlign

Categories