#transformers

3 articles

Layer Normalization Normalizing each example across its features
Scaling Laws for Neural Language Models Why bigger models, more data, and more compute lead to predictable gains
Vision Transformer (ViT) Applying Transformers directly to image patches for visual recognition