#scaling

Scaling Laws for Neural Language Models

Empirical laws governing how language model performance scales with compute, data, and parameters