Data sciencefromInfoQ11 months agoApple Open-Sources One Billion Parameter Language Model OpenELMOpenELM, Apple's Transformer-based language model, uses scaled-attention mechanism, outperforms similar models with fewer tokens, and is reproducible by anyone.