#long-context-modeling

[ follow ]
InfoQ
3 months ago
Data science

Meta Open-Sources MEGALODON LLM for Efficient Long Sequence Modeling

MEGALODON, a large language model (LLM), outperforms Llama 2 model on various benchmarks with linear computational complexity and unlimited context length. [ more ]
[ Load more ]