Sign in Subscribe

transformer-models

Jun
25
AI Model Simulates 500 Million Years of Evolution to create new Proteins! ESM3 is a LLM for Biology.

AI Model Simulates 500 Million Years of Evolution to create new Proteins! ESM3 is a LLM for Biology.

🆕 from Wes Roth! Discover how ESM3 simulates 500 million years of evolution to create new proteins, revolutionizing protein design with
3 min read
Apr
24
Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

🆕 from Yannic Kilcher! Discover how infinite attention revolutionizes sequence processing by enabling Transformer models to handle infinitely long inputs efficiently.
4 min read
Jan
13
Mixtral of Experts (Paper Explained)

Mixtral of Experts (Paper Explained)

🆕 from Yannic Kilcher! Explore the innovative Mixr of Experts model architecture and its impact on AI model performance and transparency.
3 min read