Olmo Hybrid: AI2's Open-Source Model Hints at a Post-Transformer Future
AI2 and Lambda trained a hybrid transformer-RNN model that's twice as data-efficient as pure transformers. But can you actually run it locally?
Tag
AI2 and Lambda trained a hybrid transformer-RNN model that's twice as data-efficient as pure transformers. But can you actually run it locally?