Olmo Hybrid: AI2's Open-Source Model Hints at a Post-Transformer Future
AI2 and Lambda trained a hybrid transformer-RNN model that's twice as data-efficient as pure transformers. But can you actually run it locally?
Tag
AI2 and Lambda trained a hybrid transformer-RNN model that's twice as data-efficient as pure transformers. But can you actually run it locally?
OpenScholar matches human expert citation accuracy while GPT-4o fabricates sources 78-90% of the time. The code, models, and 45 million paper corpus are all free to use.