OLMoE
AI model · Language model (LLM) · Text → Text by Contextual AI
A small, fully open, state-of-the-art mixture-of-experts language model.
It is designed for researchers and developers who require a high-performance model that is also computationally efficient and transparent. It represents the company's commitment to pushing the boundaries of efficient model architectures.
Model specs
The full spec card (context, pricing per token, modalities and more) on AntSpace. Sign up free to see the full spec card.
- Languages
- English
- Architecture
- Mixture-of-Experts (MoE)
- Access
- Open Source / Download
Overview
It is designed for researchers and developers who require a high-performance model that is also computationally efficient and transparent. It represents the company's commitment to pushing the boundaries of efficient model architectures.
Model Architecture
- Mixture-of-Experts Architecture: A small, fully open mixture-of-experts model designed for efficiency and high performance.
- Open-Source Availability: The model is released as a fully open-weight system for the research community.
- Efficiency Optimized: Designed to provide state-of-the-art performance while maintaining a small computational footprint.
Specifications
- Architecture
- Mixture-of-Experts (MoE)
- Access
- Open Source / Download
Added by AntSpace from public sources (contextual.ai).