OLMoE

AI model · Language model (LLM) · Text → Text by Contextual AI

A small, fully open, state-of-the-art mixture-of-experts language model.

It is designed for researchers and developers who require a high-performance model that is also computationally efficient and transparent. It represents the company's commitment to pushing the boundaries of efficient model architectures.

Model specs

The full spec card (context, pricing per token, modalities and more) on AntSpace. Sign up free to see the full spec card.

Languages
English
Architecture
Mixture-of-Experts (MoE)
Access
Open Source / Download

Overview

It is designed for researchers and developers who require a high-performance model that is also computationally efficient and transparent. It represents the company's commitment to pushing the boundaries of efficient model architectures.

Model Architecture

  • Mixture-of-Experts Architecture: A small, fully open mixture-of-experts model designed for efficiency and high performance.
  • Open-Source Availability: The model is released as a fully open-weight system for the research community.
  • Efficiency Optimized: Designed to provide state-of-the-art performance while maintaining a small computational footprint.

Specifications

Architecture
Mixture-of-Experts (MoE)
Access
Open Source / Download

Added by AntSpace from public sources (contextual.ai).

Related

More AI models by Contextual AI