---
title: "AI models released in April 2024"
type: "release-archive"
canonical_url: "https://theaiengineering.com/releases/2024/04"
markdown_url: "https://theaiengineering.com/releases/2024/04.md"
author: "The AI Engineering Editors"
publisher: "The AI Engineering"
updated: "2024-04-30"
citation: "The AI Engineering Editors. \"AI models released in April 2024.\" The AI Engineering, updated Apr 30, 2024. https://theaiengineering.com/releases/2024/04"
license: "CC BY 4.0"
license_url: "https://creativecommons.org/licenses/by/4.0/"
data_csv: "https://theaiengineering.com/releases.csv"
data_json: "https://theaiengineering.com/releases.json"
---

# AI models released in April 2024

21 releases from 13 labs, 16 with open weights. Dates are the labs' official announcement dates.

## April 2024

### Amazon Titan Text Embeddings V2

Amazon Titan Text Embeddings V2 is Amazon's second-generation text embedding model, optimized for retrieval-augmented generation, with selectable output dimensions, default normalization and pre-training on more than 100 languages plus code.

- Date: 2024-04-30
- Lab: Amazon
- Type: Embedding
- Weights: Proprietary
- Modalities: text → embedding
- Context window: 8,192 tokens
- Available at launch: API
- Permalink: https://theaiengineering.com/releases/2024/04#amazon-titan-text-embeddings-v2

Highlights:

- Accepts up to 8,192 input tokens
- Output dimensions of 256, 512 or 1,024
- Launched in US East (N. Virginia) and US West (Oregon)

Source: [Amazon Titan Text Embeddings V2 now available in Amazon Bedrock, optimized for improving RAG](https://aws.amazon.com/blogs/aws/amazon-titan-text-v2-now-available-in-amazon-bedrock-optimized-for-improving-rag/)

### Qwen1.5-110B

Qwen1.5-110B is the first 100B-plus model in the Qwen1.5 series, built with the same Transformer decoder architecture as other Qwen1.5 models.

- Date: 2024-04-25
- Lab: Alibaba Qwen
- Type: LLM
- Weights: Open weights
- Modalities: text → text
- Context window: 32,000 tokens
- Parameters: 110B
- License: Tongyi Qianwen License Agreement
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/04#qwen1-5-110b

Highlights:

- 32K-token context length
- Multilingual, including English, Chinese, French, Spanish, German, Russian, Korean, and Japanese
- Weights under the Tongyi Qianwen License Agreement

Source: [Qwen1.5-110B: The First 100B+ Model of the Qwen1.5 Series](https://qwenlm.github.io/blog/qwen1.5-110b/)

### Snowflake Arctic

Enterprise-focused open language model with a dense-MoE hybrid architecture that combines a 10B dense transformer with a residual 128-expert MoE layer.

- Date: 2024-04-24
- Lab: Snowflake
- Type: LLM
- Weights: Open weights
- Modalities: text → text
- Parameters: Dense-MoE hybrid: 480B total, 17B active
- License: Apache-2.0
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/04#snowflake-arctic

Highlights:

- Uses top-2 gating across 128 fine-grained experts
- Base and instruct checkpoints released under Apache 2.0
- Data recipes and research insights open-sourced

Source: [Snowflake Arctic - LLM for Enterprise AI](https://www.snowflake.com/en/blog/arctic-open-efficient-foundation-language-models-snowflake/)

### OpenELM

OpenELM is Apple's family of small open language models that use layer-wise scaling to allocate parameters across transformer layers, released with pretrained and instruction-tuned versions.

- Date: 2024-04-23
- Lab: Apple
- Type: Small model
- Weights: Open weights
- Modalities: text → text
- Parameters: 270M, 450M, 1.1B, 3B
- License: Apple Machine Learning Research Model License
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/04#openelm

Highlights:

- Pretrained on about 1.8 trillion tokens of public data
- Release includes training and evaluation framework, logs and checkpoints
- Includes code to convert models to MLX for Apple devices

Source: [apple/OpenELM model card](https://huggingface.co/apple/OpenELM)

### Phi-3-mini

Phi-3-mini is a 3.8B instruction-tuned Microsoft small language model and the first of the Phi-3 family, offered in 4K and 128K context variants for on-device, latency-sensitive and cost-constrained uses.

- Date: 2024-04-23
- Lab: Microsoft
- Type: Small model
- Weights: Open weights
- Modalities: text → text
- Context window: 128,000 tokens
- Parameters: 3.8B
- License: MIT
- Available at launch: Open weights, API, Cloud platforms
- Permalink: https://theaiengineering.com/releases/2024/04#phi-3-mini

Highlights:

- Available in 4K and 128K token context variants
- Released on Azure AI Studio, Hugging Face and Ollama, and as an NVIDIA NIM microservice
- Safety post-training included RLHF and red-teaming

Source: [Introducing Phi-3: Redefining what's possible with SLMs](https://azure.microsoft.com/en-us/blog/introducing-phi-3-redefining-whats-possible-with-slms/)

### Llama 3

Llama 3 is Meta's third-generation open model family, released as 8B and 70B pretrained and instruction-tuned models trained on over 15 trillion tokens.

- Date: 2024-04-18
- Lab: Meta
- Type: LLM
- Weights: Open weights
- Modalities: text → text
- Context window: 8,192 tokens
- Parameters: 8B, 70B
- License: Meta Llama 3 Community License
- Available at launch: Open weights, Cloud platforms
- Permalink: https://theaiengineering.com/releases/2024/04#llama-3

Highlights:

- Trained on sequences of 8,192 tokens
- Released with Llama Guard 2, Code Shield and CyberSec Eval 2
- Meta said models over 400B parameters were still in training

Source: [Introducing Meta Llama 3: The most capable openly available LLM to date](https://ai.meta.com/blog/meta-llama-3/)

### Llama Guard 2

Llama Guard 2 is an 8B Llama 3 based input and output safeguard model released with Llama 3, using the MLCommons hazard taxonomy.

- Date: 2024-04-18
- Lab: Meta
- Type: LLM
- Weights: Open weights
- Modalities: text → text
- Parameters: 8B
- License: Meta Llama 3 Community License
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/04#llama-guard-2

Highlights:

- Predicts safety labels on 11 of the 13 MLCommons hazard categories
- Can be fine-tuned for different applications

Source: [Introducing Meta Llama 3: The most capable openly available LLM to date](https://ai.meta.com/blog/meta-llama-3/)

### Mixtral 8x22B

Larger sparse mixture-of-experts model released under Apache 2.0, with native function calling, strong math and coding skills and a 64K-token context window.

- Date: 2024-04-17
- Lab: Mistral AI
- Type: LLM
- Weights: Open weights
- Modalities: text → text
- Context window: 64,000 tokens
- Parameters: MoE: 141B total, 39B active
- License: Apache-2.0
- Available at launch: Open weights, API
- Permalink: https://theaiengineering.com/releases/2024/04#mixtral-8x22b

Highlights:

- Fluent in English, French, Italian, German and Spanish
- Base and instruct checkpoints released
- API model ID open-mixtral-8x22b

Source: [Cheaper, Better, Faster, Stronger | Mistral AI](https://mistral.ai/news/mixtral-8x22b)

### OLMo 1.7 7B

Updated 7B OLMo model with a longer context window, a new two-stage training procedure and improved data, released with the Dolma 1.7 dataset.

- Date: 2024-04-17
- Lab: Ai2
- Type: LLM
- Weights: Open weights
- Modalities: text → text
- Context window: 4,096 tokens
- Parameters: 7B
- License: Apache-2.0
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/04#olmo-1-7

Highlights:

- Context length raised from 2,048 to 4,096 tokens
- Trained on the new Dolma 1.7 data mix
- Released under Apache 2.0

Source: [OLMo 1.7–7B: A 24 point improvement on MMLU | Ai2](https://allenai.org/blog/olmo-1-7-7b-a-24-point-improvement-on-mmlu-92b43f7d269d)

### Arctic Embed

Snowflake's family of open text embedding models optimized for retrieval quality at each size, released on Hugging Face under Apache 2.0.

- Date: 2024-04-16
- Lab: Snowflake
- Type: Embedding
- Weights: Open weights
- Modalities: text → embedding
- License: Apache-2.0
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/04#snowflake-arctic-embed

Highlights:

- Released in xs, s, m, m-long and l sizes
- A technical report followed in May 2024
- Arctic Embed M v1.5 added compressible vectors in July 2024

Source: [Snowflake/snowflake-arctic-embed-m · Hugging Face](https://huggingface.co/Snowflake/snowflake-arctic-embed-m)

### CodeQwen1.5

CodeQwen1.5-7B is a specialized code model built on the Qwen1.5 language model and pre-trained on around 3T tokens of code-related data.

- Date: 2024-04-16
- Lab: Alibaba Qwen
- Type: Coding
- Weights: Open weights
- Modalities: text → text
- Context window: 64,000 tokens
- Parameters: 7B
- License: Tongyi Qianwen License Agreement
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/04#codeqwen1-5

Highlights:

- Supports 92 programming languages
- Processes up to 64K tokens of context
- Weights under the Tongyi Qianwen License Agreement

Source: [Code with CodeQwen1.5](https://qwenlm.github.io/blog/codeqwen1.5/)

### Idefics2

General multimodal model that takes arbitrary sequences of text and images, improving on Idefics1 with a smaller size, an open license and stronger OCR.

- Date: 2024-04-15
- Lab: Hugging Face
- Type: Multimodal
- Weights: Open weights
- Modalities: text, image → text
- Parameters: 8B
- License: Apache-2.0
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/04#idefics2

Highlights:

- 8B parameters under Apache 2.0
- Improved optical character recognition
- Base and instruct versions released

Source: [Introducing Idefics2: A Powerful 8B Vision-Language Model for the community](https://huggingface.co/blog/idefics2)

### Reka Core

Reka's largest model at launch, a multimodal language model trained from scratch that accepts text, image, video and audio input and was offered via API, on-premises or on-device deployment.

- Date: 2024-04-15
- Lab: Reka
- Type: Multimodal
- Weights: Proprietary
- Modalities: text, image, video, audio → text
- Available at launch: API, Consumer app, Enterprise
- Permalink: https://theaiengineering.com/releases/2024/04#reka-core

Highlights:

- 128K context window
- Pretrained on text from 32 languages
- Launch partners included Snowflake (Cortex), Oracle and AI Singapore
- Technical report published alongside the launch

Source: [Reka Core: Our Frontier Class Multimodal Language Model](https://reka.ai/news/reka-core-our-frontier-class-multimodal-language-model)

### Rerank 3

Reranking foundation model for enterprise search and RAG that handles longer documents and semi-structured data such as emails, JSON, code and tables.

- Date: 2024-04-11
- Lab: Cohere
- Type: Reranker
- Weights: Proprietary
- Modalities: text → score
- Context window: 4,000 tokens
- Available at launch: API
- Permalink: https://theaiengineering.com/releases/2024/04#cohere-rerank-3

Highlights:

- 4K-token context length
- Covers 100+ languages
- Improved latency and lower total cost of ownership

Source: [Rerank 3: Efficient Enterprise Search & Retrieval](https://cohere.com/blog/rerank-3)

### CodeGemma

CodeGemma is a family of Gemma-based open code models for code completion, generation and chat. It includes a 7B pretrained model, a 7B instruction-tuned model and a 2B model for fast local code completion.

- Date: 2024-04-09
- Lab: Google
- Type: Coding
- Weights: Open weights
- Modalities: text → text
- Parameters: 2B, 7B
- License: Gemma Terms of Use
- Available at launch: Open weights, Cloud platforms
- Permalink: https://theaiengineering.com/releases/2024/04#codegemma

Highlights:

- Trained on an additional 500 billion tokens of mostly English web, math and code data
- Available on Kaggle, Hugging Face and Vertex AI Model Garden
- CodeGemma 1.1 followed on May 3, 2024

Source: [Gemma Family Expands with Models Tailored for Developers and Researchers](https://developers.googleblog.com/en/gemma-family-expands-with-models-tailored-for-developers-and-researchers/)

### RecurrentGemma

RecurrentGemma is a research-oriented open Gemma model that replaces the transformer with recurrent layers and local attention (the Griffin architecture), lowering memory use and keeping sampling speed steady on long sequences.

- Date: 2024-04-09
- Lab: Google
- Type: Small model
- Weights: Open weights
- Modalities: text → text
- Parameters: 2B
- License: Gemma Terms of Use
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/04#recurrentgemma

Highlights:

- Higher throughput at large batch sizes than transformer-based Gemma
- Released on Kaggle with fine-tuning notebooks
- A 9B variant followed on June 11, 2024

Source: [Gemma Family Expands with Models Tailored for Developers and Researchers](https://developers.googleblog.com/en/gemma-family-expands-with-models-tailored-for-developers-and-researchers/)

### text-embedding-004

text-embedding-004 is a Google text embedding model released in the Gemini API, offered in Vertex AI as text-embedding-preview-0409, with stronger retrieval performance than Google's earlier embedding models.

- Date: 2024-04-09
- Lab: Google
- Type: Embedding
- Weights: Proprietary
- Modalities: text → embedding
- Available at launch: API, Cloud platforms
- Permalink: https://theaiengineering.com/releases/2024/04#text-embedding-004

Highlights:

- Supports elastic embedding sizes under 768 dimensions
- Released the same day Gemini 1.5 Pro entered public preview in the Gemini API
- Shut down in the Gemini API on Jan 14, 2026

Source: [Gemini 1.5 Pro Now Available in 180+ Countries; with Native Audio Understanding, System Instructions, JSON Mode and more](https://developers.googleblog.com/gemini-15-pro-now-available-in-180-countries-with-native-audio-understanding-system-instructions-json-mode-and-more/)

### Stable LM 2 12B

12B-parameter base and instruction-tuned language models trained on 2 trillion tokens in seven languages, released alongside an updated Stable LM 2 1.6B with tool use and function calling.

- Date: 2024-04-08
- Lab: Stability AI
- Type: LLM
- Weights: Open weights
- Modalities: text → text
- Parameters: 12B
- License: Stability AI Community License
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/04#stable-lm-2-12b

Highlights:

- Seven languages including English, Spanish, German and French
- Commercial use through a Stability AI Membership
- Base and chat models on Hugging Face

Source: [Introducing Stable LM 2 12B](https://stability.ai/news-updates/introducing-stable-lm-2-12b)

### Command R+

Largest model in Cohere's R series at launch, built for advanced RAG with citations, multi-step tool use and multilingual business workloads.

- Date: 2024-04-04
- Lab: Cohere
- Type: LLM
- Weights: Open weights
- Modalities: text → text
- Context window: 128,000 tokens
- Parameters: 104B
- License: CC-BY-NC-4.0
- Available at launch: API, Open weights, Cloud platforms
- Permalink: https://theaiengineering.com/releases/2024/04#command-r-plus

Highlights:

- Launched first on Microsoft Azure and Cohere's API
- Covers 10 key business languages
- Research weights published under a non-commercial license

Source: [Introducing Command R+: A Scalable LLM Built for Business | Cohere Blog](https://cohere.com/blog/command-r-plus-microsoft-azure)

### Stable Audio 2.0

Second-generation Stable Audio model producing full tracks with coherent structure up to three minutes long at 44.1 kHz stereo from a single prompt, and adding audio-to-audio generation.

- Date: 2024-04-03
- Lab: Stability AI
- Type: Music
- Weights: Proprietary
- Modalities: text, audio → audio
- Available at launch: Consumer app, API
- Permalink: https://theaiengineering.com/releases/2024/04#stable-audio-2

Highlights:

- Trained exclusively on licensed data from the AudioSparx library
- Free to use on the Stable Audio website at launch
- API availability followed later

Source: [Introducing Stable Audio 2.0](https://stability.ai/news-updates/stable-audio-2-0)

### Qwen1.5-32B

Qwen1.5-32B and Qwen1.5-32B-Chat are mid-size additions to the Qwen1.5 series, aimed at balancing performance, efficiency, and memory footprint at about 30 billion parameters.

- Date: 2024-04-02
- Lab: Alibaba Qwen
- Type: LLM
- Weights: Open weights
- Modalities: text → text
- Context window: 32,000 tokens
- Parameters: 32B
- License: Tongyi Qianwen License Agreement
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/04#qwen1-5-32b

Highlights:

- Released as base and chat models
- Uses the same 32K context as other Qwen1.5 models
- Weights under the Tongyi Qianwen License Agreement

Source: [Qwen1.5-32B: Fitting the Capstone of the Qwen1.5 Language Model Series](https://qwenlm.github.io/blog/qwen1.5-32b/)

## Cite and reuse this data

These release records are free to reuse under CC BY 4.0, including commercially. Credit The AI Engineering and link to this page's URL. Dates are the labs' official announcement dates, and every record links to its source. List fields in the CSV are separated by " | ".

The AI Engineering Editors. "AI models released in April 2024." The AI Engineering, updated Apr 30, 2024. https://theaiengineering.com/releases/2024/04

HTML link:

```html
<a href="https://theaiengineering.com/releases/2024/04">AI models released in April 2024</a> (The AI Engineering)
```

- Title: AI models released in April 2024
- Author: The AI Engineering Editors
- Publisher: The AI Engineering
- Updated: 2024-04-30
- URL: https://theaiengineering.com/releases/2024/04
- Markdown: https://theaiengineering.com/releases/2024/04.md
- License: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/)
- Full dataset as CSV: https://theaiengineering.com/releases.csv
- Full dataset as JSON: https://theaiengineering.com/releases.json
