---
title: "AI models released in May 2024"
type: "release-archive"
canonical_url: "https://theaiengineering.com/releases/2024/05"
markdown_url: "https://theaiengineering.com/releases/2024/05.md"
author: "The AI Engineering Editors"
publisher: "The AI Engineering"
updated: "2024-05-31"
citation: "The AI Engineering Editors. \"AI models released in May 2024.\" The AI Engineering, updated May 31, 2024. https://theaiengineering.com/releases/2024/05"
license: "CC BY 4.0"
license_url: "https://creativecommons.org/licenses/by/4.0/"
data_csv: "https://theaiengineering.com/releases.csv"
data_json: "https://theaiengineering.com/releases.json"
---

# AI models released in May 2024

21 releases from 15 labs, 12 with open weights. Dates are the labs' official announcement dates.

## May 2024

### Text to Sound Effects

ElevenLabs' first sound model, generating sound effects, short instrumental tracks, soundscapes and character voices from text prompts, available to all users.

- Date: 2024-05-31
- Lab: ElevenLabs
- Type: Music
- Weights: Proprietary
- Modalities: text → audio
- Available at launch: Consumer app, API
- Permalink: https://theaiengineering.com/releases/2024/05#elevenlabs-sound-effects

Highlights:

- Generates effects, short instrumentals and soundscapes
- Aimed at film, TV, games and social creators
- Succeeded by SFX v2 and SFX v3

Source: [Sound Effects are here](https://elevenlabs.io/blog/sound-effects-are-here)

### Codestral (22B)

Mistral AI's first code model, a 22B open-weight model trained on more than 80 programming languages with fill-in-the-middle completion through a shared instruct and completion endpoint.

- Date: 2024-05-29
- Lab: Mistral AI
- Type: Coding
- Weights: Open weights
- Modalities: text → text
- Context window: 32,000 tokens
- Parameters: 22B
- License: Mistral AI Non-Production License
- Available at launch: Open weights, API
- Permalink: https://theaiengineering.com/releases/2024/05#codestral

Highlights:

- Trained on 80+ programming languages
- Released under the new Mistral AI Non-Production License
- API model ID codestral-2405

Source: [Codestral | Mistral AI](https://mistral.ai/news/codestral)

### Aya 23

Multilingual open-weights research models from Cohere For AI that trade Aya 101's breadth for depth, covering 23 languages in 8B and 35B sizes.

- Date: 2024-05-23
- Lab: Cohere
- Type: LLM
- Weights: Open weights
- Modalities: text → text
- Parameters: 8B and 35B
- License: CC-BY-NC-4.0
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/05#aya-23

Highlights:

- Builds on the Aya open science initiative
- Released with a technical report
- Weights published under a non-commercial license

Source: [C4AI Launches Aya 23, 8B and 35B Parameter Open Weights Release](https://cohere.com/blog/aya23)

### Mistral 7B v0.3

Update of Mistral 7B that extends the vocabulary to 32,768 tokens, released as base and instruct checkpoints and served as open-mistral-7b.

- Date: 2024-05-22
- Lab: Mistral AI
- Type: LLM
- Weights: Open weights
- Modalities: text → text
- Context window: 32,000 tokens
- License: Apache-2.0
- Available at launch: Open weights, API
- Permalink: https://theaiengineering.com/releases/2024/05#mistral-7b-v0-3

Highlights:

- Vocabulary extended to 32,768 tokens
- 32K-token context window
- Released under Apache 2.0

Source: [Mistral 7B v0.3 | Mistral Docs](https://docs.mistral.ai/models/mistral-7b-0-3)

### Phi-3-small and Phi-3-medium

Phi-3-small (7B) and Phi-3-medium (14B) are larger instruction-tuned members of Microsoft's Phi-3 family, first announced with Phi-3-mini and made available on Azure and Hugging Face in May 2024.

- Date: 2024-05-21
- Lab: Microsoft
- Type: LLM
- Weights: Open weights
- Modalities: text → text
- Context window: 128,000 tokens
- Parameters: 7B, 14B
- License: MIT
- Available at launch: Open weights, API, Cloud platforms
- Permalink: https://theaiengineering.com/releases/2024/05#phi-3-small-and-medium

Highlights:

- Phi-3-small offers 8K and 128K context variants
- Phi-3-medium offers 4K and 128K context variants
- First announced as coming soon on April 23, 2024

Source: [New models added to the Phi-3 family, available on Microsoft Azure](https://azure.microsoft.com/en-us/blog/new-models-added-to-the-phi-3-family-available-on-microsoft-azure/)

### Phi-3-vision

Phi-3-vision is the first multimodal model in Microsoft's Phi-3 family, a 4.2B model that combines language and vision to reason over images, extract text and interpret charts and diagrams.

- Date: 2024-05-21
- Lab: Microsoft
- Type: Multimodal
- Weights: Open weights
- Modalities: text, image → text
- Context window: 128,000 tokens
- Parameters: 4.2B
- License: MIT
- Available at launch: Open weights, API, Cloud platforms
- Permalink: https://theaiengineering.com/releases/2024/05#phi-3-vision

Highlights:

- 4.2B parameters with a 128K token context length
- Weights released May 21, 2024
- Optimized variants via ONNX Runtime, DirectML and NVIDIA NIM

Source: [New models added to the Phi-3 family, available on Microsoft Azure](https://azure.microsoft.com/en-us/blog/new-models-added-to-the-phi-3-family-available-on-microsoft-azure/)

### CogVLM2

CogVLM2 is Z.ai's next-generation open vision-language model, based on Llama 3 8B, with English and Chinese chat models. It supports image resolutions up to 1344 by 1344.

- Date: 2024-05-20
- Lab: Z.ai
- Type: Multimodal
- Weights: Open weights
- Modalities: text, image → text
- Context window: 8,000 tokens
- Parameters: 19B
- License: CogVLM License
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/05#cogvlm2

Highlights:

- 8K content length
- A video understanding version, CogVLM2-Video, followed on July 8, 2024
- Weights under the CogVLM License

Source: [CogVLM2 & CogVLM2-Video (GitHub)](https://github.com/zai-org/CogVLM2)

### DeepSeek-V2-Lite

DeepSeek-V2-Lite is a smaller mixture-of-experts model in the DeepSeek-V2 family, released as a base model and an SFT chat model. It uses the same economical training and efficient inference architecture as DeepSeek-V2.

- Date: 2024-05-16
- Lab: DeepSeek
- Type: Small model
- Weights: Open weights
- Modalities: text → text
- Context window: 32,000 tokens
- Parameters: MoE: 16B total, 2.4B active
- License: DeepSeek Model License
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/05#deepseek-v2-lite

Highlights:

- 16B total parameters with 2.4B activated
- 32K context length
- Released as DeepSeek-V2-Lite and DeepSeek-V2-Lite-Chat

Source: [DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model (GitHub)](https://github.com/deepseek-ai/DeepSeek-V2)

### Doubao (Doubao-pro and Doubao-lite)

ByteDance launched the Doubao model family on Volcano Engine's Ark platform, with Doubao-pro and Doubao-lite language models in 4K, 32K, and 128K context versions plus a Doubao text embedding model.

- Date: 2024-05-15
- Lab: ByteDance Seed
- Type: LLM
- Weights: Proprietary
- Modalities: text → text
- Context window: 128,000 tokens
- Available at launch: API
- Permalink: https://theaiengineering.com/releases/2024/05#doubao-pro-and-lite

Highlights:

- Doubao-pro offered in 4K, 32K, and 128K context versions
- Doubao-lite offered in 4K, 32K, and 128K context versions
- Function-calling and role-play variants of Doubao-pro-4k released the same day
- Doubao-embedding supports Chinese and English with 4K context

Source: [模型发布公告 2024 - 火山方舟 - 火山引擎](https://docs.volcengine.com/docs/ark/model-release-announcement-2024)

### Gemini 1.5 Flash

Gemini 1.5 Flash is a lighter-weight member of the Gemini 1.5 family, designed to be fast and efficient to serve at scale while keeping the breakthrough 1 million token long context window.

- Date: 2024-05-14
- Lab: Google
- Type: LLM
- Weights: Proprietary
- Modalities: text, image, audio, video → text
- Context window: 1,000,000 tokens
- Available at launch: API, Cloud platforms, Consumer app
- Permalink: https://theaiengineering.com/releases/2024/05#gemini-1-5-flash

Highlights:

- Introduced at Google I/O 2024 in public preview in Google AI Studio and Vertex AI
- Optimized for high-volume, high-frequency tasks; the fastest Gemini model served in the API at launch
- Stable gemini-1.5-flash-001 listed as generally available in the Gemini API changelog on May 23, 2024

Source: [Google Gemini updates: Flash 1.5, Gemma 2 and Project Astra](https://blog.google/innovation-and-ai/products/google-gemini-update-flash-ai-assistant-io-2024/)

### Gemini 1.5 Pro (2M context update)

At Google I/O 2024, Google released an improved Gemini 1.5 Pro with better code generation, logical reasoning, planning and multi-turn conversation, and extended its context window to 2 million tokens.

- Date: 2024-05-14
- Lab: Google
- Type: LLM
- Weights: Proprietary
- Modalities: text, image, audio, video → text
- Context window: 2,000,000 tokens
- Available at launch: API, Cloud platforms, Consumer app
- Permalink: https://theaiengineering.com/releases/2024/05#gemini-1-5-pro-2m-context

Highlights:

- The 2 million token window was offered by waitlist to API developers and Google Cloud customers at announcement
- General availability of the 2M context window was recorded in the Gemini API changelog on June 27, 2024
- Also improved audio and image understanding

Source: [Google Gemini updates: Flash 1.5, Gemma 2 and Project Astra](https://blog.google/innovation-and-ai/products/google-gemini-update-flash-ai-assistant-io-2024/)

### Hunyuan-DiT

Hunyuan-DiT is an open text-to-image diffusion transformer with fine-grained understanding of English and Chinese prompts, using bilingual CLIP and multilingual T5 text encoders and supporting multi-turn, dialogue-driven image generation.

- Date: 2024-05-14
- Lab: Tencent
- Type: Image
- Weights: Open weights
- Modalities: text → image
- Parameters: 1.5B
- License: Tencent Hunyuan Community License Agreement
- Available at launch: Open weights, Consumer app
- Permalink: https://theaiengineering.com/releases/2024/05#hunyuan-dit

Highlights:

- 1.5B-parameter diffusion transformer
- Version 1.1 followed June 13, 2024 and version 1.2 on July 8, 2024
- Text-to-image also offered in the Tencent Hunyuan Bot web app

Source: [LICENSE.txt · Tencent-Hunyuan/HunyuanDiT at main](https://huggingface.co/Tencent-Hunyuan/HunyuanDiT/blob/main/LICENSE.txt)

### Imagen 3

Imagen 3 is Google DeepMind's text-to-image model announced at I/O 2024 as its highest-quality image model at the time. It started in private preview in ImageFX and later reached Vertex AI and the Gemini API.

- Date: 2024-05-14
- Lab: Google
- Type: Image
- Weights: Proprietary
- Modalities: text → image
- Available at launch: Consumer app, API, Cloud platforms
- Permalink: https://theaiengineering.com/releases/2024/05#imagen-3

Highlights:

- Generally available on Vertex AI for approved users from July 31, 2024 and for all users from December 10, 2024
- Reached the Gemini API as imagen-3.0-generate-002 on February 6, 2025
- Initially offered in private preview to select creators in ImageFX

Source: [New generative media models and tools, built with and for creators](https://blog.google/technology/ai/google-generative-ai-veo-imagen-3/)

### PaliGemma

PaliGemma is Google's first open vision-language model in the Gemma family, combining the SigLIP vision encoder with a Gemma 2B language model. It targets captioning, visual question answering, OCR, object detection and segmentation.

- Date: 2024-05-14
- Lab: Google
- Type: Multimodal
- Weights: Open weights
- Modalities: text, image → text
- Parameters: 3B
- License: Gemma Terms of Use
- Available at launch: Open weights, Cloud platforms
- Permalink: https://theaiengineering.com/releases/2024/05#paligemma

Highlights:

- Inspired by PaLI-3; image encoder initialized from SigLIP-So400m
- Pretrained, fine-tuned and mixed-task checkpoints at multiple resolutions
- Available on GitHub, Hugging Face, Kaggle and Vertex AI Model Garden

Source: [Introducing PaliGemma, Gemma 2, and an Upgraded Responsible AI Toolkit](https://developers.googleblog.com/en/gemma-family-and-toolkit-expansion-io-2024/)

### GPT-4o

GPT-4o is OpenAI's omni model, trained end to end across text, vision, and audio and accepting any mix of text, audio, image, and video input. It launched in ChatGPT, including the free tier, and in the API as a text and vision model.

- Date: 2024-05-13
- Lab: OpenAI
- Type: Multimodal
- Weights: Proprietary
- Modalities: text, image, audio → text, audio
- Context window: 128,000 tokens
- Available at launch: API, Consumer app
- Permalink: https://theaiengineering.com/releases/2024/05#gpt-4o

Highlights:

- API model ID gpt-4o-2024-05-13 at launch
- API audio and video capabilities went first to a small group of trusted partners
- A new Voice Mode built on GPT-4o was planned as an alpha for ChatGPT Plus
- 128,000-token context window per the gpt-4o docs model page

Source: [Hello GPT-4o](https://openai.com/index/hello-gpt-4o/)

### Yi-1.5

Yi-1.5 is an upgraded version of 01.AI's Yi models, continuously pre-trained on a 500B-token high-quality corpus and fine-tuned on 3M samples to improve coding, math, reasoning, and instruction following.

- Date: 2024-05-13
- Lab: 01.AI
- Type: LLM
- Weights: Open weights
- Modalities: text → text
- Parameters: 6B, 9B, 34B
- License: Apache-2.0
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/05#yi-1-5

Highlights:

- Base and chat models in 34B, 9B, and 6B sizes
- Context variants of 4K, 16K, and 32K tokens
- Code and weights distributed under Apache 2.0

Source: [GitHub - 01-ai/Yi-1.5: Yi-1.5 is an upgraded version of Yi, delivering stronger performance in coding, math, reasoning, and instruction-following capability.](https://github.com/01-ai/Yi-1.5)

### Qwen-Max-0428

Qwen-Max-0428 is an instruction-tuned Qwen model for chat services, larger than the open Qwen1.5-110B. It reached the top 10 of the Chatbot Arena leaderboard shortly after release.

- Date: 2024-05-11
- Lab: Alibaba Qwen
- Type: LLM
- Weights: Proprietary
- Modalities: text → text
- Available at launch: API
- Permalink: https://theaiengineering.com/releases/2024/05#qwen-max-0428

Highlights:

- Available through the DashScope API
- DashScope API became compatible with the OpenAI API format
- Outperforms Qwen1.5-110B-Chat on MT-Bench, per Qwen

Source: [Notes on Qwen-Max-0428](https://qwenlm.github.io/blog/qwen-max-0428/)

### Amazon Titan Text Premier

Amazon Titan Text Premier is the most advanced model in the Titan Text family, optimized for retrieval-augmented generation and agent-based applications through integration with Knowledge Bases and Agents for Amazon Bedrock.

- Date: 2024-05-07
- Lab: Amazon
- Type: LLM
- Weights: Proprietary
- Modalities: text → text
- Context window: 32,000 tokens
- Available at launch: API
- Permalink: https://theaiengineering.com/releases/2024/05#amazon-titan-text-premier

Highlights:

- 32K token context window
- Best suited for English-language tasks
- Integrates with Knowledge Bases, Agents and Guardrails for Amazon Bedrock

Source: [Build RAG and agent-based generative AI applications with new Amazon Titan Text Premier model, available in Amazon Bedrock](https://aws.amazon.com/blogs/aws/build-rag-and-agent-based-generative-ai-applications-with-new-amazon-titan-text-premier-model-available-in-amazon-bedrock/)

### DeepSeek-V2

DeepSeek-V2 is a mixture-of-experts language model designed for economical training and efficient inference, pre-trained on 8.1T tokens. Compared with DeepSeek 67B, it saves 42.5% of training costs and reduces the KV cache by 93.3%.

- Date: 2024-05-06
- Lab: DeepSeek
- Type: LLM
- Weights: Open weights
- Modalities: text → text
- Context window: 128,000 tokens
- Parameters: MoE: 236B total, 21B active
- License: DeepSeek Model License
- Available at launch: API, Consumer app, Open weights
- Permalink: https://theaiengineering.com/releases/2024/05#deepseek-v2

Highlights:

- 236B total parameters with 21B activated per token
- 128K context length
- Released as a base model and an RL-tuned chat model

Source: [DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model (GitHub)](https://github.com/deepseek-ai/DeepSeek-V2)

### Granite Code (3B, 8B, 20B, 34B)

Family of open code models released as base and instruct versions in four sizes, trained on permissively licensed code and instruction data under Apache 2.0.

- Date: 2024-05-06
- Lab: IBM
- Type: Coding
- Weights: Open weights
- Modalities: text → text
- Parameters: 3B, 8B, 20B and 34B
- License: Apache-2.0
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/05#granite-code

Highlights:

- Context lengths range from 2K tokens for 3B to 8K tokens for 20B and 34B
- Instruct versions tuned for logical reasoning and problem solving
- Released under Apache 2.0

Source: [ibm-granite/granite-34b-code-instruct-8k · Hugging Face](https://huggingface.co/ibm-granite/granite-34b-code-instruct-8k)

### Jamba-Instruct

Instruction-tuned version of the Jamba open model launched in public preview on the AI21 platform for commercial use with a 256K-token context window.

- Date: 2024-05-02
- Lab: AI21 Labs
- Type: LLM
- Weights: Proprietary
- Modalities: text → text
- Context window: 256,000 tokens
- Available at launch: API
- Permalink: https://theaiengineering.com/releases/2024/05#jamba-instruct

Highlights:

- Built on the Jamba SSM-Transformer base model
- Later offered on Azure, Amazon Bedrock and Snowflake Cortex
- Public preview on the AI21 Platform at launch

Source: [Built for the Enterprise: Introducing AI21's Jamba-Instruct Model](https://www.ai21.com/blog/announcing-jamba-instruct/)

## Cite and reuse this data

These release records are free to reuse under CC BY 4.0, including commercially. Credit The AI Engineering and link to this page's URL. Dates are the labs' official announcement dates, and every record links to its source. List fields in the CSV are separated by " | ".

The AI Engineering Editors. "AI models released in May 2024." The AI Engineering, updated May 31, 2024. https://theaiengineering.com/releases/2024/05

HTML link:

```html
<a href="https://theaiengineering.com/releases/2024/05">AI models released in May 2024</a> (The AI Engineering)
```

- Title: AI models released in May 2024
- Author: The AI Engineering Editors
- Publisher: The AI Engineering
- Updated: 2024-05-31
- URL: https://theaiengineering.com/releases/2024/05
- Markdown: https://theaiengineering.com/releases/2024/05.md
- License: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/)
- Full dataset as CSV: https://theaiengineering.com/releases.csv
- Full dataset as JSON: https://theaiengineering.com/releases.json
