AI models released in February 2024
13 releases from 9 labs in February 2024, including Ideogram 1.0, Mistral Large and Mistral Small (24.02). Every entry is dated to the lab's official announcement and links to it.
- Releases
- 13
- Labs
- 9
- Open weights
- 6
February 2024
13 releasesIdeogram 1.0
Ideogram text-to-image model focused on text rendering, photorealism and prompt adherence, released to all users with Magic Prompt to help write detailed prompts.
- Modalities
- text → image
- At launch
- Consumer app
- Paid plans added private generation, image upload and Ideogram Editor
- Magic Prompt expands short prompts into detailed ones
Mistral Large
Mistral AI's flagship proprietary model at launch, fluent in five European languages with native function calling, offered on la Plateforme and Microsoft Azure.
- Modalities
- text → text
- Context
- 32K context
- At launch
- API, Cloud platforms
- 32K-token context window
- Native function calling and JSON output mode
- Azure was the first distribution partner
- API model ID mistral-large-2402
Mistral Small (24.02)
Latency- and cost-optimized proprietary model released alongside Mistral Large, positioned as an intermediary between Mistral's open-weight offering and its flagship, with RAG and function calling support.
- Modalities
- text → text
- Context
- 32K context
- At launch
- API
- Supports function calling and JSON mode
- API model ID mistral-small-2402
- The earlier mistral-small endpoint was renamed open-mixtral-8x7b
Stable Diffusion 3
Stable Diffusion 3 suite combining a diffusion transformer architecture with flow matching, ranging from 800M to 8B parameters, announced in early preview with improved multi-subject prompts and spelling.
- Modalities
- text → image
- Parameters
- 800M to 8B
- At launch
- API
- Announced with a waitlist for an early preview
- Stable Diffusion 3 and SD3 Turbo became available in the Stability API on April 17, 2024
- Multimodal Diffusion Transformer uses separate weights for image and language
Gemma
Gemma is Google's first family of lightweight open models, released in 2B and 7B sizes, each with pre-trained and instruction-tuned variants. Its terms of use permit responsible commercial usage and distribution by organizations of any size.
- Modalities
- text → text
- Context
- 8K context
- Parameters
- 2B, 7B
- License
- Gemma Terms of Use
- At launch
- Open weights, Cloud platforms
- Trained with an 8,192-token context length
- Weights on Kaggle and Hugging Face; deployable on Vertex AI and GKE
- Gemma 1.1 update released April 5, 2024
Gemini 1.5 Pro
Gemini 1.5 Pro was the first model in Google's second Gemini generation, a mid-size multimodal model that performed at a similar level to 1.0 Ultra and introduced an experimental context window of up to 1 million tokens.
- Modalities
- text, image, audio, video → text
- Context
- 1M context
- At launch
- API, Cloud platforms, Consumer app
- Launched with a standard 128,000-token window and up to 1 million tokens for a limited group in private preview
- Public preview in the Gemini API in 180+ countries began Apr 9, 2024, adding native audio understanding
- Stable gemini-1.5-pro-001 listed as generally available in the Gemini API changelog on May 23, 2024
Aya 101
Open-source massively multilingual research model from Cohere For AI covering 101 languages, released with the largest multilingual instruction fine-tuning dataset at the time.
- Modalities
- text → text
- Parameters
- 13B
- License
- Apache-2.0
- At launch
- Open weights
- Built with more than 3,000 researchers from 119 countries
- Released with a 513 million instance dataset covering 114 languages
- Expands coverage to more than 50 previously unserved languages
Reka Flash and Reka Edge
Two multimodal, multilingual models: Reka Flash, a 21B model trained from scratch for fast, high-quality workloads, and the compact 7B Reka Edge for on-device and local use, both in public beta.
- Modalities
- text, image, video → text
- Parameters
- Flash: 21B; Edge: 7B
- At launch
- Consumer app
- Pretrained on text from 32 languages
- Image and video understanding, including video captioning and video question answering
- Instruction tuned, then trained with RLHF (PPO) using Reka Flash as the reward model
- Public beta in the Reka Playground at launch
Stable Cascade
Research-preview text-to-image model built on the Würstchen architecture, using a three-stage design that decouples text-conditional generation from decoding to make fine-tuning more efficient.
- Modalities
- text → image
- Parameters
- Stage C: 1B or 3.6B
- License
- Stability AI Non-Commercial Research Community License
- At launch
- Open weights
- Stage C released in 1B and 3.6B parameter versions
- Non-commercial license
- Training and inference code on GitHub
Gemini 1.0 Ultra
Gemini 1.0 Ultra was the largest and most capable model in Google's first Gemini generation. It reached the public through Gemini Advanced on the day Bard was renamed Gemini.
- Modalities
- text, image → text
- At launch
- API, Cloud platforms, Consumer app
- Announced Dec 6, 2023 as the largest of the three Gemini 1.0 sizes (Ultra, Pro and Nano)
- Launched in Gemini Advanced on Feb 8, 2024, alongside a new Gemini mobile app
- Developers and Cloud customers could begin building with 1.0 Ultra through the Gemini API and Vertex AI from Feb 15, 2024
DeepSeekMath 7B
DeepSeekMath 7B is a math-specialized model initialized from DeepSeek-Coder-v1.5 7B and further pre-trained on 500B tokens of math-related, natural language, and code data. Its RL variant was trained with DeepSeek's Group Relative Policy Optimization (GRPO).
- Modalities
- text → text
- Parameters
- 7B
- License
- DeepSeek Model License
- At launch
- Open weights
- Released as Base, Instruct, and RL models
- Introduced the GRPO reinforcement learning algorithm
- Supports commercial use under the DeepSeek Model License
Qwen1.5
Qwen1.5 is the next iteration of the Qwen series, open-sourcing base and chat models across multiple sizes with quantized versions. It improved the developer experience with Hugging Face Transformers integration.
- Modalities
- text → text
- Context
- 32K context
- Parameters
- 0.5B, 1.8B, 4B, 7B, 14B, 72B
- License
- Tongyi Qianwen License Agreement
- At launch
- Open weights
- All models support a context length of up to 32,768 tokens
- Released just before the Chinese New Year with GPTQ, AWQ, and GGUF quantized models; code merged into Hugging Face Transformers
- Weights under the Tongyi Qianwen License Agreement
OLMo
Ai2's first truly open language model, released with its full pretraining data, training code, model weights and evaluation tools so researchers can study how it was built.
- Modalities
- text → text
- Context
- 2K context
- Parameters
- 1B and 7B
- License
- Apache-2.0
- At launch
- Open weights
- Pretrained on the open Dolma corpus of about three trillion tokens
- Built with partners including the Kempner Institute, AMD and the LUMI supercomputer
- Available on Hugging Face and GitHub
Cite and reuse this data
These release records are free to reuse under CC BY 4.0, including commercially. Credit The AI Engineering and link to this page's URL.
Dates are the labs' official announcement dates, and every record links to its source. List fields in the CSV are separated by " | ".
Citation
The AI Engineering Editors. "AI models released in February 2024." The AI Engineering, updated Feb 28, 2024. https://theaiengineering.com/releases/2024/02
HTML link
<a href="https://theaiengineering.com/releases/2024/02">AI models released in February 2024</a> (The AI Engineering)- Full dataset
- 1,167 releases from 55 labs
- Coverage
- to
- Updated
- License
- CC BY 4.0
- Publisher
- The AI Engineering