---
title: "AI models released in January 2024"
type: "release-archive"
canonical_url: "https://theaiengineering.com/releases/2024/01"
markdown_url: "https://theaiengineering.com/releases/2024/01.md"
author: "The AI Engineering Editors"
publisher: "The AI Engineering"
updated: "2024-01-29"
citation: "The AI Engineering Editors. \"AI models released in January 2024.\" The AI Engineering, updated Jan 29, 2024. https://theaiengineering.com/releases/2024/01"
license: "CC BY 4.0"
license_url: "https://creativecommons.org/licenses/by/4.0/"
data_csv: "https://theaiengineering.com/releases.csv"
data_json: "https://theaiengineering.com/releases.json"
---

# AI models released in January 2024

10 releases from 9 labs, 7 with open weights. Dates are the labs' official announcement dates.

## January 2024

### Code Llama 70B

Code Llama 70B is the largest model in the Code Llama family, released in base, Python and Instruct versions and free for research and commercial use.

- Date: 2024-01-29
- Lab: Meta
- Type: Coding
- Weights: Open weights
- Modalities: text → text
- Parameters: 70B
- License: Llama 2 Community License
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/01#code-llama-70b

Highlights:

- Same three versions as the original release: Code Llama, Code Llama - Python and Code Llama - Instruct
- Free for research and commercial use

Source: [Introducing Code Llama, a state-of-the-art large language model for coding](https://ai.meta.com/blog/code-llama-large-language-model-coding/)

### SFR-Embedding-Mistral

Text embedding model from Salesforce AI Research built on E5-mistral-7b-instruct and Mistral-7B-v0.1, fine-tuned with multi-task training for retrieval, clustering and related tasks.

- Date: 2024-01-26
- Lab: Salesforce
- Type: Embedding
- Weights: Open weights
- Modalities: text → embedding
- License: CC-BY-NC-4.0
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/01#sfr-embedding-mistral

Highlights:

- Ranked first on the MTEB benchmark at release, averaging 67.6 across 56 datasets
- Raised retrieval performance from 56.9 for E5-mistral-7b-instruct to 59.0
- Released for research use under CC BY-NC 4.0

Source: [SFR-Embedding-Mistral: Enhance Text Retrieval with Transfer Learning](https://www.salesforce.com/blog/sfr-embedding/)

### text-embedding-3-small and text-embedding-3-large

OpenAI released two new embedding models, text-embedding-3-small and text-embedding-3-large, succeeding text-embedding-ada-002 and adding a dimensions parameter that shortens embeddings while keeping their concept-representing properties.

- Date: 2024-01-25
- Lab: OpenAI
- Type: Embedding
- Weights: Proprietary
- Modalities: text → embedding
- Available at launch: API
- Permalink: https://theaiengineering.com/releases/2024/01#text-embedding-3

Highlights:

- text-embedding-3-large creates embeddings with up to 3072 dimensions
- Developers can shorten embeddings natively via the dimensions API parameter
- Announced alongside gpt-4-0125-preview, the gpt-4-turbo-preview alias, and text-moderation-007

Source: [New embedding models and API updates](https://openai.com/index/new-embedding-models-and-api-updates/)

### Niji 6

Anime and illustration model from the Niji series developed with Spellbrush, following detailed prompts more closely, writing simple text placed in quotes and adding --style raw for less anime styling.

- Date: 2024-01-24
- Lab: Midjourney
- Type: Image
- Weights: Proprietary
- Modalities: text, image → image
- Available at launch: Consumer app
- Permalink: https://theaiengineering.com/releases/2024/01#niji-6

Highlights:

- Developed in collaboration with Spellbrush
- A June 7, 2024 update improved rendering of Japanese kana and simple Chinese characters
- Supports Character Reference

Source: [Welcome to Niji V6!](https://nijijourney.com/blog/niji-updates-welcome-to-niji-v6)

### Yi-VL

Yi-VL is 01.AI's open bilingual vision-language model family in 6B and 34B sizes, pairing a CLIP ViT-H/14 vision encoder with Yi language models for English and Chinese multimodal chat.

- Date: 2024-01-23
- Lab: 01.AI
- Type: Multimodal
- Weights: Open weights
- Modalities: text, image → text
- Parameters: 6B, 34B
- License: Apache-2.0
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/01#yi-vl

Highlights:

- Image understanding at 448 by 448 resolution
- Supports English and Chinese conversations, including text recognition in images
- Trained in three stages covering the ViT, projection module, and full model

Source: [GitHub - 01-ai/Yi: A series of large language models trained from scratch by developers @01-ai](https://github.com/01-ai/Yi)

### Stable LM 2 1.6B

First model of the Stable LM 2 series, a 1.6B-parameter small language model with base and instruction-tuned versions trained on about 2 trillion tokens in seven languages.

- Date: 2024-01-19
- Lab: Stability AI
- Type: Small model
- Weights: Open weights
- Modalities: text → text
- Parameters: 1.6B
- License: Stability AI Community License
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/01#stable-lm-2-1-6b

Highlights:

- Languages: English, Spanish, German, Italian, French, Portuguese and Dutch
- Commercial use through a Stability AI Membership
- Updated version with tool use released April 8, 2024

Source: [Introducing Stable LM 2 1.6B](https://stability.ai/news-updates/introducing-stable-lm-2)

### Qwen-VL-Max

Qwen-VL-Max is Qwen's most capable vision-language model at launch, an upgrade over Qwen-VL-Plus with better detailed and text recognition. It supports images up to millions of pixels at arbitrary aspect ratios.

- Date: 2024-01-18
- Lab: Alibaba Qwen
- Type: Multimodal
- Weights: Proprietary
- Modalities: text, image → text
- Available at launch: API, Consumer app
- Permalink: https://theaiengineering.com/releases/2024/01#qwen-vl-max

Highlights:

- Accessible through Hugging Face Spaces, the Qwen website, and DashScope APIs
- Upgraded alongside Qwen-VL-Plus
- Proprietary successor to the open Qwen-VL

Source: [Qwen-VL (GitHub)](https://github.com/QwenLM/Qwen-VL)

### Stable Code 3B

3B-parameter code completion model built on Stable LM 3B and trained on 18 programming languages, adding fill-in-the-middle support and training on sequences up to 16,384 tokens.

- Date: 2024-01-16
- Lab: Stability AI
- Type: Coding
- Weights: Open weights
- Modalities: text → text
- Context window: 16,384 tokens
- Parameters: 3B
- License: Stability AI Community License
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/01#stable-code-3b

Highlights:

- Fill-in-the-middle code completion
- Trained on 18 programming languages
- Included in the Stability AI Membership for commercial use

Source: [Stable Code 3B: Coding on the Edge](https://stability.ai/news-updates/stable-code-2024-llm-code-completion-release)

### Nous-Hermes-2-Mixtral-8x7B

Hermes 2 fine-tune of Mistral AI's Mixtral 8x7B mixture-of-experts model from Nous Research, released in supervised fine-tuned and DPO-trained versions on Hugging Face.

- Date: 2024-01-15
- Lab: Nous Research
- Type: LLM
- Weights: Open weights
- Modalities: text → text
- License: Apache-2.0
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/01#nous-hermes-2-mixtral

Highlights:

- SFT and DPO versions released together
- Quantized GGUF version published the same day
- Built on Mixtral 8x7B

Source: [Releases | Nous Research](https://nousresearch.com/releases)

### DeepSeekMoE 16B

DeepSeekMoE 16B is a mixture-of-experts language model that uses fine-grained expert segmentation and shared expert isolation. Trained on 2T English and Chinese tokens, it matches DeepSeek 7B with about 40% of the computation.

- Date: 2024-01-11
- Lab: DeepSeek
- Type: LLM
- Weights: Open weights
- Modalities: text → text
- Parameters: MoE: 16.4B total
- License: DeepSeek Model License
- Available at launch: Open weights
- Permalink: https://theaiengineering.com/releases/2024/01#deepseekmoe-16b

Highlights:

- 16.4B total parameters
- Deployable on a single 40GB GPU without quantization
- Released as Base and Chat models

Source: [DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models (GitHub)](https://github.com/deepseek-ai/DeepSeek-MoE)

## Cite and reuse this data

These release records are free to reuse under CC BY 4.0, including commercially. Credit The AI Engineering and link to this page's URL. Dates are the labs' official announcement dates, and every record links to its source. List fields in the CSV are separated by " | ".

The AI Engineering Editors. "AI models released in January 2024." The AI Engineering, updated Jan 29, 2024. https://theaiengineering.com/releases/2024/01

HTML link:

```html
<a href="https://theaiengineering.com/releases/2024/01">AI models released in January 2024</a> (The AI Engineering)
```

- Title: AI models released in January 2024
- Author: The AI Engineering Editors
- Publisher: The AI Engineering
- Updated: 2024-01-29
- URL: https://theaiengineering.com/releases/2024/01
- Markdown: https://theaiengineering.com/releases/2024/01.md
- License: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/)
- Full dataset as CSV: https://theaiengineering.com/releases.csv
- Full dataset as JSON: https://theaiengineering.com/releases.json
