Skip to content

Radar ·

AI21 announces Jamba 1.5 Mini and Large

On August 22, 2024, AI21 Labs announced two MoE models combining Mamba and Joint Attention, with a 256K context window, ExpertInt8 quantization, JSON mode, tool use, and Transformers integration.

On August 22, 2024, AI21 Labs announced the Jamba 1.5 Mini and Jamba 1.5 Large MoE models. The publication says they combine Mamba and Joint Attention and offer a 256K context window. It also mentions ExpertInt8 quantization, JSON mode, tool use, and integration with Transformers.

These details are relevant to engineers evaluating LLM inference options, but do not replace their own performance and suitability tests. To verify the scope and specifics, consult AI21 Labs’ original announcement and compare its published specifications and integration instructions with the models’ technical documentation.

Original source: AI21 lança Jamba 1.5 Mini e Large

Curation · AgentLog

Get the essentials

Privacy, AI engineering and security in your inbox.

At most one digest per day, when there is news. Cancel at any time. We use your account's verified email.

Privacy

Looking for something else?DocumentationContact