Evalry
All models

Mistral: Devstral Small 1.1

by Mistral

Devstral Small 1.1 is a 24B parameter open-weight language model for software engineering agents, developed by Mistral AI in collaboration with All Hands AI. Finetuned from Mistral Small 3.1 and released under the Apache 2.0 license, it features a 128k token context window and supports both Mistral-style function calling and XML output formats. Designed for agentic coding workflows, Devstral Small 1.1 is optimized for tasks such as codebase exploration, multi-file edits, and integration into autonomous development agents like OpenHands and Cline. It achieves 53.6% on SWE-Bench Verified, surpassing all other open models on this benchmark, while remaining lightweight enough to run on a single 4090 GPU or Apple silicon machine. The model uses a Tekken tokenizer with a 131k vocabulary and is deployable via vLLM, Transformers, Ollama, LM Studio, and other OpenAI-compatible runtimes.

Avg Score

0.0%

0 answers

Avg Latency

0ms

0 runs

Pricing

$0.07

input

/

$0.28

output

per 1M tokens

Context

128K

tokens

Alternatives

Models with similar or better quality but different tradeoffs

No alternatives found

Run benchmarks on this model to discover alternatives

Other Models from Mistral

Compare performance with other models from the same creator

ModelScoreLatencyCost/1M
Mistral: Mistral Large 3 251280.2%5.1s$1.00
Mistral: Ministral 3 8B 251270.2%2.2s$0.15
Mistral: Ministral 3 14B 251269.9%3.0s$0.20
Mistral: Ministral 3 3B 251258.6%2.8s$0.10
Mistral: Mistral Small Creative——$0.20
Mistral: Devstral 2 2512——$0.0000
Mistral: Devstral 2 2512——$0.14
Mistral: Voxtral Small 24B 2507——$0.20
Mistral: Mistral Medium 3.1——$1.20
Mistral: Codestral 2508——$0.60
Mistral: Devstral Medium——$1.20
Mistral: Mistral Small 3.2 24B——$0.12
Mistral: Devstral Small 2505——$0.09
Mistral: Mistral Medium 3——$1.20
Mistral: Mistral Small 3.1 24B——$0.0000
Mistral: Mistral Small 3.1 24B——$0.07
Mistral: Saba——$0.40
Mistral: Mistral Small 3——$0.07
Mistral Large 2411——$4.00
Mistral Large 2407——$4.00
Mistral: Pixtral Large 2411——$4.00
Mistral: Ministral 8B——$0.10
Mistral: Ministral 3B——$0.04
Mistral: Pixtral 12B——$0.10
Mistral: Mistral Nemo——$0.03
Mistral: Mistral 7B Instruct——$0.0000
Mistral: Mistral 7B Instruct——$0.04
Mistral: Mistral 7B Instruct v0.3——$0.20
Mistral: Mixtral 8x22B Instruct——$4.00
Mistral Large——$4.00
Mistral Tiny——$0.25
Mistral: Mistral 7B Instruct v0.2——$0.20
Mistral: Mixtral 8x7B Instruct——$0.54
Mistral: Mistral 7B Instruct v0.1——$0.15

Benchmark Performance

How this model performs across different benchmarks

No benchmark data available

Run benchmarks with this model to see performance breakdown

Price vs Performance

Compare cost efficiency across all models

Current model
Other models
X-axis uses log scale for better visualization of price range

Score Over Time

Performance trends across all benchmark runs

No score trend data

Score history will appear here after multiple runs

Benchmark Activity

Number of benchmark runs over time

No activity data

Activity will appear here after benchmark runs

Quickstart

Get started with this model using OpenRouter

View on OpenRouter
import { OpenRouter } from "@openrouter/sdk";

const openrouter = new OpenRouter({
  apiKey: "<OPENROUTER_API_KEY>"
});

const completion = await openrouter.chat.completions.create({
  model: "mistralai/devstral-small",
  messages: [
    {
      role: "user",
      content: "Hello!"
    }
  ]
});

console.log(completion.choices[0].message.content);

Get your API key at openrouter.ai/keys