New
WEBINAR | AI Prototype to Production: Operationalizing and Orchestrating AI
September 28, 2023

Run Mistral 7B Instruct with an API

Table of Contents:

Run Mistral 7B with an API

Mistral 7B is a 7.3B parameter model from Mistral AI that outperformed Llama 2 13B on all Benchmarks and Llama 34B on many benchmarks and approaches CodeLlama 7B performance on code.

Contents

  • Mistral 7B Instruct
  • Running Mistral 7B Instruct with Python
  • Mistral 7B Instruct Model Demo
  • Mistral 7B vs Llama 2

Mistral 7B Instruct: Fine-Tuning for Chat

Mistral 7B is finetuned on publicly available instruction datasets resulting in Mistral 7B Instruct Model. It achieves remarkable performance, outperforming all other 7B models on MT-Bench and is comparable to 13B chat models.

Running Mistral 7B Instruct with Python

You can run Mistral 7B Instruct with our Python SDK with just a few lines of code.

To get started, Signup to Clarifai here and get your Personal Access Token(PAT) under security section in settings. 

Check out the Code Below:

You can also run the Mistral 7B Instruct model with the Clarifai Python API Client

Check out the Code Below:

You can also run Mistral 7B Instruct Model using the other Clarifai Client Libraries like Javascript, Java, cURL, NodeJS, PHP, etc here

Model Demo in the Clarifai Platform:

Try out the Mistral 7B Instruct model here: clarifai.com/mistralai/completion/models/mistral-7B-Instruct

Screenshot 2023-09-29 at 8.19.49 AM

Mistral 7B vs Llama 2

Mistral 7B was evaluated with the performance of various Llama models across a wide range of benchmarks.

  1. Mistral 7B Dominance: Mistral 7B stands out by significantly outperforming Llama 2 13B across all metrics.

  2. Comparable to Llama 34B: Since there is no Llama 2 34B version available Mistral 7B's performance is compared with Llama 34B and it's on par.

  3. Code and Reasoning: Mistral 7B also excels in code-related and reasoning benchmarks and it's approaches CodeLlama 7B performance on code.

Keep up to speed with AI

  • Follow us on Twitter X to get the latest from the LLMs

  • Join us in our Discord to talk LLMs