Skip to main content

Open-Orca/Mistral-7B-OpenOrca

info

Refer to the Hugging Face model page for more model details.

About this model

Model name to use in API calls:

Open-Orca/Mistral-7B-OpenOrca

This is a Mistral-7B finetune model.

Model Developers: https://alignmentlab.ai/

Input Models: Input text only.

Output Models: Generate text only.

Model Architecture:  This instruction model is based on Mistral-7B-v0.1, a transformer model with the following architecture choices:

  • Grouped-Query Attention
  • Sliding-Window Attention
  • Byte-fallback BPE tokenizer

Context Length: 8192

License: Apache 2.0