Skip to main content
Version: 0.0.0

Model deprecations

tip

Deprecated models remain accessible on the Anyscale Platform. For assistance, contact endpoints-help@anyscale.com.

  • Support discontinued for SafetyLlama, Zephyr-7B, and Mistral-7B-OpenOrca as of February 22, 2024: Transition to Mistral-7B recommended. Traffic to Zephyr-7B and Mistral-7B-OpenOrca redirects automatically to Mistral 7B.

  • Latency degradation in Llama 13B from February 22, 2024: Transition to Mistral 7B, Mixtral 70B, or Llama 70B advised for enhanced performance.

  • Traffic rerouted from Code Llama 34B to Code Llama 70B as of February 15, 2024: Code Llama 34B traffic has migrated to Code Llama 70B, ensuring improved quality with no additional cost. Transition to Code Llama 70B recommended.