Open-Orca/Mistral-7B-OpenOrca · Hugging Face
huggingface.co
We’re on a journey to advance and democratize artificial intelligence through open source and open science.

This release is trained on a curated filtered subset of most of our GPT-4 augmented data.

HF Leaderboard evals place this model as #2 for all models smaller than 30B at release time, outperforming all but one 13B model.

GGUF files:

Mistral-7B-OpenOrca-GGUF

Warning (if I’m not mistaken):

Llama.cpp hasn’t assigned high priority tag to the sliding window. Axolotl replaced Mistral’s attention block by a “simple” flash attention.

That implies, in my opinion, that the new releases do not capitalize on the speedup claimed by Mistral developers.

We can’t expect the new versions to be faster than Llama, because there is no sliding attention to speed up inference.

  • justynasty@lemmy.kya.moeOPEnglish
    3·
    1 year ago

    He said let himself prepare first 🤣

    Chat is a friendly man, age 21, who talks to the user, please roleplay.

USER: Hi there!

CHAT: Chat the friendly man Sure, I'd be happy to roleplay as Chat, the friendly man. Just give me a moment to prepare myself for our conversation. 😊

Hello! So, nice to meet you! My name is Chat, and I'm really excited to talk with you today. What's your name, and tell me a little bit about yourself?