LocalLLaMA

2203 readers

5 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago

MODERATORS

SkySyrup@sh.itjust.works

pax@sh.itjust.works

noneabove1182@sh.itjust.works

New Wizard coder model posted and quantized by TheBloke! (twitter.com)

submitted 1 year ago by noneabove1182@sh.itjust.works to c/localllama@sh.itjust.works

3 comments fedilink hide all child comments

Promising stuff from their repo, claiming "exceptional performance, achieving a [HumanEval] pass@1 score of 57.3, surpassing the open-source SOTA by approximately 20 points."

https://github.com/nlpxucan/WizardLM

you are viewing a single comment's thread
view the rest of the comments

[–] Mixel@feddit.de 0 points 1 year ago (1 children)

So if I understand correctly it is fine tuned for coding or what exactly is this Wizard model doing?

[–] notfromhere@lemmy.one 0 points 1 year ago (1 children)

It is StarCoder and fine tuned on a new Wizard Instruct dataset optimized for coding models. So it follows the instruct formatting of prompts on top of the StarCoder base model.

[–] Mixel@feddit.de 0 points 1 year ago

That sounds great honestly! Does that work with the newest ggml yet?