LocalLLaMA

2151 readers

1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago

MODERATORS

SkySyrup@sh.itjust.works

pax@sh.itjust.works

noneabove1182@sh.itjust.works

InternLM2 models llama-fied (sh.itjust.works)

submitted 7 months ago by noneabove1182@sh.itjust.works to c/localllama@sh.itjust.works

0 comments fedilink hide all child comments

Thanks to Charles for the conversion scripts, I've converted several of the new internLM2 models into Llama format. I've also made them into ExLlamaV2 while I was at it.

You can find them here:

https://huggingface.co/bartowski?search_models=internlm2

Note, the chat models seem to do something odd without outputting [UNUSED_TOKEN_145] in a way that seems equivalent to <|im_end|>, not sure why, but it works fine despite outputting that at the end.

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here