Llama 3: Dense Evolution or Expert Revolution? : r/LocalLLaMA
网页2023年9月16日 · The improvement llama 2 brought over llama 1 wasn't crazy, and if they want to match or exceed GPT3.5/4 performance, they'll have to make architecture changes so it can still run on consumer hardware.
Thinking about what people ask for in llama 3 : r/LocalLLaMA
网页So I was looking at some of the things people ask for in llama 3, kinda judging them over whether they made sense or were feasible. Mixture of Experts - Why? This literally is useless to us. MoE helps with Flops issues, it takes up more vram than a dense model. OpenAI makes it work, it isn't naturally superior or better by default.
What is the latest news for Llama 3? : r/LocalLLaMA - Reddit
网页When Llama2 dropped, at it was a huge improvement on both Llama and all the other stuff that happened in the meantime. If/when Llama3 comes around, it will be exactly as good as Meta want it to be. If they want to take the lead again, all it costs is money.
Zuckerberg says they are training LLaMa 3 on 600,000 H100s
网页2024年1月18日 · No he didn’t actually say what Llama 3 is being trained with. He said that by the end of 2024 they will have 600,000 H100 equivalent in compute but Llama 3 is being trained now and they will be buying 350,000 H100 by the end of 2024. So that means that right now they don’t have 600,000 H100 equivalent compute capability to train Llama 3 with.
Llama 3 is out of competition. : r/LocalLLaMA - Reddit
网页2024年5月4日 · Llama-3 is sort of a game-changer in the AI space, in my anecdotal opinion. It's extremely coherent (even obnoxiously so at times). It's legitimately the first AI model I've interacted with that actually feels like a person at times.
4bit pre-quantized Llama-3 8B bitsandbytes uploaded!
网页Hey everyone! Just uploaded 4bit pre quantized bitsandbytes (can do GGUF if people want) versions of Llama-3's 8b instruct and base versions on Unsloth's HF page!
Meta Platforms to Launch Small Versions of Llama 3 Next Week
网页2024年4月8日 · The release of the smaller Llama 3 models is likely intended to generate excitement and anticipation for the launch of the full Llama 3 model. Llama 3 is the successor to Llama 2, which was launched by Meta last July. The release of Llama 3 comes as several other companies, including Google, Elon Musk's xAI, and Mistral, have also …
Hermes 2 Theta Llama-3 8B | Llama 3 + Hermes 2 Pro merge | by …
网页The original Llama 3 is an amazing general instruct model, but despite this, I will still be using Kunoichi DPO v2 for storytelling. 🥰 These earlier Llama 3 merges, when they are good at following cards, are producing direct events and facts.
New Roleplaying(RP/ERP) model, Llama-3-Soliloquy-8B-v2
网页Hi. was the gguf for this created after the llamacpp update? "Added fixes for Llama 3 tokenization: Support updated Llama 3 GGUFs with pre-tokenizations. Note: In order to benefit from the tokenizer fix, the GGUF models need to be reconverted after this commit. A warning will be displayed if the model was created before this fix."
multimodal Llama-3 supporting 1152x1152 beats LLaVA-v1.6
网页We provide Bunny-v1.1-Llama-3-8B-V, which is built upon SigLIP and Llama-3-8B-Instruct with S^2-Wrapper, supporting 1152x1152 resolution. It surpasses a variety of models such as LLaVA-v1.6, Idefics2, MM1 and Mini-Gemini-HD.