from Hacker News

HuggingChat: Chat with Llama 3.1 (70B and 405B)

by nsarrazin on 7/23/24, 3:49 PM with 1 comments

• by nsarrazin on 7/23/24, 3:49 PM

  We just released the latest version of the Llama 3.1 models on HuggingChat! We’re currently hosting the 405B at FP8 and the 70B at full precision. They’re compatible with our tools, so that means you can use them with web search, PDF parsing and image generation for example.

  Excited to see what the community thinks of them, let us know if they work well for your use cases. The 405B is pretty good at some advanced reasoning tasks, it's quite impressive actually!

  Try them out here:

  - 405B: https://huggingface.co/chat/models/meta-llama/Meta-Llama-3.1...

  - 70B: https://huggingface.co/chat/models/meta-llama/Meta-Llama-3.1...