from Hacker News

Ask HN: An Offline ChatGPT Alternative?

by DBformore on 3/1/23, 8:13 PM with 2 comments

• by pizza on 3/3/23, 7:36 PM

  You can see here the most downloaded models from the Hugging Face transformers hub: https://huggingface.co/spaces/huggingface/transformers-stats

  If I'm not mistaken these will be some of the best sota language models to try:

  - Flan-T5

  - OPT

  - Distilbert

  - GPT-J

  Look into PEFT to fit finetuning on a consumer-grade device. You'll have to roll your own RLHF though.. :)

• by fl0ps on 3/1/23, 10:56 PM

  Been asked here before, but this was interesting:

  https://old.reddit.com/r/programming/comments/szqq5m/gptj_is...