by jexp on 11/19/23, 6:57 PM with 1 comments
by jexp on 11/19/23, 6:57 PM
Quick 5 minute video on downloading and running Hugging Face language models in GGUF format (quantized by TheBloke) with Ollama on your local machine and checking GPU consumption with asitop (Apple Silicon Mac Top).