gpt runner
wyGpt
https://github.com/wangyi-fudan/wyGPT
wyGPT No model is perfect but some are useful.
Introduction
This is my 2.5 years’ day-and-night efforts on GPT. It is mature and highly optimized on single GPU.
GPT4All
https://github.com/nomic-ai/gpt4all
Open-source large language models that run locally on your CPU and nearly any GPU
GPT4All Website and Models
GPT4All Documentation
https://github.com/nomic-ai/gpt4all
How to Run Mistral-7B on an M1 Mac With Ollama
How to Run Mistral-7B on an M1 Mac With Ollama