This project is no longer maintained. I created this project during my University times, but now I do not have the time nor willing to continue this by myself. The repo will be put on read-only mode, ...

So far, running LLMs has required a large amount of computing resources, mainly GPUs. Running locally, a simple prompt with a typical LLM takes on an average Mac ...