Discuss all things related to AI
I learned about this from a local meetup and it’s pretty cool: https://lmstudio.ai/
If you want to quickly run a LLM on your local machine it’s pretty dumb/simple to get started. I am using a macbook pro m1 pro w/ 16GB of ram.
I use Ollama, looks similar
Oh nice. Will check it out. Are there any local models you have been a big fan of?
Mistral or codellama
Cool I’ll check them out. How powerful is your machine?
I’ve got 64GB M1, feels very smooth to run the models, it saves time