Private LLM for Android

I get that they are trying to be inclusive for older models and having LLMs that don’t require more than 6gb of ram. But I was really hoping to take advantage of my Android 16 pro’s 8gb. It could easily handle llama 3.2 11b parameter model. Addd it addd it.

This app is great to test the models locally on your computer. Like to have a Private Ai that doesn’t leak data to the internet out there. However I do wish to tweak the models and modify them somehow.

I can’t find the uncensored models. I want to use them for fiction writing purposes.

Great app, LLMs run really fast on Android 16 Pro! I would love some work on the UI, and possibly a download all models button. It would also be fantastic if some larger models were added even though they would be slow. 5 Stars!

This app is great, I love that I can interact with LLMs locally and privately, and I'm quite honestly blown away that the devs of Private LLM have been able to make this work! My only suggestion is adding a bit more advanced customization options, like additional sampling parameters (Top K, Min P, Top A, Frequency Penalty, Repetition Penalty, Presence Penalty, Max Tokens, etc), and an option to add manually downloaded LLMs. Additionally, it would be amazing if there were some kind of memory system, similar to the "memory" feature on the ChatGPT app, to enable our LLMs to remember details across multiple conversations. All in all, this app is great for what it is. I'm thoroughly impressed!