If you want to specifically use Gemma 3n int4 there’s Edge Gallery, an official Google app. I think it can also run some other stuff maybe if you convert it into their weird format. Also not the greatest UX honestly. Slow, crashes, doesn’t save settings, etc.
I have local AI on my Android
i do too! its a really underpowered model so he’s a little dumb but I love him so much
edit: nvm he’s a little sleepy right now 💤
would you mind sharing yours if it doesn’t get angry sometimes and rage quit
that looks a lot easier than manually running it using termux, what’s the app called?
PocketPal
If you want to specifically use Gemma 3n int4 there’s Edge Gallery, an official Google app. I think it can also run some other stuff maybe if you convert it into their weird format. Also not the greatest UX honestly. Slow, crashes, doesn’t save settings, etc.