You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@beehaw.org
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
You can already run a llm natively on Android devices.
You can on iOS as well!
https://apps.apple.com/us/app/private-llm/id6448106860
Which one do you use? I tried MLCChat, but all 3 times it either showed a java error or generated giberrish, what’s worked for you?
The hard part isn’t running ai on a device… it’s doing so while retaining battery life, performance, and privacy.
Privacy is also easy with a local LLM. Performance and battery not so much.