I really want to use AI like llama, ChatGTP, midjourney etc. for something productive. But over the last year the only thing I found use for it was to propose places to go as a family on our Hokaido Japan journey. There were great proposals for places to go.
But perhaps you guys have some great use cases for AI in your life?
I use it quite a bit. I don’t trust big companies who commercialize AI so I run my AIs locally on my old retired gaming desktop that I’ve turned into a homelab/media server.
I use Kobold.AI to self host an LLM like ChatGPT (Dolphin-Mistral7b if you are curious). I mainly use it for low effort knowledge searches for stuff that is easier typed out long and descriptive (since google struggles with this). Since it’s AI I have to be careful about what I search since I’ve seen it make stuff up but for the majority of what I use it for (Programming syntax, Linux troubleshooting, general questions) it’s pretty good.
I also have Stable Diffusion running as well using the ICBINP model (which is pretty decent for photorealistic images). I use this AI to generate social media display pictures and porn :) it’s fun because it’s a surprise at what you’re going to get but sometimes it generates absolute horrors. Anatomical horrors. Those are genuinely horrific. Other times it’s really good.
How do you set up stable diffusion to run locally? I have been trying out llama.cpp for text and was looking for a similarly easy tool to try image generation.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@beehaw.org
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
I use it quite a bit. I don’t trust big companies who commercialize AI so I run my AIs locally on my old retired gaming desktop that I’ve turned into a homelab/media server.
I use Kobold.AI to self host an LLM like ChatGPT (Dolphin-Mistral7b if you are curious). I mainly use it for low effort knowledge searches for stuff that is easier typed out long and descriptive (since google struggles with this). Since it’s AI I have to be careful about what I search since I’ve seen it make stuff up but for the majority of what I use it for (Programming syntax, Linux troubleshooting, general questions) it’s pretty good.
I also have Stable Diffusion running as well using the ICBINP model (which is pretty decent for photorealistic images). I use this AI to generate social media display pictures and porn :) it’s fun because it’s a surprise at what you’re going to get but sometimes it generates absolute horrors. Anatomical horrors. Those are genuinely horrific. Other times it’s really good.
How do you set up stable diffusion to run locally? I have been trying out llama.cpp for text and was looking for a similarly easy tool to try image generation.
The linked A1111 is definitely by far the easiest to set up!
https://github.com/AUTOMATIC1111/stable-diffusion-webui
AUTOMATIC 1111 with webui