Hi everyone, was just going over the ZimaCube page on ZimaBoard’s website: https://www.zimaboard.com/zimacube/

They mention a “private GPT” for one’s files: I’m interested in how they implemented it, if the process is open source, and if self-hosting something like this is possible.

Thanks!

Terrasque
link
fedilink
English
71Y

Probably running a local model, like for example Mistral. Sounds like small local model + RAG

100% it’s just an half assed hack around an open source library

For Kickstarter it doesn’t need to actually work, it just needs to have the option in the menu

ffhein
link
fedilink
English
51Y

There are tons of options for running LLMs locally nowadays, though none come close to GPT4 or Claude 2 etc. One place to start is /c/localllama@sh.itjust.works

@MigratingtoLemmy@lemmy.world
creator
link
fedilink
English
11Y

Thank you, subscribed!

@RegalPotoo@lemmy.world
link
fedilink
English
61Y

“GPT” describes a machine learning technique - tools like ChatGPT use this technique along with massive training sets to produce their results, but there isn’t anything stopping you doing it on a small scale so you can slap “GPT” or “AI” on your product and jump on the band wagon without actually adding anything of value

Create a post

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don’t control.

Rules:

  1. Be civil: we’re here to support and learn from one another. Insults won’t be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it’s not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don’t duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

  • 1 user online
  • 191 users / day
  • 419 users / week
  • 1.14K users / month
  • 3.85K users / 6 months
  • 1 subscriber
  • 3.71K Posts
  • 74.6K Comments
  • Modlog