A personal chatbot that can search through your notes and saved documents sounds like an obvious application of LLMs, but for some reason I can’t find such a project. Are there any in the works?
I did this with my wiki in order to read each article and come up with a category and keyword cloud. I first started by attempting to use many different tools to build my own LLM and then realized that I was reinventing the wheel and shifted to using OpenAI’s API. I was able to prompt it to read each article as input and output what I needed in a machine readable format. It worked like a charm.
You can easily build one yourself. Check llamaindex and langchain for prebacked solutions. Otherwise the math is pretty trivial if you are using normalized embeddings. You can quickly do one with numpy.
My suggestion anyway is to start with langchain, full of tutorials executable as jupyter notebook
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !programming@programming.dev
Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!
Cross posting is strongly encouraged in the instance. If you feel your post or another person’s post makes sense in another community cross post into it.
Hope you enjoy the instance!
Rules
Rules
Follow the programming.dev instance rules
Keep content related to programming in some way
If you’re posting long videos try to add in some form of tldr for those who don’t want to watch videos
https://github.com/imartinez/privateGPT
Awesome, thank you !
I did this with my wiki in order to read each article and come up with a category and keyword cloud. I first started by attempting to use many different tools to build my own LLM and then realized that I was reinventing the wheel and shifted to using OpenAI’s API. I was able to prompt it to read each article as input and output what I needed in a machine readable format. It worked like a charm.
You can easily build one yourself. Check llamaindex and langchain for prebacked solutions. Otherwise the math is pretty trivial if you are using normalized embeddings. You can quickly do one with numpy.
My suggestion anyway is to start with langchain, full of tutorials executable as jupyter notebook
If you’re in the Google ecosystem, Bard recently gained the (toggleable) ability to access you email/notes (can’t remember if it can access documents)