Does anyone have recommendations for a way to capture, archive and visualize arbitrary data in one convenient location. I’m talking about arbitrary/misc. stuff like electricity usage, gas usage, body weight, spending, mileage, habit tracking etc… Essentially looking for a super solution that can be easily interfaced with, has convenient methods of browsing, filtering, and visualizing, and can (obviously, based on post location) be self hosted.
I currently use mint, beestat, Google Fit, Samsung Health and probably a few others as my trackers/monitors of my personal and home data, but I’ve always been curious about finding a solution where I have complete control over my personal data once it’s captured by the various sources, assuming I can get my hands on it via exporting manually or otherwise.
For background, My experience level is pretty minimal. I have unRAID running on an old desktop PC, hosting a file share and gitlab container. I can scrape python programs together easy enough, but databases and web tech will take some learning.
I’m interested in ways any of you intelligent folks may have figured out how to manage your personal data! Thanks in advance for sharing!
I use Home Assistant for similar purposes, with Influx DB and Grafana. There are many integrations to automatically populate data. For example, I have heart rate data from my Apple Watch flow in so I can view it in Grafana.
Brainstorming a bit, I think wiring up InfluxDB, Grafana plus some convenient way of inputting all those data sources sounds ideal. As a time series database, keeping track of how data evolves over time is InfluxDB’s whole thing, Grafana or similar would be for visualizing said data. I guess the complicated part would be getting your data sources to write to it in a convenient way, not sure if there’s a generic enough project out there already.
Looking around a bit, not too dissimilar to what this blog post has done.
Thanks for the suggestions. At a quick glance, grafana looks to be perfect for the visualization aspect (at least in terms of capabilities). Glad to see there are free utilities for that and I might not have to resort to chicken scratch html/pyplot :-) I have yet to dig into influxDB still…
Deterrent is right. That graph is terrifying! I feel their frustration regarding getting data from Android apps. Part of what got me started thinking about this was when I realized that the years of data I entered into my fitness pal was suddenly locked behind a subscription service :-( Thanks for sharing!
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !selfhosted@lemmy.world
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don’t control.
Rules:
Be civil: we’re here to support and learn from one another. Insults won’t be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it’s not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don’t duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.
Resources:
selfh.st Newsletter and index of selfhosted software and apps
I use Home Assistant for similar purposes, with Influx DB and Grafana. There are many integrations to automatically populate data. For example, I have heart rate data from my Apple Watch flow in so I can view it in Grafana.
Honestly, I think using more than Excel for this might be an overkill.
I’m not here on self-hosted for underkill 😉
Brainstorming a bit, I think wiring up InfluxDB, Grafana plus some convenient way of inputting all those data sources sounds ideal. As a time series database, keeping track of how data evolves over time is InfluxDB’s whole thing, Grafana or similar would be for visualizing said data. I guess the complicated part would be getting your data sources to write to it in a convenient way, not sure if there’s a generic enough project out there already.
Looking around a bit, not too dissimilar to what this blog post has done.
Thanks for the suggestions. At a quick glance, grafana looks to be perfect for the visualization aspect (at least in terms of capabilities). Glad to see there are free utilities for that and I might not have to resort to chicken scratch html/pyplot :-) I have yet to dig into influxDB still…
I’d look at karlicoss’s personal data infrastructure for inspiration (or perhaps deterrent).
Deterrent is right. That graph is terrifying! I feel their frustration regarding getting data from Android apps. Part of what got me started thinking about this was when I realized that the years of data I entered into my fitness pal was suddenly locked behind a subscription service :-( Thanks for sharing!
Wait My Fitness Pal went subscription model? Also, pay once, export once, cancel?