Greetings everyone! Daniel here, I’ve been working on Linkwarden part-time over the past few months.
Linkwarden is a self-hosted, open-source collaborative bookmark manager to collect, organize and archive webpages.
Key features:
📸 Preserve webpages as Screenshot, PDF, etc. So you can access them even if they are taken down.
👥 Collaborative, so you can share your collections with your friends and colleagues. You can also make them public and share them with the world.
📱 Designed for every screen size, from widescreen monitors down to smartphones.
⚡️ Open source and fully self-hostable!
✨ And so many more features! (Literally, just didn’t want to make this post too long. Check out theGithub repoandWebsitefor more info…)
If you like what we’re doing, you can support the project by either starring ⭐️ the repo to make it more visible to others or by subscribing to the Cloud plan (which helps the project, a lot).
Things like mobile app (PWA) are already on the project roadmap and I’m so excited to share them with you in the future.
Feedback is always welcome, so feel free to share your thoughts!
It is. There’s no way for search engines to join all the servers and index them all, thus there’s no way to efficiently find information on them without already being there.
Are you talking about crawlers not being able to index matrix messenges?
It’s not a website, there’s no chat that’s being indexed by crawlers, afaik.
You could index them if you wanted.
A chat is meant to be ephemeral. Unlike with a forum where it is a goal to have long lasting information sharing.
Usually you want to things for a project, one forum and one chat. The chat is more informal and not meant to replace a proper forum. You can basically chit chat in a chat but not in a forum.
There’s nothijg hidden on matrix.
You can verify yourself, go to the space of
Nextcloud, GNOME, KDE, OPENSUSE, FEDORA, flatpak, neo store, libretube, etc. Nothing is hidden.
it’s not literally hidden, but it’s not easily searchable because since it’s a chat, it’s not indexable on search engines. A forum is a better solution to avoid the same questions being asked 1000x and to expose great solutions and advices.
You can link them together at least that’s how the discord and matrix chats are for our instance are. I can chat from discord and get replies from people in matrix
Ah, I was not aware of a way to bridge two channels/servers entirely. I know there are bots that people use to bridge their user accounts though.
If it is fully seamless? Sure. But I don’t know why you are bothering then. But if it adds a “Bot” tag or any other hoops, you are still just making a worse experience for everyone. We ran into this back in the IRC days all the time.
Matrix is a terrible experience, honestly. It’s incredibly slow and their “servers” don’t really function as a community as much as a series of chat groups. I’m not fond of opening my chat app and then staring at it for 10-15 seconds while it loads all the new messages. And yes, I’ve tried different servers.
Discord is feature-rich. And now has the option to submit posts, which drastically increases usability and searchability. But it does have a big problem with privacy and ads.
Projects like this are much better suited for something like Gitlab.
Element is the thing that’s subpar (to be generous) compared to other chat apps. Element X is better for the features that have been implemented, but the current feature set is very incomplete.
I think Matrix suffers from some issues with large communities, for instance Graphene OS has already had to abandon 2-3 of their main group chats due to same bug and last time I checked (2-3 months ago) there has even been talks of switching to Discord. That is, just in case, a community of some of the most diehard privacy nerds btw
Thank you for including oAuth options for sign on. Makes a big difference being able to use the same account for all the things like freshRSS, seafile, immich etc.
The general principle is called single sign on (sso).
The idea is that instead of each all keeping track of users itself, there is another app (sometimes called an identity provider) that does this. Then when you try to log into an app, it takes to the to login of your identity provider instead. When the IP says you are the correct user, it sends a token to the app saying to let you access your account.
The huge benefits are if you are already logged into the IP on a browser for example, the other apps will login automatically without having to put in your password again.
Also for me the biggest benefit is not having to manage passwords for a large number of apps so family that uses my server have 1 account which gives them access to jellyfin, seafile, immich, freshrss etc. If they change that password it changes it for everything. You can enforce minimum password requirements. You can also add 2FA to any app now immediately.
There’s good guides to settings it up with traefik so that you get let encrypt certificates and can use traefik for proxy authentication on web based apps like sonarr. There are many different authentication methods an app can choose to use and Authentik essentially supports everything.
SSO should really be the standard for self hosted apps because this way they don’t have to worry about ensuring they have the latest security for user management etc. The app just allows a dedicated identity provider to worry about user management security so the app devs can focus on just the app.
If you have to add a whole other app the match what authentik can do, is authelia really lighter weight?
Im joking because authentik does takes a decent chunk of ram but having all protocols together is nice. You can actually make ldap authentication 2FA if you want.
I’m going to try it out and see how it compares to Authelia. My home server has 64GB RAM and I have VPSes with 16GB and 48GB RAM so RAM isn’t much of an issue :D
I can imagine that news orgs won’t like having publicly available backups of their subscriber only content. Is this a problem that has been considered?
Also, somewhat related, are the plans to turn this a little bit into a P2P archive.org? I mean, if multiple people store snapshots of webpages at different times, the timeline could be rebuilt using their publicly available snapshots.
Yeah. I expect basically any publicly available instances to get C&Ds REAL fast.
And a p2p archive.org will basically never work. For the same reasons that the various NSFW lemmy instances get defederated from almost instantly. Because there is room for discussion on sites that highlight nudity in movies. There isn’t much room to discuss when it is nothing but revenge porn, “fappening links”, ripped OF content, and (inevitably) child porn.
Stuff like this… I am sure there are niches but I am not seeing a lot of benefit over either a folder or a notes app that lets me upload PDFs (or even just google drive). But once you try to build a “community” you are going to have the same moderation issues amplified a hundred fold.
I think they do it to be funny (I hope). Like making fun of the folks on Facebook who write stuff like “I hearby declare that all of my posts are my property and can’t be harvested for data” or whatever.
It refers to some old forum signature iirc. I saw an explanation of it in some other Lemmy thread some time ago, though I don’t exactly remember where or when.
Lmao funny that this comes up… i just downloaded the full 1.5TB data set a couple days ago… took nearly 10 hours to unpack. I’m going to be that any flash game you can remember has been backed up and is playable.
Games from that time were actually running mostly in your browser. Meaning that the host, for example Miniclip served you the JavaScript and other files of the game which were then executed locally. So technically you could archive those games as long as you can load them up at least once initially.
If you logged and saved all the files the first one requested you could potentially make it work. You could manually change of the file paths in the html if you only doing a few of them. There’s only like 10 or so paths that would need to be modified. The PHP ones are likely harder to make work as php is a server side language and you don’t likely have easy access to PHP server and everything that goes with it.
Anyway thanks for the link to to mynoise.net. It looks like a well designed, carefully crafted website.
It’s an open source solution designed to scale to what the web was originally designed for and excels at. Documents. Specifically hyperlinked documents or webpages. You can’t reasonably expect an archival service to archive something that is by definition not static like an interactive web app.
This is a fresh install as about 10 minutes ago so using the :latest tag which I believe is the v 2.4.8 build.
Signing up is possible and I was able to create my user account so that’s a good start at least. :)
Amazing! Have wanted something like this for years, currently use raindrop but not fully, very hesitant of locking myself in. This looks very promising.
I’m very curious… Why do you feel locked in by raindrop? I like that it can regularly upload exports to my Google drive and I can Always download them as html and csv.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !selfhosted@lemmy.world
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don’t control.
Rules:
Be civil: we’re here to support and learn from one another. Insults won’t be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it’s not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don’t duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.
Resources:
selfh.st Newsletter and index of selfhosted software and apps
Cool app at first glance!
I always wonder why some open source projects choose discord and not matrix?
Discord and matrix are not searchable, they shouldn’t be used at all
That’s a client issue, not a protocol issue
It is. There’s no way for search engines to join all the servers and index them all, thus there’s no way to efficiently find information on them without already being there.
Are you talking about crawlers not being able to index matrix messenges?
It’s not a website, there’s no chat that’s being indexed by crawlers, afaik.
You could index them if you wanted.
A chat is meant to be ephemeral. Unlike with a forum where it is a goal to have long lasting information sharing.
Usually you want to things for a project, one forum and one chat. The chat is more informal and not meant to replace a proper forum. You can basically chit chat in a chat but not in a forum.
That’s the problem, discussions should happen on the open web, not hidden in chatrooms
There’s nothijg hidden on matrix. You can verify yourself, go to the space of Nextcloud, GNOME, KDE, OPENSUSE, FEDORA, flatpak, neo store, libretube, etc. Nothing is hidden.
it’s not literally hidden, but it’s not easily searchable because since it’s a chat, it’s not indexable on search engines. A forum is a better solution to avoid the same questions being asked 1000x and to expose great solutions and advices.
The problem is many people are using them like forums, so a lot of potentially useful info is lost (which is more of an user issue than anything else)
Even cooler page to sell you on the app. Very smooth gifs
Gifs are the USP
Matrix is cool but its user base is not there yet.
Then stop driving people to discord alone, at least use both so there’s an option
So… split the user (and support) base while invariably emphasizing the shortcomings of Matrix?
You can create a webhook in Discord and in Matrix that will share messages in channels back and forth
You can link them together at least that’s how the discord and matrix chats are for our instance are. I can chat from discord and get replies from people in matrix
Ah, I was not aware of a way to bridge two channels/servers entirely. I know there are bots that people use to bridge their user accounts though.
If it is fully seamless? Sure. But I don’t know why you are bothering then. But if it adds a “Bot” tag or any other hoops, you are still just making a worse experience for everyone. We ran into this back in the IRC days all the time.
Of course it isn’t seamless, but I have seen good and bad implementations.
By that logic, why are you on lemmy?
And I’m on matrix too, but I’m just an individual. If I were trying to advertise my project I’d probably use discord / reddit as well tbh
Why not both?
Also, if all projects advertised only the largest platforms, how would small platforms grow?
Yup why both both
Matrix is a terrible experience, honestly. It’s incredibly slow and their “servers” don’t really function as a community as much as a series of chat groups. I’m not fond of opening my chat app and then staring at it for 10-15 seconds while it loads all the new messages. And yes, I’ve tried different servers.
Discord is feature-rich. And now has the option to submit posts, which drastically increases usability and searchability. But it does have a big problem with privacy and ads.
Projects like this are much better suited for something like Gitlab.
deleted by creator
Element on iOS is absolutely, definitely, slow!
Desktop is better or worse or the same?
Pretty much the same
matrix.org works just fine. Nowadays, the experience is as good as on any other chat app
Element is the thing that’s subpar (to be generous) compared to other chat apps. Element X is better for the features that have been implemented, but the current feature set is very incomplete.
Mobile yes, desktop isn’t subpar ime
Even desktop is more resource heavy than it should be. But yes, mobile is much worse.
Beg to differ. Not all of us want to be Beta_testers
I think Matrix suffers from some issues with large communities, for instance Graphene OS has already had to abandon 2-3 of their main group chats due to same bug and last time I checked (2-3 months ago) there has even been talks of switching to Discord. That is, just in case, a community of some of the most diehard privacy nerds btw
I wonder why they don’t just set up a forum
Perhaps they could create a community on programming.dev
Using it since 2 months now and I really like it. Was totally worth a donation👍
Thanks!
It seems so much nicer than my nextcloud bookmarks!
What value can this bring me over features available using a Mozilla (Firefox) account and the Official Wayback Machine Browser Extension?
Collaboration, making your collections public, better organization, self-hostedness (idk if that’s a word), better UI and so on…
Thank you for responding quickly
No prob!
Any demo? That doesnt have a paywall?
Has anyone been able to get the Firefox extension to work with a self-hosted installation? It’s not accepting my login address.
Works without issues here. Keep in mind to add http(s):// in front of your address.
Yeah, I’m doing that and it isn’t working on ff for windows or android.
I can log into the same address on my browser no problem.
Strange 🤔
I have no problems with Firefox on Fedora 39 or FF on Windows 11.
Extension is not available on FF in Android. How did you try that?
I’m using Iceraven, but if you visit the FF Add-on website and to to desktop mode, I can install pretty much any extension.
I’m not sure why it’s not working. I’ll continue to investigate why it’s not connecting.
Good luck, maybe you find a clue in the docs, if not ask on github ☺️
Fixed it!
So, there was a closed issue on github: https://github.com/linkwarden/browser-extension/issues/44
And the solution was to reconfigure the pull command to use “ghcr.io/linkwarden/linkwarden:latest” instead of “ghcr.io/linkwarden/linkwarden:main”
It loaded a more recent version of Linkwarded (totally different from the one it had originally) and the extension is working now :)
Thanks for sharing the solution ☺️
Thank you for including oAuth options for sign on. Makes a big difference being able to use the same account for all the things like freshRSS, seafile, immich etc.
Although in the subscription version, SSO is not available unless you purchase the “Contact Us” version. https://sso.tax would like a word.
Free for self hosted which is probably what matters to most here
Definitely a fair point, always good to see that in a project
I’m intrigued. How does it work? Do you have a link or an article to point me to?
The general principle is called single sign on (sso).
The idea is that instead of each all keeping track of users itself, there is another app (sometimes called an identity provider) that does this. Then when you try to log into an app, it takes to the to login of your identity provider instead. When the IP says you are the correct user, it sends a token to the app saying to let you access your account.
The huge benefits are if you are already logged into the IP on a browser for example, the other apps will login automatically without having to put in your password again.
Also for me the biggest benefit is not having to manage passwords for a large number of apps so family that uses my server have 1 account which gives them access to jellyfin, seafile, immich, freshrss etc. If they change that password it changes it for everything. You can enforce minimum password requirements. You can also add 2FA to any app now immediately.
I use Authentik as my identity provider: https://goauthentik.io/https://goauthentik.io/
There’s good guides to settings it up with traefik so that you get let encrypt certificates and can use traefik for proxy authentication on web based apps like sonarr. There are many different authentication methods an app can choose to use and Authentik essentially supports everything.
https://youtu.be/CPURnYaW3Zk
SSO should really be the standard for self hosted apps because this way they don’t have to worry about ensuring they have the latest security for user management etc. The app just allows a dedicated identity provider to worry about user management security so the app devs can focus on just the app.
Authentik is pretty good. Authelia is good too, and lighter weight.
You can combine Authelia with LLDAP to get a web UI for user management and LDAP for apps that don’t support OpenID Connect (like Home Assistant).
If you have to add a whole other app the match what authentik can do, is authelia really lighter weight?
Im joking because authentik does takes a decent chunk of ram but having all protocols together is nice. You can actually make ldap authentication 2FA if you want.
Interesting… How does Authentik do 2FA for LDAP?
I’m going to try it out and see how it compares to Authelia. My home server has 64GB RAM and I have VPSes with 16GB and 48GB RAM so RAM isn’t much of an issue :D
Because authentik uses flows, you can insert the 2FA part into any login flow (proxy, oauth, ldap etc)
https://youtu.be/whSBD8YbVlc
LDAP sends username and password over the network though… It doesn’t use regular web-based authentication. How would it add 2FA to that?
Here is an alternative Piped link(s):
https://piped.video/whSBD8YbVlc
Piped is a privacy-respecting open-source alternative frontend to YouTube.
I’m open-source; check me out at GitHub.
Thank you for the detailed answer! It seems really interesting and I will definitely give a try on my server!
How does making collections public work if you’re self hosting?
Like this: https://cloud.linkwarden.app/public/collections/118
FYI, if you have a synology NAS and want to self-host using the docker install, these instructions work: https://mariushosting.com/how-to-install-linkwarden-on-your-synology-nas/
I can imagine that news orgs won’t like having publicly available backups of their subscriber only content. Is this a problem that has been considered?
Also, somewhat related, are the plans to turn this a little bit into a P2P archive.org? I mean, if multiple people store snapshots of webpages at different times, the timeline could be rebuilt using their publicly available snapshots.
CC BY-NC-SA 4.0
Now that would be cool!
Yeah. I expect basically any publicly available instances to get C&Ds REAL fast.
And a p2p archive.org will basically never work. For the same reasons that the various NSFW lemmy instances get defederated from almost instantly. Because there is room for discussion on sites that highlight nudity in movies. There isn’t much room to discuss when it is nothing but revenge porn, “fappening links”, ripped OF content, and (inevitably) child porn.
Stuff like this… I am sure there are niches but I am not seeing a lot of benefit over either a folder or a notes app that lets me upload PDFs (or even just google drive). But once you try to build a “community” you are going to have the same moderation issues amplified a hundred fold.
I’m not sure I understand your thoughts on p2p archive.org . What does it have to do with NSFW lemmy? I don’t follow.
CC BY-NC-SA 4.0
Sorry for off-topic, but why do your comments end in a license link?
I think they do it to be funny (I hope). Like making fun of the folks on Facebook who write stuff like “I hearby declare that all of my posts are my property and can’t be harvested for data” or whatever.
It refers to some old forum signature iirc. I saw an explanation of it in some other Lemmy thread some time ago, though I don’t exactly remember where or when.
My question is: what’s wrong with browser bookmarks and something SIMPLE to sync them between like devices like floccus (+ webdav server)?
no image/text previews, only small part of the title visible, no sharing, no automatic archiving
Content changes or disappear.
For fun, I booted up a old 2005 laptop with windows xp on it. The bookmarks were all dead. And most weren’t archived in any way.
There’s were many browser games I used to play that is completely lost in time.
How would browser games survive with that solution tho? They most likely require some server…
Most browser games are quite simple and aren’t running on a remote server.
Oh you mean the ones here: https://flashpointarchive.org/ and http://www.flashgamearchive.com/
Yeah, flashpoint is great.
Lmao funny that this comes up… i just downloaded the full 1.5TB data set a couple days ago… took nearly 10 hours to unpack. I’m going to be that any flash game you can remember has been backed up and is playable.
Games from that time were actually running mostly in your browser. Meaning that the host, for example Miniclip served you the JavaScript and other files of the game which were then executed locally. So technically you could archive those games as long as you can load them up at least once initially.
Potentially yes, but for instance I’ve been looking for a way to have the following players offline and it seems harder than expected:
Any tips?
If you logged and saved all the files the first one requested you could potentially make it work. You could manually change of the file paths in the html if you only doing a few of them. There’s only like 10 or so paths that would need to be modified. The PHP ones are likely harder to make work as php is a server side language and you don’t likely have easy access to PHP server and everything that goes with it.
Anyway thanks for the link to to mynoise.net. It looks like a well designed, carefully crafted website.
Yes yes, but what about magic / automated solutions? Wasn’t that the great advantage of Linkwarden?
It’s an open source solution designed to scale to what the web was originally designed for and excels at. Documents. Specifically hyperlinked documents or webpages. You can’t reasonably expect an archival service to archive something that is by definition not static like an interactive web app.
Installed and no way to login, see this in your GH issues:
https://github.com/linkwarden/linkwarden/issues/415
This is a fresh install as about 10 minutes ago so using the :latest tag which I believe is the v 2.4.8 build. Signing up is possible and I was able to create my user account so that’s a good start at least. :)
Amazing! Have wanted something like this for years, currently use raindrop but not fully, very hesitant of locking myself in. This looks very promising.
I’m very curious… Why do you feel locked in by raindrop? I like that it can regularly upload exports to my Google drive and I can Always download them as html and csv.
That sounds great, I didn’t look into it enough to know that
I actually tried to build Raindrop.io-clone like this one one day, but never got the time to work fully on it… Congrats OP!
This sounds very cool and I’d definitely use it.