I would like to find a way I can have a cold copy of articles that I view, something like a self-hosted archive.is … but it does it automatically for every site I visit.
Please help me find out how or where!
1) Yes, you can do this up to a point. However, manual capture works better than automatic.
2) One approach is Pale Moon plus ScrapBook X. This approach is simple, but it only works for some sites.
3) For near-perfect captures, learn to use WARC toolsets. I've tested openwayback and pywb and suggest starting with those two. This isn't plug and play but I've gotten it to work pretty well.
1) These tools do work though in different ways. One of the WARC tools saves captures in multiple formats. You'll find that only the WARC format and multimedia files work well.
2) I started to do this in 2006 using pre-Quantum Firefox and the original ScrapBook extension. It's nice to still be able to read websites that are long gone.
3) There's one more approach that's tricky but automatic as you wished. One sets up a copy of Squid to decode https and cache content forever.
@oldcoder My main grievance is that I on occasion want to refer to an article I read, or to find it by searching by browser history, but if I store a link in my database years later it is gone, and browser history is no longer full text searchable, let alone far in the past.
Is there some reason you don’t automatically archive all of the web pages you visit?
1) Regarding the grievance: Yes, I started to write my own tools in 1995 to capture websites for this and other reasons.
2) Q. Why not capture everything? A. In the past, disks cost a lot more and complete and automated captures, especially for https sites, were more difficult.
But 1 TB disks, even SSDs, are cheap now and the Squid approach is both fast and automatic. So I'll probably capture more pages automatically in the future.
Mastodon server for creative rationalists. Intended for light or technical discussion as opposed to strong debate.
Discouraged: Identity politics, religion, profanity, national events, X-rated discussion or materials. We might set up other servers for those things.
Encouraged: Creative Commons works, Minetest and other FOSS games, FOSS, writers, artists, recipes, rhymes, cat photos, G-rated webcomics.