You all will know more than anyone, but shit is disappearing rapidly off the web. If there's something you care about, or even just something mildly cool on an obscure site you don't want to see lost forever, save it to your drive. If it's something you personally want to preserve, be it facebook, twitter data, whatever, by law I think they have to have an archive accessible so go ahead and grab that before you're banned.
Hard drive space is cheap, preservation of something valuable even to just you, could be worth something to you or your progeny. Take care of it. We're in such a precarious place.
Idiots love to spout "the internet is forever ;)" but it is anything but, it is very ephemeral. We are on the precipice of an incredible tightwire act, so much information is held on by a single thread ready to collapse in a day, especially of the history 3DT cares about. It WILL be ground to dust if you do not take a personal stake in doing so. An inordinate amount of culture is already irrecoverably lost, and much more lying dormant on random hard drives stashed in forgotten places. Take the few minutes it takes to preserve the things you care about. Whether it be something personal to you you may want in the foreseeable future, or something bigger than you, the more efforts the better.
Alexandria is on fire.
Posted at 2021/03/20, 05:21:38Post ID: 4345
You all will know more than anyone, but shit is disappearing rapidly off the web. If there's something you care about, or even just something mildly cool on an obscure site you don't want to see lost forever, save it to your drive. If it's something you personally want to preserve, be it facebook, twitter data, whatever, by law I think they have to have an archive accessible so go ahead and grab that before you're banned.
Hard drive space is cheap, preservation of something valuable even to just you, could be worth something to you or your progeny. Take care of it. We're in such a precarious place.
Idiots love to spout "the internet is forever ;)" but it is anything but, it is very ephemeral. We are on the precipice of an incredible tightwire act, so much information is held on by a single thread ready to collapse in a day, especially of the history 3DT cares about. It WILL be ground to dust if you do not take a personal stake in doing so. An inordinate amount of culture is already irrecoverably lost, and much more lying dormant on random hard drives stashed in forgotten places. Take the few minutes it takes to preserve the things you care about. Whether it be something personal to you you may want in the foreseeable future, or something bigger than you, the more efforts the better.
Alexandria is on fire.
Post 4345
ive got 1042 (atm) pics and vids all classics saved from my favourite twitter RW esoterica poasters onto 3 different hard drives and 2 clouds if any1 wants em. Idk how im gonna send em over. Mail a USB mayb?
I hope this email finds you in the middle of a gunfight, at a restaurant.
Posted at 2021/03/21, 11:32:00Post ID: 4345:4358
[post=4345]Post 4345[/post]
ive got 1042 (atm) pics and vids all classics saved from my favourite twitter RW esoterica poasters onto 3 different hard drives and 2 clouds if any1 wants em. Idk how im gonna send em over. Mail a USB mayb?
“`"if by chance u can`t afford LSD, then buy a color tv!"`”
download every last one those .jpgs &.mp4s boys, but don`t worry about preserving any important text~ i got it ALL right here::
https://libraryofbabel.info/browse.cgi
life says 𝘥𝘢𝘯𝘤𝘦, a motion
to the alchemist reminder
“all these parts together,
now let in the rhythm”
Posted at 2021/03/22, 15:01:57Post ID: 4345:4371
download every last one those .jpgs &.mp4s boys, but don`t worry about preserving any important text~ i got it ALL right here::
https://libraryofbabel.info/browse.cgi
download every last one those .jpgs &.mp4s boys, but don`t worry about preserving any important text~ i got it ALL right here::
https://libraryofbabel.info/browse.cgi
thats the story that got me into borges
Posted at 2021/03/23, 01:08:42Post ID: 4345:4380
[quote=meinong@4345:4371]download every last one those .jpgs &.mp4s boys, but don`t worry about preserving any important text~ i got it ALL right here::
https://libraryofbabel.info/browse.cgi[/quote]
thats the story that got me into borges
Internet scribes are essential to preserving modern and past history, both fictional and non fictional. A dark age will be upon us eventually.
And frankly, it will be a necessary step. When given access to more data than you could ever consume 1000 times over it is no longer a useful collection. This process of grabbing what matters to us off the shelves before it burns down is an important part of this process of culling and curating information.
Think services like spotify now, virtually every song ever at your fingertips and what do people do? Listen to the same things they listened to 10-15 years ago. No scarcity and no interface but an algo makes for quite a sterile life. Engaging with media should be purposeful, not rote
Posted at 2021/03/23, 01:12:10Post ID: 4345:4381
[quote=TOLKO@4345:4366]Internet scribes are essential to preserving modern and past history, both fictional and non fictional. A dark age will be upon us eventually.[/quote]
And frankly, it will be a necessary step. When given access to more data than you could ever consume 1000 times over it is no longer a useful collection. This process of grabbing what matters to us off the shelves before it burns down is an important part of this process of culling and curating information.
Think services like spotify now, virtually every song ever at your fingertips and what do people do? Listen to the same things they listened to 10-15 years ago. No scarcity and no interface but an algo makes for quite a sterile life. Engaging with media should be purposeful, not rote
The problem is this lie that persists that "the internet is forever" that is incredibly damaging to this process and will cost people everything they ever knew growing up. It will simply not exist anymore. We're in an unimaginably precarious network of information that is extremely vulnerable. CDNs cache and send data thru the world but only surface the same 1% of content to everyone. 99% of information is buried deep away, rarely accessed.
Posted at 2021/03/23, 01:14:43Post ID: 4345:4382
The problem is this lie that persists that "the internet is forever" that is incredibly damaging to this process and will cost people everything they ever knew growing up. It will simply not exist anymore. We're in an unimaginably precarious network of information that is extremely vulnerable. CDNs cache and send data thru the world but only surface the same 1% of content to everyone. 99% of information is buried deep away, rarely accessed.
I plan to use RSS feeds to archive shit on a home server.
Youtube will be a script using sfeed + youtube-dl.
Proper archival for Instagram is awkward. You can save the webpage in a browser (which gives you a bunch of bullshit) but I think bibliogram may be the best option.
Ultimately archiving the modern web is fukt because everything is built on custom APIs loaded from HTML retrieved using HTTP (and a whole bunch of other shit...). Gopher is a much cleaner design.
I use pinboard to host some of my bookmarks but that needs to love and organisation. I don't regularly export it and my bookmarks are a bit of a mess. I'm tempted to pay for the automatic archival but there's some stuff for which it doesn't work properly because of the aforementioned reasons. (Youtube being a good example.)
The Youtube comment section is actually unrelated as it's an incredible source of info. Let's assume it's true, here's an example
https://www.youtube.com/watch?v=hxOnbpWVELU&lc=UggZXV2UG9FwZXgCoAEC
I remember this ALL too well... Myself (Sean P. Riley) and fellow Boingo crewmate Charlie Unkeless painted the majority of these covers in my backyard garage airbrush studio in Venice, California early in 1980. We invited the band members to come over and help paint some (we had 130 to do!) of which I think only Leon Schneiderman and Dale Turner ever showed up. The hand inscribed initial on the back of each one is "CS" which stands for Charlie & Sean. Great memories, great times, GREAT MUSIC! Long live OIngo Boingo!
I see this all the time and noone cares!
There are also browser proxying setups which archive everything you look at. That seems well and good but some things I'd rather not keep & middle-manning shit is a good way to get pwned.
This link has some useful info: https://www.gwern.net/Archiving-URLs
see you online
The most cyberpunk thing you can do, as in the dystopian meaning of the word, is watching Bl*ck M*rror on N*tflix and then talking about it on R*ddit.
Posted at 2021/03/24, 13:31:01Post ID: 4345:4391
I plan to use RSS feeds to archive shit on a home server.
Youtube will be a script using sfeed + youtube-dl.
Proper archival for Instagram is awkward. You can save the webpage in a browser (which gives you a bunch of bullshit) but I think bibliogram may be the best option.
Ultimately archiving the modern web is fukt because everything is built on custom APIs loaded from HTML retrieved using HTTP (and a whole bunch of other shit...). Gopher is a much cleaner design.
I use pinboard to host some of my bookmarks but that needs to love and organisation. I don't regularly export it and my bookmarks are a bit of a mess. I'm tempted to pay for the automatic archival but there's some stuff for which it doesn't work properly because of the aforementioned reasons. (Youtube being a good example.)
The Youtube comment section is actually unrelated as it's an incredible source of info. Let's assume it's true, here's an example
[url]https://www.youtube.com/watch?v=hxOnbpWVELU&lc=UggZXV2UG9FwZXgCoAEC[/url]
[quote]I remember this ALL too well... Myself (Sean P. Riley) and fellow Boingo crewmate Charlie Unkeless painted the majority of these covers in my backyard garage airbrush studio in Venice, California early in 1980. We invited the band members to come over and help paint some (we had 130 to do!) of which I think only Leon Schneiderman and Dale Turner ever showed up. The hand inscribed initial on the back of each one is "CS" which stands for Charlie & Sean. Great memories, great times, GREAT MUSIC! Long live OIngo Boingo![/quote]
I see this all the time and noone cares!
There are also browser proxying setups which archive everything you look at. That seems well and good but some things I'd rather not keep & middle-manning shit is a good way to get pwned.
This link has some useful info: [url]https://www.gwern.net/Archiving-URLs[/url]
see you online
Post 4345:4391
a most overlooked point you mentioned, the importance of the comment section on older videos/ war footage/ music. Normally I'd just screen capture something especially interesting, but there must be a better way.
another example: https://www.youtube.com/watch?v=oePMd2XQ5gA
14 year old comments with a completely unique style of speaking, injokes, references. Invaluable.
Posted at 2021/03/24, 20:42:23Post ID: 4345:4393
[post=4345:4391]Post 4345:4391[/post]
a most overlooked point you mentioned, the importance of the comment section on older videos/ war footage/ music. Normally I'd just screen capture something especially interesting, but there must be a better way.
another example: https://www.youtube.com/watch?v=oePMd2XQ5gA
14 year old comments with a completely unique style of speaking, injokes, references. Invaluable.
really good stuff wired, in our efforts to digitize everything in order to make it more networked and more accessible we've only made it worse at both those things in the long term. Sacrificed any long term utility. Mr. Dewey Decimal came up with a far more superior way to index and link things together that we have not come up with a comparable solution digitally yet (and it would be inordinately more complex in several dimensions to even do so).
Funny to see even big wiki pages deal with link rot, go to their references and half the sources people so eagerly depend on are totally dead.
I've often said, I think even on this forum:
IF YOU CANT HOLD IT, ITS NOT YOURS
technically any data on a hard drive can be held via the electrons in the drive representing the data. Anything hosted on web is vulnerable and of course even hard drives and physical digital media themselves are subject to a much higher failure rate than something like a book. Still, it's basically a guarantee that any URLs you have saved will be dead in 10 years. You'll probably still have access to a lot of cloud storage solutions unless that gets stripped from you or they face some technical failure, but it's a safer bet.
But as you described, you can't simply save web pages anymore. It loads data in such small chunks, obfuscated between layers of the API hitting the UI and things like that.
Your best bet for raw data is learning to parse APIs, lots have public documentation or ways to exploit it, but that's not going to really save the graphical elements which I know a lot of us care about. Still, this is what I did a week or so ago to backup like 7 years of soundcloud favorites. About 1300 tracks (I'm sure I had more but they were deleted).
I copied 80 pages of the API responses for their likes API, and saved the file locally, to email, etc. Of course I expect all the links to the songs themselves to die someday, the music no longer easily accessible, in the worst case I at least have artist and track names for a major portion of the music I've been listening to for the last 7 years of my life
Posted at 2021/03/24, 20:43:12Post ID: 4345:4394
really good stuff wired, in our efforts to digitize everything in order to make it more networked and more accessible we've only made it worse at both those things in the long term. Sacrificed any long term utility. Mr. Dewey Decimal came up with a far more superior way to index and link things together that we have not come up with a comparable solution digitally yet (and it would be inordinately more complex in several dimensions to even do so).
Funny to see even big wiki pages deal with link rot, go to their references and half the sources people so eagerly depend on are totally dead.
I've often said, I think even on this forum:
IF YOU CANT HOLD IT, ITS NOT YOURS
technically any data on a hard drive can be held via the electrons in the drive representing the data. Anything hosted on web is vulnerable and of course even hard drives and physical digital media themselves are subject to a much higher failure rate than something like a book. Still, it's basically a guarantee that any URLs you have saved will be dead in 10 years. You'll probably still have access to a lot of cloud storage solutions unless that gets stripped from you or they face some technical failure, but it's a safer bet.
But as you described, you can't simply save web pages anymore. It loads data in such small chunks, obfuscated between layers of the API hitting the UI and things like that.
Your best bet for raw data is learning to parse APIs, lots have public documentation or ways to exploit it, but that's not going to really save the graphical elements which I know a lot of us care about. Still, this is what I did a week or so ago to backup like 7 years of soundcloud favorites. About 1300 tracks (I'm sure I had more but they were deleted).
I copied 80 pages of the API responses for their likes API, and saved the file locally, to email, etc. Of course I expect all the links to the songs themselves to die someday, the music no longer easily accessible, in the worst case I at least have artist and track names for a major portion of the music I've been listening to for the last 7 years of my life
It's also not a secret that companies like Facebook and Google like to use your images for Facial Recognition AI testing, among plenty of other shady shit. Getting a good set of drives and reclaiming your data is one of the best investments you can make.
If you're schizo like me, you can even encrypt those drives, so nobody but you will be able to see what's contained within them.
I'm also a firm believer that everyone should run their own, HTML-Only, Javascript-less website. Be it locally for archiving purposes, or on the web.
Posted at 2021/03/27, 10:53:16Post ID: 4345:4408
It's also not a secret that companies like Facebook and Google like to use your images for Facial Recognition AI testing, among plenty of other shady shit. Getting a good set of drives and reclaiming your data is one of the best investments you can make.
If you're schizo like me, you can even encrypt those drives, so nobody but you will be able to see what's contained within them.
I'm also a firm believer that everyone should run their own, HTML-Only, Javascript-less website. Be it locally for archiving purposes, or on the web.
[url]https://www.vcstar.com/story/news/local/communities/simi-valley/2020/01/21/man-sentenced-8-years-hard-drive-theft-scheme/4536331002/[/url] shuck and dump.
Post 4345:4358
If you set up a server you can have your friends ssh in, I can't vouch for its safety but it serves its purpose for relatively small circles of friends. I know guy that made his server open to anyone who visited his site for a while. Twas comfy, I dl'd some pdfs and anime from him. It's not too hard to set up. This is less effective for website data but works amazingly for things you torrent (which you should be doing), pdfs (those can get difficult to find b/c of copyright laws cracking down), and personal photos. I'm a big proponent of high trust local networking. It's not that bad to hand over your server address to an IRL mate.
⠀⠀⠀⠀⠀⠀⠀⠀⠀
Posted at 2021/06/09, 03:23:14Post ID: 4345:5006
[post=4345:4358]Post 4345:4358[/post]
If you set up a server you can have your friends ssh in, I can't vouch for its safety but it serves its purpose for relatively small circles of friends. I know guy that made his server open to anyone who visited his site for a while. Twas comfy, I dl'd some pdfs and anime from him. It's not too hard to set up. This is less effective for website data but works amazingly for things you torrent (which you should be doing), pdfs (those can get difficult to find b/c of copyright laws cracking down), and personal photos. I'm a big proponent of high trust local networking. It's not that bad to hand over your server address to an IRL mate.
