31
Mafia / Re: Oh jeez, Quicktopic is shutting down
« on: November 28, 2021, 01:37:18 pm »
Yeah, configuring stuff may be pretty hard. Ruby and Python is already preinstalled on Mac and Linux machines, but if you're using Windows, you'll have to first install those languages as well. And in any rate, no matter what OS you're on, you'll likely want to upgrade to the latest version. Then, you can:
Step 1: Install wayback-machine-archiver:
Step 2: Confirm that the tool is installed:
Step 3 (Optional): Check to see if the tool works by passing in the URL of a page you wanted archived...
Step 4: Copy and paste the code in a *.rb file (let's call it "file.rb") and then execute that code using
Since configuration is a rather time-consuming and annoying process, I decided instead to upload the script onto repl.it, a code-sharing website that already had the configuration set up for you. You can see it here: https://replit.com/@tra38/ArchiverBackup#main.rb
Main difference is that instead of using a Python package, I instead used a native Ruby gem - "wayback_archiver" - so I wouldn't need to depend on Python, and could rely solely on Ruby. This was because I couldn't find a way to use both Ruby and Python at the same time...or rather, couldn't find a way to quickly do it. A short-and-dirty hack (using wayback_archiver) was good enough. I tested that script by archiving Gnosia's dead chat and scum chat.
To be able to use the repl.it's script, you just need to make an account on the site. Then you can "fork" the codebase, making the modifications as appropriate and then clicking on Run to execute the code.
P.S.: I also ran the repl.it's script with CYOMA's mafia chat, and it looks like that chat is now finally publicly accessible.
P.P.S: Catch with this new updated script is that you don't get the web.archive.org URL when the archive process is complete (though considering that URL is buried within a bunch of spurious error messages, maybe that's probably a benefit rather than a malus). You would likely need to do a manually confirmation on web.archive.org.
Step 1: Install wayback-machine-archiver:
Code: [Select]
pip3 install wayback-machine-archiverStep 2: Confirm that the tool is installed:
Code: [Select]
archiver --helpStep 3 (Optional): Check to see if the tool works by passing in the URL of a page you wanted archived...
Code: [Select]
archiver "https://quicktopic.com/53/H/[INSERT_ID_HERE]?o=0&range=all&print=1&submit=Show+printable+page"Step 4: Copy and paste the code in a *.rb file (let's call it "file.rb") and then execute that code using
Code: [Select]
ruby file.rb***Since configuration is a rather time-consuming and annoying process, I decided instead to upload the script onto repl.it, a code-sharing website that already had the configuration set up for you. You can see it here: https://replit.com/@tra38/ArchiverBackup#main.rb
Main difference is that instead of using a Python package, I instead used a native Ruby gem - "wayback_archiver" - so I wouldn't need to depend on Python, and could rely solely on Ruby. This was because I couldn't find a way to use both Ruby and Python at the same time...or rather, couldn't find a way to quickly do it. A short-and-dirty hack (using wayback_archiver) was good enough. I tested that script by archiving Gnosia's dead chat and scum chat.
To be able to use the repl.it's script, you just need to make an account on the site. Then you can "fork" the codebase, making the modifications as appropriate and then clicking on Run to execute the code.
P.S.: I also ran the repl.it's script with CYOMA's mafia chat, and it looks like that chat is now finally publicly accessible.
P.P.S: Catch with this new updated script is that you don't get the web.archive.org URL when the archive process is complete (though considering that URL is buried within a bunch of spurious error messages, maybe that's probably a benefit rather than a malus). You would likely need to do a manually confirmation on web.archive.org.
