TOOLS

Webrecorder

Webrecorder is a web archiving tool developed by Rhizome. It is open-source, and free to use. The Posters Network have been experimenting with it as a way of collecting the kind of interactive and dynamic graphical content that is shown on complex websites, and shared on social media — whilst holding that content in context.

Webrecorder caught our attention because of the ways it is different to traditional web archiving technologies. Traditional web archiving is done by Internet bots or ‘crawlers’, which are provided with a start or ‘seed’ URL and programmed to systematically explore and comprehensively capture whole websites. Whereas, Webrecorder is operated by a human curator. So rather than an automated crawler, it depends on a conscious, thinking person performing the actions of browsing the web. This has two important practical consequences:

Firstly, instead of being determined by programmed instructions, the ‘depth’ and ‘scope’ of what is collected are defined by an individual’s decisions. Webrecorder only captures the parts of the web which a curator explores, so when we are collecting we are at once selecting what to keep.

Secondly, human-scale archiving makes it possible to capture interactive content (such as videos which start after we click play, elements on screen that can be filtered or sorted differently depending on selections in a drop-down menu, or a social media feed where the motion of scrolling stimulates further content to load).

This brief step-by-step is intended to help curators get started with the tool and begin collecting objects on the web themselves:

https://webrecorder.io

  1. Setting Up
    1. Create an account
      You can collect without an account, but your archives won’t be saved, and you won’t have options to share them directly.
    2. Choose a New Recording Name
      Recording Name must not be URL, as the syntax becomes conflated with the URL you are recording and will disrupt Playback.
  2. Making a Recording
    1. Paste in the URL you want to Record
      Press the Record button

    2. Requests and responses exchanges take place between your web browser and web servers as you explore. Webrecorder is storing those exchanges, so that your encounter on the web can be re-staged.
    3. Watch the file size counter (top left) increase as content gets added to your archive.
    4. On the dynamic web, certain resources are loaded only when triggered by our interactions, so make sure you scroll down through content, and click play on embedded videos if you want to capture them.
    5. Webrecorder detects each time a new page is loaded, and creates a ‘bookmark’ (or link). In Replay mode, the collection can be entered via any one of these ‘bookmarks’.
    6. Browse the web, making decisions about what elements you want your archive to contain: follow links, and capture the surrounding context.
    7. Archives are being saved continuously as you explore. Hover over the Record Button, to click Stop.
    8. To add a new recording, click New Recording to add another Session to your Collection.
    9. Using Webrecorder, you capture the web as you see it. For example, you can login to your social media accounts, and Record your perspective of a platform. Webrecorder does not record what you type into password fields.
    10. Note that on platforms such as Twitter, content is loaded dynamically. You need to scroll down, and click to capture embedded videos and expand conversation threads.
    11. Everything you want to be able to Replay needs to be Recorded — keep an eye on the size counter, while it is still increasing it is still capturing your activity.
  3. Getting an overview of your Collection
    1. In Collection Overview mode, a panel on the left side shows Recording session. Some elements of metadata are captured automatically, including the digital storage size (MB or GB), the number of bookmarks, and the duration of the Recording Session.
    2. Click on any of the bookmarks to enter the archive in Replay mode.
    3. The order that you captured elements in does not matter, but you can only Replay elements of web pages which you have recorded.
  4. Re-Recording or Making a Patch
    1. If in Replay mode, you notice that content you intended to capture is incomplete or missing, you can either Record the URL again, or Patch your Recording.
    2. When the page is still available on the live web, Webrecorder Re-Records or Patches from the original source. If not, Webrecorder tries to locate another archived version of the page in a public web archive elsewhere to capture what is missing in your collection.
    3. Begin Re-Recording or Patching by clicking on the drop-down arrow to the right of the Record/Stop button. Choose, ‘Record this URL again’, or on the button labeled ‘Patch this URL’.
  5. Capturing a Static Copy
    1. At times, it may be useful to supplement your Recordings with exact, static snapshots of what you see on screen. To do this, click on the drop-down arrow to the right of the Record/Stop button and choose, ‘Static Copy’.
    2. Note that all dynamic elements will be removed, so content in the Static Copy is not interactive.
  6. Returning to the Collection Overview
    1. In Collection Overview mode, you will now see two Recording Session in the panel on the left side.
    2. You can view the bookmarks from one Session at a time, by using the filters.
    3. You can show or hide bookmarks, using the ‘eye’ buttons in the left margin. You can toggle the display of hidden bookmarks on or off, using the ‘eye’ switch at the left edge of the header.
    4. You can create a Collection Description, or edit your Collection Name by clicking on the pencil icons.
    5. You can make your Collection public or private, using the Collection Public? switch at the top right on the Overview page.
    6. If your Collection is public, you can share it by copying and pasting the URL from the Collection Overview page.
    7. If your Collection is public, you can also share individual bookmarks, clicking on the Sharing Options button at the top right in Replay mode, or by copying and pasting its individual URL.
  7. Doesn’t look right? and Asking for help
    1. If you are experiencing problems Replaying a particular page, get in touch with Rhizome, via the Doesn’t Look Right? button at the top right in Replay mode.
    2. If you are having difficulty capturing a particular type of content, write to support@webrecorder.io
  8. Downloading a Collection
    1. You can download your collection as a WARC (Web ARChive file package) by clicking the green ‘Download Collection’ button at the top left of the Collection Overview page.
    2. To open a WARC file and view it offline, you can use Webrecorder Player a free, open source software that can be downloaded from GitHub, here.

      See also: Rhizome’s Quick Start Guide + Glossary: https://webrecorder.io/_documentation.

      View our example narratives here