Add CI tests that pages haven't been deleted since the previous run

[alexwlchan]

To avoid a repeat of #219.

We use http-crawler to spider the live site, and the site we're building – if there are pages on live that have disappeared, we error the build. Any pages we intentionally want to delete either get an exception in that test, or a 410 status code – but that gets explicitly documented in the patch.