AdverSpider is a next-generation web crawler that specializes in detecting and analyzing online advertising. AdverSpider takes a list of URLs, visits each page and figures out how many ads are being displayed, which ad networks are being used and which sizes of ads are available. This data is returned to you as XML which makes it easy to process however you'd like.

AdverSpider is ideally suited for:


See a sample report generated from AdverSpider data.

Supported Networks

AdverSpider currently detects ads from the following popular online ad networks.

Support for more networks is planned. If you'd like to see support for an ad network not listed here please email your request to shawn@simister.ca

Results Extraction Tool

The 80 Legs results files are delivered in a compressed format that needs to be expanded before you can use the results.

Download Now

Once you've completed a crawl. You can use the results extraction tool to convert the results to XML.

  1. Download the anlayzed results zip file from the 80 Legs portal and extract the .80 file.
  2. Make sure that you have the Java runtime environment (version 6 or higher) installed.
  3. Run the tool from the command-line like this:
    java -jar AdverSpider_Tool-1.0.jar your_results.80
  4. An XML file with the same name as your original .80 file will appear in the same directory.