AdverSpider is a next-generation web crawler that specializes in detecting and analyzing online advertising. AdverSpider takes a list of URLs, visits each page and figures out how many ads are being displayed, which ad networks are being used and which sizes of ads are available. This data is returned to you as XML which makes it easy to process however you'd like.
AdverSpider is ideally suited for:
- Doing competitive analysis to find out how your competitors are monetizing their pages.
- Finding high quality content to display you ads on.
- Finding new ad networks which target the publishers that you're interested in.
![]() | See a sample report generated from AdverSpider data. |
Supported Networks
AdverSpider currently detects ads from the following popular online ad networks.
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
Support for more networks is planned. If you'd like to see support for an ad network not listed here please email your request to shawn@simister.ca
Results Extraction Tool
The 80 Legs results files are delivered in a compressed format that needs to be expanded before you can use the results.
![]() | Download Now |
Once you've completed a crawl. You can use the results extraction tool to convert the results to XML.
- Download the anlayzed results zip file from the 80 Legs portal and extract the .80 file.
- Make sure that you have the Java runtime environment (version 6 or higher) installed.
- Run the tool from the command-line like this:
java -jar AdverSpider_Tool-1.0.jar your_results.80
- An XML file with the same name as your original .80 file will appear in the same directory.











