Dead-Links.com - Free Broken Link Checker

Validate your website

FREQUENTLY ASKED QUESTIONS

Which is the spider's User Agent?

The spider's User Agent is : "online link validator (http://www.dead-links.com/)"

The spider IP address?

The robot's IP address is 216.93.174.12.

How can I identify the robot in the log files of my server?

With any of the 2 informations above you can identify when the crawler has been in your server.

Is there any limit in the number of pages the robot can crawl?

The spider has a limit of 25 pages per domain and 150 external documents with a maximum execution time of 15 minutes.

If the robot finds a link towards http://www.dead-links.com during the exploration, the page limit in the domains increases to 150 and the external urls to 500, also increases the execution time.

My domain has thousands of documents, can you check it completely ?

For special request like yours contact with the webmaster: webmaster@dead-links.com.

The spider can crawl without problems thousands of documents and work during hours.

Does the spider follows the robots.txt protocol?

The protocol is not yet implemented. We are working on it.

Can I block the spider in my website?

Yes, you can do it either blocking the User Agent or the robot's IP address.

What are the mime-types?

Visit: information about Mime Types.

What is an URL? And the query string?

Visit: information about URLs and query strings.

Does the spider recognizes links inside frames, java, javascript, image maps, etc..?

Nowadays the robot doesn't recognizes this kind of links or redirections:

• Links inside frames
• Links using javascript
• Links inside java applets
• Links inside Flash objects
• Links inside IFrames
• Links inside image maps
• Redirections using Meta-Refresh tag

It is important to show that all of this kind of links have a negative impact in your search engine rankings.
So, if the robot crawls your website without problems, your website is well optimized and ready for search engines.

The spider reports that my site has 0 links. What happens?

The reason may be that you are using any of the techniques or links described above.

Is there any guidelines to optimize my website for search engines?

Yes, visit: search engine guidelines.