23rd April 2012
Some great news today, the SiteCrawl API is now live and ready for use. You can now easily access the power of SiteCrawl, adding tasks, checking on the status and even digging deep into a crawl that you have created. You have access to all the information; broken links found, anchor text used, which links were nofollow and even the total number of links to and from a particular url.
You can view the entire reference doc along with sample calls on the api reference page.
All SiteCrawl accounts have an API key associated with them, you can access your key from the Api Tools section of the account area.
There is currently no limit on the amount of calls you can do to the API, however there is a rate limit of 1 call every 3 seconds. If you hit this you will get a 429 response code and a error message.
So if you create something with the API, please let me know, I'd love to check it out and share it with other people. If you have any questions or comments feel free to contact me.
blog comments powered by Disqus