Generate robots.txt files
Create a robots.txt file for your website.
Check backlinks for any website
Check for broken links on your website
Lookup DNS records
Check how old a domain is
Check HTTP headers
Check keyword density