I just read aaron wall’s blog about robots.txt that help help him to make 10K from just one page. That owesome!. Actually i’ve already wrote about robots.txt before. It’s about robots.txt to the rescue. I wish i can make money like him..Ganbate to me! Aaron Wall is one of SEO expert that provide a lot [...]
Look at the sky, It a bird..no its a plan..no its Superman… hehehe..Just borrow words from old superman movies. What i want to share today is about robots.txt. Ia function as “superman” to deal with search engine spider. Search engine spider must meet them first before they crawl on your website. You website got robots.txt?It [...]
This is about Googlebot from Official Google Webmaster Central Blog, The common request that google support is to post a list of Googlebot IP addresses in some public place. The problem with that is that if/when the IP ranges of google crawlers change, not everyone will know to check.
