Google Wants to Establish an Official Standard for Using Robots.txt - Search Engine Journal
- Google Wants to Establish an Official Standard for Using Robots.txt Search Engine Journal
- Google wants to make robots.txt an Internet standard after 25 years 9to5Google
- Google pushes for an official web crawler standard Engadget
- Google open-sources robots.txt parser in push to make Robots Exclusion Protocol an official standard VentureBeat
- Google Works To Make Robots Exclusion Protocol A Real Standard Search Engine Roundtable
- View full coverage on Google News