Robots.txt

XML and Google News Sitemaps to feed the hungry spiders. Compatible with WordPress Multisite, most caching plugins, Polylang and WPML.