.Google.com limits robots.txt assistance to 4 industries, clarifying its own posture on in need of support directives.Google simply assists 4 certain robots.txt industries.Unsupported directives in robots.txt will certainly be overlooked.Take into consideration auditing your robots.txt reports taking into account this update.