User-agent: * Disallow: /404/ Disallow: /css/ Disallow: /images/