User-agent: * Disallow: /index.html Disallow: /public Disallow: /404.html Disallow: /upanupdate Disallow: /so Disallow: /*?*