User-agent: * Disallow: /pages/ Disallow: /media/ Allow: / Disallow: /technical/ Disallow: /homepage.aspx