User-Agent: * Disallow: /ftp/ Disallow: /404.html Disallow: /videos/ Disallow: /scripts/ Disallow: /surf-in-portugal/eng/surf-in-algarve/ Disallow: /surf-in-mentawai/ Disallow: /surf_in_mentawai/ Allow: /