User-agent: * Disallow: /classes/ Disallow: /csv/ Disallow: /logs/ Disallow: /spaw/