User-agent: * Disallow: /csv$ Disallow: /csv/ Disallow: /php$ Disallow: /php/ Disallow: /xml$ Disallow: /xml/ Disallow: /json$ Disallow: /json/ Disallow: /line$ Disallow: /line/ Disallow: /batch$ Disallow: /batch/