User-agent: * Disallow: /api Disallow: /admin Disallow: /admin/** Disallow: /auth Disallow: /auth/**