# Allow crawler access User-agent: * Allow: / Allow: /register?referralCode=* # Block all crawlers for all /api/* User-agent: * Disallow: /api/*