User-agent: * Allow: / # Block private/internal app routes (not for indexing) Disallow: /dashboard/ Disallow: /admin/ Disallow: /login Disallow: /register # Let crawlers fetch the sitemap and OG/share assets; block all other API JSON Allow: /api/sitemap.xml Allow: /api/og/ Disallow: /api/ Sitemap: https://mythreadsly.com/api/sitemap.xml