Infrastructure
· 9 checks — DNS, redirects, IPv6, crawlability, URL variants, and domain intelligence rolled into one auditable list.DCrawlabilityActionrobots.txt present, no sitemapFIX
Disallow: / for all user-agents prevents search engines from indexing any page. This will remove the site from search results.
Disallow: / in robots.txt blocks every search crawler — the site becomes invisible in organic search.
Learn more ▾ ▴
Common deployment mistake: a staging robots.txt with `User-agent: * / Disallow: /` ships to prod. The site falls out of search results within days. Verify your robots.txt is the production-intended version. If this is intentional (private site), no action needed.
Source: Google Search Central
A sitemap helps search engines discover and index your pages more efficiently.
No sitemap.xml — Google relies on crawl-graph discovery alone, slowing indexing of deep or fresh URLs.
Learn more ▾ ▴
A sitemap accelerates Google's discovery of new and updated content. Most CMSes auto-generate one; static-site frameworks need a build-step plugin. Reference it from robots.txt and submit in Search Console to confirm Google can fetch it.
Source: sitemaps.org / Google Search Central
Add a 'Sitemap:' directive to robots.txt so search engines can discover your sitemap.
robots.txt omits Sitemap: directive — crawlers must fetch /sitemap.xml by convention; reliable but missing the explicit hint.
Source: sitemaps.org
User-agent: Googlebot
Disallow: /join/
Disallow: /lidworden/
Disallow: /businesses/
Disallow: /reset_password/
Disallow: /invitation/
Disallow: /generic_unsub/
Disallow: /inv_unsub/
Disallow: /generic_nm_unsub/
Disallow: /category_unsub/
Disallow: /rso_database_match_new/
User-agent: Slurp
Disallow: /join/
Disallow: /lidworden/
Disallow: /businesses/
Disallow: /reset_password/
Disallow: /invitation/
Disallow: /generic_unsub/
Disallow: /inv_unsub/
Disallow: /generic_nm_unsub/
Disallow: /category_unsub/
Disallow: /rso_database_match_new/
User-agent: msnbot
Disallow: /join/
Disallow: /lidworden/
Disallow: /businesses/
Disallow: /reset_password/
Disallow: /invitation/
Disallow: /generic_unsub/
Disallow: /inv_unsub/
Disallow: /generic_nm_unsub/
Disallow: /category_unsub/
Disallow: /rso_database_match_new/
User-agent: ia_archiver
Disallow: /join/
Disallow: /lidworden/
Disallow: /businesses/
Disallow: /reset_password/
Disallow: /invitation/
Disallow: /generic_unsub/
Disallow: /inv_unsub/
Disallow: /generic_nm_unsub/
Disallow: /category_unsub/
Disallow: /rso_database_match_new/
User-agent: Teoma
Disallow: /join/
Disallow: /lidworden/
Disallow: /businesses/
Disallow: /reset_password/
Disallow: /invitation/
Disallow: /generic_unsub/
Disallow: /inv_unsub/
Disallow: /generic_nm_unsub/
Disallow: /category_unsub/
Disallow: /rso_database_match_new/
User-agent: SemrushBot
Disallow: /join/
Disallow: /lidworden/
Disallow: /businesses/
Disallow: /reset_password/
Disallow: /invitation/
Disallow: /generic_unsub/
Disallow: /inv_unsub/
Disallow: /generic_nm_unsub/
Disallow: /category_unsub/
Disallow: /rso_database_match_new/
User-agent: Seobility
Disallow: /join/
Disallow: /lidworden/
Disallow: /businesses/
Disallow: /reset_password/
Disallow: /invitation/
Disallow: /generic_unsub/
Disallow: /inv_unsub/
Disallow: /generic_nm_unsub/
Disallow: /category_unsub/
Disallow: /rso_database_match_new/
# Twitter specifies this format here https://dev.twitter.com/cards/getting-started#crawling
User-agent: Twitterbot
Disallow: *
Allow: /events/
Allow: /city/feed/
Allow: /city/post/
Allow: /agency/
Allow: /pages/
Allow: /link_preview_image/
User-agent: facebookexternalhit
Disallow: /
Allow: /rewind
Allow: /?from_rewind=true
Allow: /link_preview_image/
Allow: /for_sale_and_free/
Allow: /p/
Allow: /g/
Allow: /faves/
User-agent: GPTBot
Disallow: /
User-agent: *
Disallow: /
Allow: /link_preview_image/
Allow: /for_sale_and_free/
No sitemap found
Adding a sitemap helps search engines discover your pages.
CIPv6 ReadinessActionNo IPv6 supportREVIEW
IPv6 support is increasingly important for global accessibility. About 40% of internet users have IPv6 connectivity.
No AAAA records — same impact as 'no IPv6 (AAAA) records'; IPv6-preferring clients pay extra latency falling back to IPv4.
Source: Google IPv6 stats
BTLS Certificate Expiry & Recommendations309 days until leaf cert expires — 5 issues to addressREVIEW
Certificate validity
Recommended actions
- Extend HSTS max-age to at least 31536000 (1 year) to meet the preload list criteria
- Add includeSubDomains to the HSTS directive
- Add the preload directive and submit to hstspreload.org once max-age + includeSubDomains are in place
- Enable DNSSEC on your domain for DNS spoofing protection
- Enable OCSP stapling on your TLS server to remove a CA roundtrip and protect user privacy
A+DNS Records4 A records, 82 ms lookupPASS
| A | 13.249.228.44, 13.249.228.5, 13.249.228.19, 13.249.228.41 |
| AAAA | — |
| CNAME | — |
| NS | ns-1734.awsdns-24.co.uk, ns-1005.awsdns-61.net, ns-61.awsdns-07.com, ns-1316.awsdns-36.org |
| MX | 10 aspmx.l.google.com 20 alt1.aspmx.l.google.com 30 alt2.aspmx.l.google.com 40 aspmx2.googlemail.com 50 aspmx3.googlemail.com |
| TXT | stripe-verification=a6e8d615b93a924b2bd9076a573c40b2bd28cacf12f42c295c227d869634... google-site-verification=qcHRaT0QHmpBHQg9LwymiwG3HwXStPDAmdNT4Kxs9cE onetrust-domain-verification=b98cb1e5dc4648779952be5836a28fe8 anthropic-domain-verification-43zv66=SYl0xVvQeUScHqpmFY3CdKpS8 have-i-been-pwned-verification=f7e78745f37dc3cce3c163c07a5b1758 CisionOne SAML=ce16d3f59f007aa0cd7b3817919ab56d1f3b84c88135e3583dfbef41fa8fd4c6 amazonses:Zgv+qLglapD3jCC/3nAq3seDQ7x3m2BbX2K19QGF4pA= stripe-verification=7e5f3cb932f9907759b9a01b00be273b05ee7f681c48ca7d25470c2386ff... canva-site-verification=74379-_bsPI7RgMPI6t9iQ twilio-domain-verification=16008e63da9a904621ab3c180ae4000c google-site-verification=pPGxzrWdOD4RZHU2FHDk-gc-IZOrhqzYydN1ZHFkoO0 stripe-verification=6592ecc703321011b70d9e9a2bad18183af4b3d8b43a61749625897b9c50... docusign=f4808610-33ff-434f-a6c2-fcdbb72ad2c5 adobe-idp-site-verification=ef96e9b89f65061510835e31e2b68bf5b706a0b7f6c3d2e4679c... google-site-verification=r7NHJRhgTmTS2Mu8nyoQDdhhmYtERj7zJUX29uabWjM MS=ms28859681 openai-domain-verification=dv-1pyaNQtslu8WISrJEjB8afL5 cursor-domain-verification-n7t2ea=BH9fXLDULg0CGAEtS7CG9XLKE google-site-verification=vRyT_7LgS3iwK0j1Xa-4hssVsqd-t0gPaeWgfu6ZrrM jamf-site-verification=tVCbpTjR6J3NFlrt9Xhi3Q google-site-verification=OTZyHZAnCkfafNaOoE-C47xaz2c_4AQ5MjO9b6J6U5U h1-domain-verification=tPjYmixyvCxwJZo2mKh43CT9KyHwp8budWJ6KNXXU7Tqcmyb stripe-verification=a2f8ef65badbd284f3517d1823f7355b2c94336e78ae1f3211f5fb84388a... stripe-verification=ed5bd9b75b8044bea267024a29553776c7e90bafead69cb3b9c36cd373e9... cursor-domain-verification-fmsj6t=UynbUS4x4TjZqr5Sgy8Fll9FR hubspot-domain-verification=YjU2MTM4MDItZmJkMS00YjMyLWE1MzQtYmU5YjkxNWQ5ZDA4 SPF v=spf1 include:nextdoor.com._nspf.vali.email include:%{i}._ip.%{h}._ehlo.%{d}._s... 00d36000001gqddeas google-site-verification=jJrOlchVU6F2KtkGHoduYTtPySMzBu00Iui-yufBFsk stripe-verification=d093b67bc19d2119de1178f8cd47619a7ba3367a79ba2c26aef3504629cf... segment-site-verification=R6tFFkwUk99N4NVzvPM71rEzt5WC7fER HyyE7huGMzb8zwdmKp5TdDnWQvNP2fI atlassian-domain-verification=xEjhcN2mkn0C+dWmKFSB6xRKKSWAFubHbMnnAlI84bNuPmsk9a... stripe-verification=2330bc9474cc3f973fb84f7514b762129c7161b3a12256e5e70eeeb49d4a... |
| CAA | Lookup not available with standard resolver |
CAA record lookup requires a specialized DNS resolver. This check will be available in a future update.
Informational: CAA (Certification Authority Authorization) records weren't checked in this scan.
A+Redirect ChainNo redirects — direct accessPASS
https://nextdoor.com
281 ms · HTTP/1.1 FINAL
| # | URL | Status | Time | Protocol | Server |
|---|---|---|---|---|---|
| 1 | https://nextdoor.com | 200 | 281 ms | HTTP/1.1 | istio-envoy |
A+URL Variantswww/non-www, trailing slash, HTTP→HTTPSPASS
www / non-www
Preferred variant: non-www
HTTP → HTTPS
Consistent
A+Domain Intelligencenextdoor.com — via Amazon Registrar, Inc., 22 years, 6 months old, hosted on AWSPASS
241 days
February 11, 2027
309 days
Issued by Amazon
22 years, 6 months
Registered February 11, 2004
Not enabled
Protects against DNS spoofing
AWS
ASN AS16509
13.249.228.44
Amazon Registrar, Inc.
Expiry timeline
Recommended actions
- Enable DNSSEC to protect visitors from DNS spoofing
- Enable registrar lock (clientTransferProhibited) to block unauthorized domain transfers
DNSSEC protects against DNS spoofing attacks. While not required, enabling DNSSEC adds an additional layer of security. Contact your DNS provider to enable it.
Without DNSSEC, an attacker who can poison your DNS can hijack your domain — and SSL certs alone don't stop them.
Learn more ▾ ▴
DNSSEC adds cryptographic signatures to DNS records, preventing forged responses from poisoning resolver caches. Without it, an attacker who controls the network path can redirect your domain to a malicious server before any HTTPS handshake happens. Most modern registrars (Cloudflare, Google Domains, Route 53) enable it with one toggle.
Source: ICANN / RFC 4033
The domain can be transferred without an unlock step. Enable registrar lock (clientTransferProhibited) in your registrar's control panel to protect against unauthorized or accidental transfers.
Without registrar lock, an attacker who phishes your registrar credentials can transfer the domain in minutes — total brand hijack.
Learn more ▾ ▴
Registrar lock (clientTransferProhibited, clientUpdateProhibited, clientDeleteProhibited) requires extra verification before any transfer/update/delete. Every major registrar offers it free. Combined with 2FA on your registrar account, it's the strongest defense against domain hijacking.
Source: ICANN / domain-security best practice