Infrastructure
· 9 checks — DNS, redirects, IPv6, crawlability, URL variants, and domain intelligence rolled into one auditable list.BCrawlabilityrobots.txt present, sitemap with 0 URLsREVIEW
Search engines may not be able to parse the sitemap. Fix XML validation errors.
An unparseable sitemap is silently ignored by Google — the URLs it advertises are never queued for crawl.
Learn more ▾ ▴
Google's sitemap parser is strict about XML validity. A single unescaped `&` or unclosed tag invalidates the whole file. Run your sitemap through a validator (Search Console's Sitemaps report flags it) and fix the offending entry. Most generators escape correctly; mistakes usually come from manually-written entries.
Source: sitemaps.org / Google Search Central
An empty sitemap provides no value. Add <url> entries for your pages.
An empty sitemap signals 'no content to index' to Google — actively harmful versus having no sitemap at all.
Learn more ▾ ▴
Google compares URLs in the sitemap against URLs it has crawled. An empty sitemap on a site with thousands of pages signals abandonment. Either populate it correctly (most CMSes auto-generate) or delete the file and let Google crawl normally.
Source: Google Search Central / sitemaps.org
User-agent: *
Allow: /sitemaps_v3/*
Disallow: /auth/*
Disallow: /search*
Disallow: /my/*
Disallow: /yours*
Disallow: /notifications
# Disable short links leading to external websites
# ========================
Disallow: /r/*
# Explicitly allow shortlink to posts
Allow: /r/p/*
# Disable indexing of search
Disallow: /search*
Sitemap: https://www.producthunt.com/sitemaps_v3/root_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/stories_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/topics_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/newsletters_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/forums_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/discussions_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/product_about_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/product_alternatives_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/product_reviews_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/products_categories_sitemap.xml.gz
User-agent: SemrushBot
Crawl-delay: 1
User-agent: SiteAuditBot
Crawl-delay: 1
BTLS Certificate Expiry & Recommendations64 days until leaf cert expires — 2 issues to addressREVIEW
Certificate validity
Recommended actions
- Extend HSTS max-age to at least 31536000 (1 year) to meet the preload list criteria
- Enable OCSP stapling on your TLS server to remove a CA roundtrip and protect user privacy
ADNS Records2 A records, 34 ms lookupPASS
| A | 104.18.126.118, 104.18.127.118 |
| AAAA | 2606:4700::6812:7f76, 2606:4700::6812:7e76 |
| CNAME | — |
| NS | — |
| MX | — |
| TXT | — |
| CAA | Lookup not available with standard resolver |
CAA record lookup requires a specialized DNS resolver. This check will be available in a future update.
Informational: CAA (Certification Authority Authorization) records weren't checked in this scan.
SPF helps prevent email spoofing. Add a TXT record starting with 'v=spf1'.
Without SPF, receiving servers can't validate sending IPs — your domain is easier to spoof in phishing.
Learn more ▾ ▴
SPF complements DMARC. Both should be published. SPF records list authorized sending IPs (e.g., `v=spf1 include:_spf.google.com ~all` for Google Workspace). After publishing, verify in Google Postmaster Tools or mxtoolbox.
Source: RFC 7208 (SPF)
A+Redirect ChainNo redirects — direct accessPASS
https://www.producthunt.com
85 ms · HTTP/1.1 FINAL
| # | URL | Status | Time | Protocol | Server |
|---|---|---|---|---|---|
| 1 | https://www.producthunt.com | 200 | 85 ms | HTTP/1.1 | cloudflare |
A+IPv6 ReadinessIPv6 reachable (16 ms)PASS
A+URL Variantswww/non-www, trailing slash, HTTP→HTTPSPASS
www / non-www
Preferred variant: www
HTTP → HTTPS
Consistent
A+Domain Intelligenceproducthunt.com — via GoDaddy.com, LLC, 23 years, 5 months oldPASS
1696 days
March 4, 2031
64 days
Issued by Google Trust Services
23 years, 5 months
Registered March 4, 2003
Enabled
Protects against DNS spoofing
Unknown
2606:4700::6812:7f76
GoDaddy.com, LLC