Infrastructure
· 9 checks — DNS, redirects, IPv6, crawlability, URL variants, and domain intelligence rolled into one auditable list.CCrawlabilityActionrobots.txt present, sitemap with 7 URLsREVIEW
Disallow: / for all user-agents prevents search engines from indexing any page. This will remove the site from search results.
Disallow: / in robots.txt blocks every search crawler — the site becomes invisible in organic search.
Learn more ▾ ▴
Common deployment mistake: a staging robots.txt with `User-agent: * / Disallow: /` ships to prod. The site falls out of search results within days. Verify your robots.txt is the production-intended version. If this is intentional (private site), no action needed.
Source: Google Search Central
User-agent: Googlebot
Disallow:
User-agent: googlebot-image
Disallow:
User-agent: googlebot-mobile
Disallow:
User-agent: MSNBot
Disallow:
User-agent: Slurp
Disallow:
User-agent: yahoo-mmcrawler
Disallow:
User-agent: Twitterbot/1.0
Disallow:
User-agent: TwitterBot 1.0
Disallow:
User-agent: AhrefsBot
Disallow:
User-agent: AhrefsSiteAudit
Disallow:
User-agent: Screaming Frog
Disallow:
User-agent: Screaming Frog SEO Spider
Disallow:
User-agent: yahoo-blogs/v3.9
Disallow:
User-agent: Bingbot
Disallow:
User-agent: *
Disallow: /
Disallow: /cgi-bin/
Disallow: /research/
Sitemap: https://www.spiceworks.com/sitemap_index.xml
Disallow: /*?
Disallow: /sw-marketing/*
User-agent: *
Disallow: /legal-resource-center/*
Disallow: /offers/*
Disallow: /cdn-cgi/
User-agent: "008"
User-agent: Amazonbot
User-agent: anthropic-ai
User-agent: Applebot
User-agent: Applebot-extended
User-agent: Bytespider
User-agent: CCBot
User-agent: ClaudeBot
User-agent: Claude-Web
User-agent: cohere-ai
User-agent: Diffbot
User-agent: FacebookBot
User-agent: GPTBot
User-agent: HTTrack
User-agent: Nutch
User-agent: Offline Explorer
User-agent: omgili
User-agent: Scrapy
User-agent: YouBot
User-Agent: meta-externalagent
User-Agent: Timpibot
User-Agent: DuckAssistBot
User-Agent: Perplexity-User
User-Agent: Ai2Bot-Dolma
User-Agent: meta-externalfetcher
User-Agent: ChatGPT-User
User-Agent: PerplexityBot
User-Agent: OAI-SearchBot
Disallow: /
- https://www.spiceworks.com/post-sitemap....
- https://www.spiceworks.com/page-sitemap....
- https://www.spiceworks.com/category-site...
- https://www.spiceworks.com/post_tag-site...
- https://www.spiceworks.com/topic-sitemap...
- https://www.spiceworks.com/legal-resourc...
- https://www.spiceworks.com/author-sitema...
BURL Variantswww/non-www, trailing slash, HTTP→HTTPSREVIEW
www / non-www
Inconsistent — duplicate content risk
HTTP → HTTPS
Consistent
BTLS Certificate Expiry & Recommendations58 days until leaf cert expires — 3 issues to addressREVIEW
Certificate validity
Recommended actions
- Enable HSTS: Strict-Transport-Security: max-age=31536000; includeSubDomains
- Enable DNSSEC on your domain for DNS spoofing protection
- Enable OCSP stapling on your TLS server to remove a CA roundtrip and protect user privacy
BCDN & DeliveryCloudflareREVIEW
A+DNS Records2 A records, 120 ms lookupPASS
| A | 141.193.213.11, 141.193.213.10 |
| AAAA | 2606:4700:4400::6812:2938, 2606:4700:4400::ac40:92c8 |
| CNAME | — |
| NS | ns-198.awsdns-24.com, ns-518.awsdns-00.net, ns-1051.awsdns-03.org, ns-1720.awsdns-23.co.uk |
| MX | 1 aspmx.l.google.com 5 alt1.aspmx.l.google.com 5 alt2.aspmx.l.google.com 10 alt4.aspmx.l.google.com 10 alt3.aspmx.l.google.com |
| TXT | google-site-verification=7iGHKwnOqoTIbWDgpiM3ilTu_OmVDUcHyBjL72KgFlc workplace-domain-verification=nyG3Ka2PT6mtUMtgla9atxccUqqeG1 google-site-verification=WtyWEqjfeBHB8_ClM05h4Gb-cOCLV3Zn8TnC4jvIfk4 MS=ms16651012 zapier-domain-verification-challenge=f1ddfaef-2fc4-4420-9a94-11f3ed601ac9 globalsign-domain-verification=5a7f99475d1f7aa90047a05432038b8e amazonses:Ziz/TAhYy0oGBc/6Q8dgs1gyE7ktj51iuQ6wgWoSFKk= h9j11af54a3uvi1lcivggg9m84 SPF v=spf1 ip4:54.208.84.215 ip4:54.176.194.42 include:_spf.google.com include:docu... google-site-verification=tXRqlrOJB_rehe2s3jmvuel81gIrUpsitUQYQUTkyag ZOOM_verify_uXjUz93wC8WW4gZuNpyZG9 anthropic-domain-verification-3w7hrh=LvorYKtpD1HtRXx8uy1d5XYso onetrust-domain-verification=fb28bed427354cd2bef229432d72141b MS=ms50687237 3p66qggv5y8nmk4df8gjdw51c0hmqw5r google-site-verification=fpONNpFDTr1UqTr6ifJJXhyn2M3cs4auUbgBE4WJBus MS=ms21468380 ba6ede24-7c8a-4946-b89a-ee430ce135df stripe-verification=306FF55E0FE79A8D44DA43C555A76AD6D87668B60773E119F4E558B79E8D... cloudhealth=1b8c9785-3541-464b-af6a-ade74fc9b1f5 globalsign-domain-verification=637b76af88aae3dd060517498ca8f4e7 46zy6.x.incapdns.net google-site-verification=S0w4z5I4aSiJp311kSpLAXZ5yowVpmn92dNJ30HTXRE google-site-verification=HDwadu-OTn_948CnaOw9vmNQf8wYDcOaThtwDIMl8wE docker-verification=29f307d8-a755-4c25-bd34-a61785f73284 google-site-verification=tn2O5lUSfajEemiJ3seaJBZrfpEK3sGItRwAVNWO71s knowbe4-site-verification=f8a0eecde40ecb172ead956570d9179c globalsign-domain-verification=NaF3CvZ7nt5nRRTJudXu6YlAJfzi4pMK_qeNkqWi0b atlassian-sending-domain-verification=6dad3d05-26ed-4916-bfc1-e7fa71e42d98 globalsign-domain-verification=22D16ECCD57588EA202735485707C00A globalsign-domain-verification=8459F93764A4ADAD2034E40A1089B622 atlassian-domain-verification=QUsZX4LdPWTYZgx09JhShFot27EJnUl/5CyxXFsiGebXl2QD8F... drift-domain-verification=05dd87d9d7c282afdcb1ca4284b2d573176df1b4935b39ba193e68... _globalsign-domain-verification=trWgc15L247W7Xyco4N5M8bx2RPqEZMw_iHW5QlK-u google-site-verification=Uool69iYXsSjjBUJqrUm7YBRyVnl5_omdyxvdG5exe4 teamviewer-sso-verification=fec790dab3b04f00a1b94beeeec9a7df miro-verification=e9a62b40366ba29373bbd98c9c7ec60d5c45605c |
| CAA | Lookup not available with standard resolver |
CAA record lookup requires a specialized DNS resolver. This check will be available in a future update.
Informational: CAA (Certification Authority Authorization) records weren't checked in this scan.
ARedirect Chain1 redirect(s), 228 ms totalPASS
https://spiceworks.com
20 ms · HTTP/1.1
https://www.spiceworks.com/
208 ms · HTTP/1.1 FINAL
| # | URL | Status | Time | Protocol | Server |
|---|---|---|---|---|---|
| 1 | https://spiceworks.com | 301 | 20 ms | HTTP/1.1 | cloudflare |
| 2 | https://www.spiceworks.com/ | 200 | 208 ms | HTTP/1.1 | cloudflare |
See the visual redirect chain in the HTTP Probe tab →
A+IPv6 ReadinessIPv6 reachable (17 ms)PASS
A+Domain Intelligencespiceworks.com — via CSC Corporate Domains, Inc., 28 years, 6 months oldPASS
621 days
February 25, 2028
58 days
Issued by Google Trust Services
28 years, 6 months
Registered February 26, 1998
Not enabled
Protects against DNS spoofing
Unknown
2606:4700:4400::6812:2938
CSC Corporate Domains, Inc.
Expiry timeline
Recommended actions
- Enable DNSSEC to protect visitors from DNS spoofing
- Enable registrar lock (clientTransferProhibited) to block unauthorized domain transfers
DNSSEC protects against DNS spoofing attacks. While not required, enabling DNSSEC adds an additional layer of security. Contact your DNS provider to enable it.
Without DNSSEC, an attacker who can poison your DNS can hijack your domain — and SSL certs alone don't stop them.
Learn more ▾ ▴
DNSSEC adds cryptographic signatures to DNS records, preventing forged responses from poisoning resolver caches. Without it, an attacker who controls the network path can redirect your domain to a malicious server before any HTTPS handshake happens. Most modern registrars (Cloudflare, Google Domains, Route 53) enable it with one toggle.
Source: ICANN / RFC 4033
The domain can be transferred without an unlock step. Enable registrar lock (clientTransferProhibited) in your registrar's control panel to protect against unauthorized or accidental transfers.
Without registrar lock, an attacker who phishes your registrar credentials can transfer the domain in minutes — total brand hijack.
Learn more ▾ ▴
Registrar lock (clientTransferProhibited, clientUpdateProhibited, clientDeleteProhibited) requires extra verification before any transfer/update/delete. Every major registrar offers it free. Combined with 2FA on your registrar account, it's the strongest defense against domain hijacking.
Source: ICANN / domain-security best practice