Infrastructure
· 9 checks — DNS, redirects, IPv6, crawlability, URL variants, and domain intelligence rolled into one auditable list.BCrawlabilityrobots.txt present, no sitemapREVIEW
A sitemap helps search engines discover and index your pages more efficiently.
No sitemap.xml — Google relies on crawl-graph discovery alone, slowing indexing of deep or fresh URLs.
Learn more ▾ ▴
A sitemap accelerates Google's discovery of new and updated content. Most CMSes auto-generate one; static-site frameworks need a build-step plugin. Reference it from robots.txt and submit in Search Console to confirm Google can fetch it.
Source: sitemaps.org / Google Search Central
Add a 'Sitemap:' directive to robots.txt so search engines can discover your sitemap.
robots.txt omits Sitemap: directive — crawlers must fetch /sitemap.xml by convention; reliable but missing the explicit hint.
Source: sitemaps.org
User-agent: *
Disallow: /ylefiroot-errors
Disallow: /cgi-bin
Disallow: /klaffi
Disallow: /java
Disallow: /player
Disallow: /errorsivut/
Disallow: /global/
Disallow: /haku/
Disallow: /eurovision/
Disallow: /embed/
Allow: /global/api/load.php
Allow: /cgi-bin/tekstitv/ttv.cgi/
# karttasovellus APla 9.7.2015
Disallow: /karttasovellus/
#ai crawling
User-agent: AI2Bot
Disallow: /
User-agent: Ai2Bot-Dolma
Disallow: /
User-agent: Amazonbot
Disallow: /
User-agent: anthropic-ai
Disallow: /
User-agent: Bytespider
Disallow: /
User-agent: CCBot
Disallow: /
User-agent: ChatGPT-User
Disallow: /
User-agent: Claude-Web
Disallow: /
User-agent: ClaudeBot
Disallow: /
User-agent: cohere-ai
Disallow: /
User-agent: cohere-training-data-crawler
Disallow: /
User-agent: Crawlspace
Disallow: /
User-agent: DeepSeek
Disallow: /
User-agent: DeepSeekBot
Disallow: /
User-agent: Diffbot
Disallow: /
User-agent: FacebookBot
Disallow: /
User-agent: FriendlyCrawler
Disallow: /
User-agent: Google-Extended
Disallow: /
User-agent: GPTBot
Disallow: /
User-agent: Grok
Disallow: /
User-agent: GrokAI
Disallow: /
User-agent: iaskspider/2.0
Disallow: /
User-agent: ICC-Crawler
Disallow: /
User-agent: img2dataset
Disallow: /
User-agent: ISSCyberRiskCrawler
Disallow: /
User-agent: Meta-ExternalAgent
Disallow: /
User-agent: omgili
Disallow: /
User-agent: omgilibot
Disallow: /
User-agent: PanguBot
Disallow: /
User-agent: PetalBot
Disallow: /
User-agent: Scrapy
Disallow: /
User-agent: Sidetrade indexer bot
Disallow: /
User-agent: Timpibot
Disallow: /
User-agent: TurnitinBot
Disallow: /
User-agent: VelenPublicWebCrawler
Disallow: /
User-agent: x.AI
Disallow: /
User-agent: xAI
Disallow: /
User-agent: YouBot
Disallow: /
No sitemap found
Adding a sitemap helps search engines discover your pages.
BTLS Certificate Expiry & Recommendations255 days until leaf cert expires — 3 issues to addressREVIEW
Certificate validity
Recommended actions
- Add includeSubDomains to the HSTS directive
- Enable DNSSEC on your domain for DNS spoofing protection
- Enable OCSP stapling on your TLS server to remove a CA roundtrip and protect user privacy
A+DNS Records4 A records, 38 ms lookupPASS
| A | 99.84.9.4, 99.84.9.43, 99.84.9.82, 99.84.9.62 |
| AAAA | 2600:9000:215b:d200:18:f677:b7c0:93a1, 2600:9000:215b:2e00:18:f677:b7c0:93a1, 2600:9000:215b:de00:18:f677:b7c0:93a1, 2600:9000:215b:8a00:18:f677:b7c0:93a1, 2600:9000:215b:6c00:18:f677:b7c0:93a1, 2600:9000:215b:ce00:18:f677:b7c0:93a1, 2600:9000:215b:ea00:18:f677:b7c0:93a1, 2600:9000:215b:b800:18:f677:b7c0:93a1 |
| CNAME | — |
| NS | ns-1882.awsdns-43.co.uk, ns-997.awsdns-60.net, ns-76.awsdns-09.com, ns-1394.awsdns-46.org |
| MX | 1 aspmx.l.google.com 5 alt1.aspmx.l.google.com 5 alt2.aspmx.l.google.com 10 alt4.aspmx.l.google.com 10 alt3.aspmx.l.google.com |
| TXT | SPF v=spf1 include:_spf.google.com include:sendgrid.net ip4:91.229.137.157 ip4:91.22... docker-verification=3ad78e7a-0128-4c58-8663-f4392ef1d734 MS=ms87337362 google-site-verification=71Rq2E-lhe2L7jfu1D-E9105ggU2QQspBPWnAr3jLnA miro-verification=f6af3190ee5f699a3794d7ac520a05b6431bd74e cursor-domain-verification-9k95c0=GkD0r2LWm5O7IRqbDgoSDZMdL anthropic-domain-verification-t1mdfb=4lsAUl1Dvht7xHYljstxV4PDA apple-domain-verification=p2FA9S4EAl9oxmeB jetbrains-domain-verification=7wnteevhuo9xo2kdioe5qt73g atlassian-domain-verification=1/zBChdxAtrmr4UAj729bQZmC/F5/4utmKPrlxa5oWUq0fGV2u... google-site-verification=QqzaDDt8v7OONKD5-Q88iphtDkkI3DyNA7XXVsS_pd8 MS=8D4C0977DAE3D8BC3999F2596F19E6E4AF215969 |
| CAA | Lookup not available with standard resolver |
CAA record lookup requires a specialized DNS resolver. This check will be available in a future update.
Informational: CAA (Certification Authority Authorization) records weren't checked in this scan.
A+Redirect ChainNo redirects — direct accessPASS
https://yle.fi
37 ms · HTTP/1.1 FINAL
| # | URL | Status | Time | Protocol | Server |
|---|---|---|---|---|---|
| 1 | https://yle.fi | 200 | 37 ms | HTTP/1.1 |
A+IPv6 ReadinessIPv6 reachable (1 ms)PASS
A+URL Variantswww/non-www, trailing slash, HTTP→HTTPSPASS
www / non-www
Preferred variant: non-www
HTTP → HTTPS
Consistent
A+Domain Intelligenceyle.fi — 35 years, 9 months oldPASS
Unknown
255 days
Issued by Amazon
35 years, 9 months
Registered January 1, 1991
Status unknown
Protects against DNS spoofing
Unknown
2600:9000:215b:ea00:18:f677:b7c0:93a1
Registrar unknown