Infrastructure - https://oilprice.com BeaverCheck Audit

D

CDN & Delivery

Action

No CDN detected

FIX

No CDN detected

A CDN can significantly improve load times for users around the world by caching content at edge nodes closer to them.

No CDN detected

Consider using a CDN to improve global delivery speed and reduce origin load.

C

IPv6 Readiness

Action

No IPv6 support

REVIEW

No IPv6 support

No IPv6 (AAAA) records found

IPv6 support is increasingly important for global accessibility. About 40% of internet users have IPv6 connectivity.

No IPv6 Support

About 40% of internet users have IPv6. Consider adding AAAA records.

IPv6 support is increasingly important for global accessibility. About 40% of internet users have IPv6 connectivity.

Why this matters

No AAAA records — same impact as 'no IPv6 (AAAA) records'; IPv6-preferring clients pay extra latency falling back to IPv4.

Source: Google IPv6 stats

B

TLS Certificate Expiry & Recommendations

135 days until leaf cert expires — 5 issues to address

REVIEW

Certificate validity

135

days left

0d 30d 60d 90d+

Recommended actions

Prefer TLS 1.3 — TLS 1.2 is acceptable but TLS 1.3 removes RSA key exchange and improves latency
Add includeSubDomains to the HSTS directive
Add the preload directive and submit to hstspreload.org once max-age + includeSubDomains are in place
Enable DNSSEC on your domain for DNS spoofing protection
Enable OCSP stapling on your TLS server to remove a CA roundtrip and protect user privacy

A+

DNS Records

3 A records, 4 ms lookup

PASS

3 A records, 4 ms lookup

Resolves to 3 IPv4 address(es)

Got: 52.15.49.175, 3.136.216.33, 3.136.79.18

No IPv6 (AAAA) records

4 nameserver(s) configured

Got: ns-1168.awsdns-18.org, ns-1547.awsdns-01.co.uk, ns-347.awsdns-43.com, ns-619.awsdns-13.net

1 mail exchanger(s) configured

CAA records not checked

CAA record lookup requires a specialized DNS resolver. This check will be available in a future update.

No SPF record found in TXT records

SPF helps prevent email spoofing. Add a TXT record starting with 'v=spf1'.

DNS resolution time: 4 ms

Got: 4 ms

A	52.15.49.175, 3.136.216.33, 3.136.79.18
AAAA	—
CNAME	—
NS	ns-1168.awsdns-18.org, ns-1547.awsdns-01.co.uk, ns-347.awsdns-43.com, ns-619.awsdns-13.net
MX	0 oilprice-com.mail.protection.outlook.com
TXT	"v=spf1 include:spfa.cpmails.com include:spf.mandrillapp.com google-site-verification=ZeRolfOZBXBRpYoGPCWq72o2kJUkeDVpUHdKwDpQFws include:servers.mcsv.net include:spf.protection.outlook.com -all"
CAA	Lookup not available with standard resolver

Resolved in 4 ms

CAA record lookup requires a specialized DNS resolver. This check will be available in a future update.

Why this matters

Informational: CAA (Certification Authority Authorization) records weren't checked in this scan.

SPF helps prevent email spoofing. Add a TXT record starting with 'v=spf1'.

Why this matters

Without SPF, receiving servers can't validate sending IPs — your domain is easier to spoof in phishing.

Learn more ▾

SPF complements DMARC. Both should be published. SPF records list authorized sending IPs (e.g., `v=spf1 include:_spf.google.com ~all` for Google Workspace). After publishing, verify in Google Postmaster Tools or mxtoolbox.

Source: RFC 7208 (SPF)

A+

Redirect Chain

No redirects — direct access

PASS

No redirects — direct access

Got: https://oilprice.com

https://oilprice.com

533 ms · HTTP/1.1 FINAL

#	URL	Status	Time	Protocol	Server
1	https://oilprice.com	200	533 ms	HTTP/1.1	Apache/2.4.66 () PHP/8.2.19

A+

Crawlability

robots.txt present, sitemap with 229 URLs

PASS

robots.txt present, sitemap with 229 URLs

robots.txt is present

Got: 7574 bytes

sitemap.xml is present

sitemap.xml is valid XML

sitemap.xml contains 229 entries

Sitemap index with 229 child sitemaps

robots.txt references sitemap

robots.txt 200 OK

Size 7574 B Sitemaps referenced 3 User-agents ClaudeBot, FacebookBot, FriendlyCrawler, ImagesiftBot, omgili, omgilibot, Timpibot, Claude-Web, ClaudeWeb, cohere-ai, Meta-ExternalAgent, Scrapy, *, Amazonbot, anthropic-ai, CCBot, Google-Extended, GPTBot, img2dataset, YouBot, Applebot-Extended, Diffbot, VelenPublicWebCrawler, Bytespider Blocking No — crawling allowed

# robots.txt

#User-agent: Mediapartners-Google
#Disallow:

#
User-agent: *
Disallow: /cgi-bin/
Disallow: /search
Disallow: /goto/
Disallow: /commodity-price-charts?1*
Disallow: /_private/
Disallow: /_vti_bin/
Disallow: /_vti_cnf/
Disallow: /_vti_log/
Disallow: /_vti_pvt/
Disallow: /_vti_txt/
Disallow: /newsletters/
Disallow: /feed/3
Disallow: /newsfeeds/redirect/
Disallow: /salestool
Disallow: /salestool/
Disallow: /articles/sponsored
Disallow: /articles/sponsored/
Disallow: /auth/*
Disallow: /account/*
Sitemap: https://oilprice.com/sitemap_index.xml
Sitemap: https://oilprice.com/sitemap.xml
Sitemap: https://oilprice.com/googlenews.xml

# Original rules for old site
Disallow: /administrator/
Disallow: /cache/
Disallow: /components/
Disallow: /component/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/
Disallow: /xmlrpc/

Disallow: /ajax/csrf
Disallow: /ajax/add_view/*
Disallow: /ajax/return_country
Disallow: /widgets/*
Disallow: /freewidgets/*
Disallow: /opc/*
Disallow: /ajax/get_banner/*
Disallow: /ajax/get_user_blends
Disallow: /ajax/add_pushcrew
Disallow: /ajax/*

#mobile usability problems
#Urgent SEO issues - please confirm receipt 15/02/2017
Disallow: /ajax/get_chart_prices/
Disallow: /commodity-widgets.php
Disallow: /iframes/barcharts
Disallow: /market-intelligence/signup_success/6
Disallow: /newwidgets.php?3
Disallow: /specialreports/8_Mega_Trends.html
Disallow: /widgets/energyproduction.html

Disallow: /*data.json$
Disallow: /*data.json?t=*

Disallow: /*last.json$
Disallow: /*last.json?t=*

Disallow: /Energy/Energy-General/The-Gas-Find-That-Could-Transform-Europes-Energy-Future.html
Disallow: /Energy/Energy-General/This-Could-Be-A-Gamechanger-For-Natural-Gas-In-Europe.html
Disallow: /Energy/Energy-General/How-To-Profit-From-Europes-800-Billion-Energy-Crisis.html
Disallow: /Energy/Energy-General/The-No1-Energy-Stock-for-2024.html
Disallow: /Energy/Energy-General/Forgotten-Gas-Reserves-Could-Be-A-Gamechanger-For-European-Energy.html
Disallow: /Energy/Energy-General/Meet-the-Man-Using-AI-To-Revive-An-Oil-Gas-Play-Supermajors-Left-For-Dead.html
Disallow: /Energy/Natural-Gas/How-Artificial-Intelligence-Could-Trigger-a-Natural-Gas-Boom-in-Europe.html


# translated category/subcategory pages which have no articles on them so have the "wrong" langugue tag
Disallow: /es/Metales/Plata/
Disallow: /ar/%D8%A7%D9%84%D9%85%D8%B9%D8%A7%D8%AF%D9%86/%D9%81%D8%B6%D8%A9/
Disallow: /fr/M%C3%A9taux/Argent/
Disallow: /zh/%E9%87%91%E5%B1%9E/%E9%93%B6%E8%89%B2/
Disallow: /jp/%E9%87%91%E5%B1%9E/%E3%82%B7%E3%83%AB%E3%83%90%E3%83%BC/
Disallow: /es/Platino/
Disallow: /ar/%D8%A7%D9%84%D8%A8%D9%84%D8%A7%D8%AA%D9%8A%D9%86/
Disallow: /fr/Le-platine/
Disallow: /zh/%E7%99%BD%E9%87%91/
Disallow: /jp/%E3%83%97%E3%83%A9%E3%83%81%E3%83%8A/
Disallow: /es/Alimentos/
Disallow: /ar/%D9%85%D9%88%D8%A7%D8%AF-%D8%BA%D8%B0%D8%A7%D8%A6%D9%8A%D8%A9/
Disallow: /fr/Denr%C3%A9es-alimentaires/
Disallow: /zh/%E9%A3%9F%E5%93%81/
Disallow: /jp/%E9%A3%9F%E6%96%99%E5%93%81-%E3%81%97%E3%82%87%E3%81%8F%E3%82%8A%E3%82%87%E3%81%86%E3%81%B2%E3%82%93/
Disallow: /es/This-translation-does-not-provide-enough-context-to-accurately-translate-Could-you-please-provide-more-information-or-clarify-the-content-youd-like-to-be-translated/
Disallow: /ar/%D8%A7%D9%84%D9%86%D8%AD%D8%A7%D8%B3/
Disallow: /fr/Cuivre/
Disallow: /zh/%E9%93%9C/
Disallow: /jp/%E9%8A%85/
Disallow: /es/Energ%C3%ADa-alternativa/Celdas-de-combustible/
Disallow: /ar/%D8%A7%D9%84%D8%B7%D8%A7%D9%82%D8%A9-%D8%A7%D9%84%D9%85%D8%AA%D8%AC%D8%AF%D8%AF%D8%A9/%D8%AE%D9%84%D8%A7%D9%8A%D8%A7-%D8%A7%D9%84%D9%88%D9%82%D9%88%D8%AF/
Disallow: /fr/%C3%89nergie-renouvelable/Piles-%C3%A0-combustible/
Disallow: /zh/%E5%8F%AF%E5%86%8D%E7%94%9F%E8%83%BD%E6%BA%90/%E7%87%83%E6%96%99%E7%94%B5%E6%B1%A0/
Disallow: /jp/%E4%BB%A3%E6%9B%BF%E3%82%A8%E3%83%8D%E3%83%AB%E3%82%AE%E3%83%BC/%E7%87%83%E6%96%99%E9%9B%BB%E6%B1%A0/
Disallow: /es/Energ%C3%ADa-alternativa/Energ%C3%ADa-Mareomotriz/
Disallow: /ar/%D8%A7%D9%84%D8%B7%D8%A7%D9%82%D8%A9-%D8%A7%D9%84%D9%85%D8%AA%D8%AC%D8%AF%D8%AF%D8%A9/%D8%B7%D8%A7%D9%82%D8%A9-%D9%85%D8%AF-%D8%A7%D9%84%D8%AA%D9%8A%D8%A7%D8%B1%D8%A7%D8%AA/
Disallow: /fr/%C3%89nergie-renouvelable/%C3%89nergie-mar%C3%A9motrice/
Disallow: /zh/%E5%8F%AF%E5%86%8D%E7%94%9F%E8%83%BD%E6%BA%90/%E6%BD%AE%E6%B1%90%E8%83%BD%E9%87%8F/
Disallow: /jp/%E4%BB%A3%E6%9B%BF%E3%82%A8%E3%83%8D%E3%83%AB%E3%82%AE%E3%83%BC/%E6%BD%AE%E5%8A%9B%E3%82%A8%E3%83%8D%E3%83%AB%E3%82%AE%E3%83%BC/
Disallow: /es/El-Medio-Ambiente/Derrames-de-petr%C3%B3leo/
Disallow: /ar/%D8%A7%D9%84%D8%A8%D9%8A%D8%A6%D8%A9/%D8%AA%D8%B3%D8%B1%D8%A8-%D8%A7%D9%84%D9%86%D9%81%D8%B7/
Disallow: /fr/LEnvironnement/D%C3%A9versements-de-p%C3%A9trole/
Disallow: /zh/%E7%8E%AF%E5%A2%83/%E7%9F%B3%E6%B2%B9%E6%B3%84%E6%BC%8F/
Disallow: /jp/%E7%92%B0%E5%A2%83-Kanky%C5%8D/%E7%9F%B3%E6%B2%B9%E6%B5%81%E5%87%BA%E4%BA%8B%E6%95%85/
Disallow: /es/Geopol%C3%ADtica/Indonesia/
Disallow: /ar/%D8%A7%D9%84%D8%AC%D8%BA%D8%B1%D8%A7%D9%81%D9%8A%D8%A7-%D8%A7%D9%84%D8%B3%D9%8A%D8%A7%D8%B3%D9%8A%D8%A9/%D8%A5%D9%86%D8%AF%D9%88%D9%86%D9%8A%D8%B3%D9%8A%D8%A7/
Disallow: /fr/G%C3%A9opolitique/LIndon%C3%A9sie/
Disallow: /zh/%E5%9C%B0%E7%BC%98%E6%94%BF%E6%B2%BB/%E5%8D%B0%E5%BA%A6%E5%B0%BC%E8%A5%BF%E4%BA%9A/
Disallow: /jp/%E5%9C%B0%E6%94%BF%E5%AD%A6/%E3%82%A4%E3%83%B3%E3%83%89%E3%83%8D%E3%82%B7%E3%82%A2/
Disallow: /es/Geopol%C3%ADtica/Am%C3%A9rica-del-Norte/
Disallow: /ar/%D8%A7%D9%84%D8%AC%D8%BA%D8%B1%D8%A7%D9%81%D9%8A%D8%A7-%D8%A7%D9%84%D8%B3%D9%8A%D8%A7%D8%B3%D9%8A%D8%A9/%D8%A3%D9%85%D8%B1%D9%8A%D9%83%D8%A7-%D8%A7%D9%84%D8%B4%D9%85%D8%A7%D9%84%D9%8A%D8%A9/
Disallow: /fr/G%C3%A9opolitique/Am%C3%A9rique-du-Nord/
Disallow: /zh/%E5%9C%B0%E7%BC%98%E6%94%BF%E6%B2%BB/%E5%8C%97%E7%BE%8E%E6%B4%B2/
Disallow: /jp/%E5%9C%B0%E6%94%BF%E5%AD%A6/%E5%8C%97%E3%82%A2%E3%83%A1%E3%83%AA%E3%82%AB/
Disallow: /es/Geopol%C3%ADtica/Sudam%C3%A9rica/
Disallow: /ar/%D8%A7%D9%84%D8%AC%D8%BA%D8%B1%D8%A7%D9%81%D9%8A%D8%A7-%D8%A7%D9%84%D8%B3%D9%8A%D8%A7%D8%B3%D9%8A%D8%A9/%D8%A3%D9%85%D8%B1%D9%8A%D9%83%D8%A7-%D8%A7%D9%84%D8%AC%D9%86%D9%88%D8%A8%D9%8A%D8%A9/
Disallow: /fr/G%C3%A9opolitique/Am%C3%A9rique-du-Sud/
Disallow: /zh/%E5%9C%B0%E7%BC%98%E6%94%BF%E6%B2%BB/%E5%8D%97%E7%BE%8E%E6%B4%B2/
Disallow: /jp/%E5%9C%B0%E6%94%BF%E5%AD%A6/%E5%8D%97%E3%82%A2%E3%83%A1%E3%83%AA%E3%82%AB/
Disallow: /es/Finanzas/Informes-de-Inversi%C3%B3n-y-Trading/
Disallow: /ar/%D8%A7%D9%84%D9%85%D8%A7%D9%84%D9%8A%D8%A9/%D8%AA%D9%82%D8%A7%D8%B1%D9%8A%D8%B1-%D8%A7%D9%84%D8%A7%D8%B3%D8%AA%D8%AB%D9%85%D8%A7%D8%B1-%D9%88%D8%A7%D9%84%D8%AA%D8%AF%D8%A7%D9%88%D9%84/
Disallow: /fr/%C3%89conomie/Rapports-sur-lInvestissement-et-le-Trading/
Disallow: /zh/%E8%B4%A2%E7%BB%8F/%E6%8A%95%E8%B5%84%E4%B8%8E%E4%BA%A4%E6%98%93%E6%8A%A5%E5%91%8A/
Disallow: /jp/%E8%B2%A1%E5%8B%99/%E6%8A%95%E8%B3%87%E3%81%A8%E5%8F%96%E5%BC%95%E3%83%AC%E3%83%9D%E3%83%BC%E3%83%88/


User-agent: Amazonbot
User-agent: anthropic-ai
User-agent: Applebot-Extended
User-agent: Bytespider
User-agent: CCBot
#User-agent: ChatGPT-User
User-agent: ClaudeBot
User-agent: Claude-Web
User-agent: ClaudeWeb
User-agent: cohere-ai
User-agent: Diffbot
User-agent: FacebookBot
User-agent: FriendlyCrawler
User-agent: Google-Extended
User-agent: GPTBot
User-agent: ImagesiftBot
User-agent: img2dataset
User-agent: Meta-ExternalAgent
#User-agent: OAI-SearchBot
User-agent: omgili
User-agent: omgilibot
#User-agent: PerplexityBot
User-agent: Scrapy
User-agent: Timpibot
User-agent: VelenPublicWebCrawler
User-agent: YouBot
Disallow: /

sitemap.xml 200 OK

Type Sitemap Index URLs 229 entries Valid XML Yes

Child Sitemaps:

A+

URL Variants

www/non-www, trailing slash, HTTP→HTTPS

PASS

www/non-www, trailing slash, HTTP→HTTPS

www/non-www redirect configured correctly (preferred: non-www)

HTTP correctly 301-redirects to HTTPS

www / non-www

301https://www.oilprice.com/

200https://oilprice.com/

Preferred variant: non-www

HTTP → HTTPS

301http://oilprice.com/ → https://oilprice.com:443/

Consistent

A+

Domain Intelligence

oilprice.com — via GoDaddy.com, LLC, 30 years, 10 months old, hosted on AWS

PASS

oilprice.com — via GoDaddy.com, LLC, 30 years, 10 months old, hosted on AWS

Domain registered until Nov 5, 2029 (3 years, 7 months remaining)

DNSSEC is not enabled

DNSSEC protects against DNS spoofing attacks. While not required, enabling DNSSEC adds an additional layer of security. Contact your DNS provider to enable it.

Registrar: GoDaddy.com, LLC

Registrar lock is NOT enabled

The domain can be transferred without an unlock step. Enable registrar lock (clientTransferProhibited) in your registrar's control panel to protect against unauthorized or accidental transfers.

Hosting: AWS

Got: AS16509

Domain expiry

1240 days

November 5, 2029

SSL certificate

135 days

Issued by Amazon

Domain age

30 years, 10 months

Registered November 6, 1995

DNSSEC

Not enabled

Protects against DNS spoofing

Hosting

AWS

ASN AS16509

52.15.49.175

Registrar

GoDaddy.com, LLC

Unlocked 2 NS records

Expiry timeline

Today

+1 year

Domain expiry SSL expiry Danger zone (≤30 days)

Recommended actions

Enable DNSSEC to protect visitors from DNS spoofing
Enable registrar lock (clientTransferProhibited) to block unauthorized domain transfers

Registrar GoDaddy.com, LLC

Created November 6, 1995 (30 years, 10 months ago)

Expires November 5, 2029 (3 years, 7 months)

Last Updated September 5, 2022

Name Servers ns-1168.awsdns-18.org, ns-1547.awsdns-01.co.uk

DNSSEC Not enabled

Hosting

IP Address 52.15.49.175

ASN AS16509 (AMAZON-02 - Amazon.com, Inc., US)

Provider AWS

Data source: rdap (0.3s)

DNSSEC protects against DNS spoofing attacks. While not required, enabling DNSSEC adds an additional layer of security. Contact your DNS provider to enable it.

Why this matters

Without DNSSEC, an attacker who can poison your DNS can hijack your domain — and SSL certs alone don't stop them.

Learn more ▾

DNSSEC adds cryptographic signatures to DNS records, preventing forged responses from poisoning resolver caches. Without it, an attacker who controls the network path can redirect your domain to a malicious server before any HTTPS handshake happens. Most modern registrars (Cloudflare, Google Domains, Route 53) enable it with one toggle.

Source: ICANN / RFC 4033

The domain can be transferred without an unlock step. Enable registrar lock (clientTransferProhibited) in your registrar's control panel to protect against unauthorized or accidental transfers.

Why this matters

Without registrar lock, an attacker who phishes your registrar credentials can transfer the domain in minutes — total brand hijack.

Learn more ▾

Registrar lock (clientTransferProhibited, clientUpdateProhibited, clientDeleteProhibited) requires extra verification before any transfer/update/delete. Every major registrar offers it free. Combined with 2FA on your registrar account, it's the strongest defense against domain hijacking.

Source: ICANN / domain-security best practice

A

HTTP Probe Timing

Total 626 ms — DNS, TCP, TLS, TTFB, content transfer breakdown

PASS

DNS Lookup

4 ms

TCP Connect

102 ms

TLS Handshake

206 ms

Time to First Byte

524 ms

Total Time

626 ms

Connection waterfall

DNS Lookup 4 ms TCP Connect 102 ms TLS Handshake 206 ms Server Processing 212 ms Content Transfer 102 ms