Summary
- HTTP status
- 200
- IP address
- 13.227.231.20, 13.227.231.112, 13.227.231.17, 13.227.231.22, 2600:9000:2035:b000:12:c43c:aa80:93a1, 2600:9000:2035:f800:12:c43c:aa80:93a1, 2600:9000:2035:c600:12:c43c:aa80:93a1, 2600:9000:2035:3600:12:c43c:aa80:93a1, 2600:9000:2035:f400:12:c43c:aa80:93a1, 2600:9000:2035:6200:12:c43c:aa80:93a1, 2600:9000:2035:3c00:12:c43c:aa80:93a1, 2600:9000:2035:f200:12:c43c:aa80:93a1
- ASN
- —
- Hosting provider
- Amazon Technologies Inc.
- Country
- US
- Title
- Crawlee · Build reliable crawlers. Fast.
- Description
- Crawlee helps you build and maintain your crawlers. It's open source, but built by developers who scrape millions of pages every day for a living.
- Language
- en
- Server
- nginx
- Generator
- Docusaurus v3.10.2
- Certificate
- ValidAmazon
- Sitemap
- Present
- Domain name
- crawlee.dev
SSL/TLS certificate
The SSL/TLS certificate encrypts exchanges between visitors and the website (HTTPS) and proves its identity. It is issued by a certificate authority after a more or less thorough check: of the domain name only (DV), of the organization that owns it (OV), or extended validation (EV).
- Certificate authority
- Amazon (Amazon RSA 2048 M04)
- Validation type
- Domain validation (DV)
- Status
- Valid
- Covered domains
- *.crawlee.dev, crawlee.dev
- Valid from
- May 4, 2026
- Valid until
- November 18, 2026 (expires in 46 days)
- Protocol
- TLSv1.3
- Key
- RSA 2048 bits
Sitemap
A sitemap lists the pages of a website to help search engines discover them. It can have any name when it is declared in the robots.txt file.
The robots.txt file declares 2 sitemaps.
| File | Content | Last modified |
|---|---|---|
| https://crawlee.dev/sitemap.xml | 3,864 pages | — |
| https://crawlee.dev/python/sitemap.xml | 982 pages | — |
Redirects
The website address does not redirect.
Outgoing links
The home page links to 1 other website.