For website owners
MyPliablesSiteScan
If you saw MyPliablesSiteScan in your server logs, a MyPliables customer asked us to check a website, usually their own or one whose design they admire. It is a one-time visit made on request, not a crawler that indexes the web.
How to recognise it
- User-agent:
MyPliablesSiteScan/1.0 (+https://mypliables.com/scan; one-time site check requested by a MyPliables customer) - Source address: requests come from our server at
5.161.36.204.
What it does
- Reads the home page and up to 5 pages linked from it (6 pages per site at most), plus up to 4 stylesheets and some of the images on those pages.
- Checks things like page speed basics, accessibility (colour contrast, labels, headings) and the site's design (colours, fonts, layout), so the customer gets an audit and design ideas.
- Waits at least a quarter of a second between requests to the same site.
What it never does
- It only makes
GETrequests. It never submits forms, logs in, sends cookies or uses credentials. - It never connects to private or internal network addresses, and checks every redirect (at most 5).
- It stops early: 10 seconds per request, 2 MB per page, 400 KB per stylesheet, 5 MB per image, and 8 MB and 60 seconds for the whole visit.
- Each MyPliables customer can check at most 12 websites an hour, and at most 3 checks run at once across our service.
How to block it
MyPliablesSiteScan reads your robots.txt before anything else and obeys it (RFC 9309), both for rules aimed at MyPliablesSiteScan and for rules aimed at all robots (*). To keep it out of your whole site, add:
User-agent: MyPliablesSiteScan
Disallow: /
If your robots.txt returns a server error (5xx) or can't be reached, MyPliablesSiteScan treats the whole site as off-limits and fetches nothing else.
Questions or problems
If you think MyPliablesSiteScan misbehaved on your site, or you want us to stop checking it, contact us and include your domain. Please include the time and the request path from your logs if you have them.