mydossierbot
mydossierbot is the reader behind mydossier.lu. If you see it in your logs, a tenant pasted a link to one of your pages into their mydossier search to check the home against their must-haves.
Last updated 27 September 2026
How to recognise it
It identifies itself with this user agent:
mydossierbot/1.0 (+https://mydossier.lu/bot)
Its requests come from our servers at [Server IP addresses].
What it reads
- Only pages a person pasted into mydossier. It does not crawl, follow links or look for pages on its own.
- Each page once, when it is pasted. If another tenant pastes the same address within 24 hours, we reuse what we read instead of asking again.
- HTML pages only, up to 3 MB, with a 15-second time limit.
What it keeps
Only the key facts of the listing (rent, charges, size, rooms, commune, availability, features and money terms) plus the link. It never stores the page, the description text or the photos, and never republishes them.
How it behaves
- It follows your robots.txt, which it reads at most once a day per site, and the
X-Robots-Tagheader. - It takes no for an answer. If a page asks for a login, refuses access, asks it to slow down or shows a challenge (401, 403, 429 or a CAPTCHA), it stops and does not try again.
- It uses no proxies, no headless browsers and no tricks to look like a person. It retries once, and only when the network fails.
How to block it
To stop mydossierbot from reading your site, add this to your robots.txt:
User-agent: mydossierbot Disallow: /
The tenant then sees that we couldn’t read the page, and can still open the listing on your website.
Questions
Write to hello@mydossier.lu. Tell us the domain and, if you can, the time of the request.