MapleSyrupBot

For municipal clerks, web teams and IT staff who noticed our crawler in their logs.

MapleSyrup helps businesses find upcoming public-sector projects in Canada. Our crawler reads public council and committee agendas, minutes and staff reports, then links every summary back to your original document.

How to recognise it

Requests carry this user agent:

MapleSyrupBot/0.1 (+https://maplesyrup.win/bot)

How it behaves

  • It follows your robots.txt. Disallow MapleSyrupBot and it stops.
  • It makes one request at a time per website and waits at least 2 seconds between requests.
  • It checks each portal about twice a day and only re-downloads documents from recent meetings.
  • It reads only pages published to the public. It never logs in, submits forms or guesses private URLs.
  • If a portal refuses a request (for example HTTP 403), it stops downloading that kind of file and doesn't try to get around the block. We may email to ask for permission instead.

What we keep

Agenda item titles, descriptions, motions, dates and the text of public reports, so people can search them. We don't publish the names of private residents who appear in minutes, such as delegations or correspondents.

Contact us or opt out

To slow the crawler down, exclude part of your site, or ask us to stop, email crawler@maplesyrup.win. We reply within two business days. Blocking MapleSyrupBot in robots.txt works immediately.