What we tested
The nine clients fall into three groups, and each group has one colour on this page. Hover over a row to highlight that client in every chart.
- Bulwark: a JMAP web app. The charts show the release; the beta is in the builds chart further down. Bulwark Lite is the same app built as static files, talking JMAP straight from the browser; the third row is that same build served by Stalwart itself.
- Third-party JMAP webmail: Stormbox.
- IMAP webmails: Roundcube 1.7, SnappyMail 2.38, Cypht, SOGo and Delivr 1.0. Delivr's browser talks to Delivr's own API server, and that server talks IMAP to the mail server.
- SquirrelMail 1.4 (2011): plain HTML pages with no JavaScript app. About as light as webmail gets.
Colour says only how a client reaches the mail server. Rows are told apart by their label, never by hue.
How long does a click take?
The bar is the median time. The thin line covers the middle half of all runs. As a rough guide, 100 ms feels instant and 1 s feels like waiting. Ignore differences under about 30 ms. Each client was tested in one session, so gaps that small can be chance.
How much does a click download?
Hollow bars are lower than normal. The test opens the same five messages again and again. SnappyMail and SOGo keep them in a local cache, so opening a message for the first time downloads more than this.
How long does login take?
Login was measured once per client. That is why these bars have no thin line.
Does a bigger mailbox slow it down?
Each bar is how much slower the action got with 1000 messages than with 100. A bar left of zero means it got faster. Hover over a row to see both times. Grey, hollow bars are changes under about 30 ms, or under 5% for an action that takes longer than about 600 ms, which is too small to mean anything. That includes clients that look slightly faster with more mail. We tested only two mailbox sizes, so this shows a difference, not a trend.
Does the Bulwark version matter?
Every release, on one mailbox
Each point is the latest patch of a minor release, oldest on the left, spaced evenly rather than by date. The line is the median and the shaded band the middle half of the runs. All versions were measured one after another against the same 1000-message mailbox, seeded once and never touched again. Only the Bulwark image changed: same server, same corpus, same browser, same driver.
Numbers per release
Times in ms: median (25th–75th percentile), with 1000 messages. Login was measured once per release.