Python MQTT clients, measured by what can be checked

8 client libraries against one Mosquitto on one machine. Every rate is a count the broker's $SYS counters and a neutral C peer confirm; every cost is read from /proc from outside the client. Tables sort best first; click a value to unfold the raw counts and checks of each run. Only valid runs enter a value.

Machine: Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz, 4 cores, governor performance
Broker: eclipse-mosquitto:2.1.2-alpine, one core
Broker C→C ceiling: 78,749 msgs/s
Runs: 3 per point, 8.0 s window, clients interleaved
Harness floor: ≤ 537 ns per message
Date: 2026-09-30T22:07:27Z

How fast can each client publish?

Messages per second the C subscriber received, 256-byte payloads. QoS 1 keeps 64 publishes in flight and counts a message once its PUBACK is back. “≥” marks a rate at which the broker saturated first: the client's own capacity is at least that.

client

QoS 0
msgs/s ↑

QoS 1
msgs/s ↑

QoS 1 CPU / msg ↓

mqttium 1.1.0 asyncio

≥ 77,947broker bound

run 1 · valid broker bound

client sent	791,512
client completed	791,512
broker received ($SYS)	791,512
broker sent ($SYS)	791,512
C sink received	791,512
in window: sent / delivered	621621 / 623965
CPU user / sys per msg	12.7 µs / 0.2 µs
CPU (share of a core)	100.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 791512 from the client; client sent 791512, completed 791512
broker_confirms_deliveries: broker sent 791512; peer received 791512
payloads_intact: 0 of 791512 payloads had an unexpected length
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid broker bound

client sent	790,871
client completed	790,871
broker received ($SYS)	790,871
broker sent ($SYS)	790,871
C sink received	790,871
in window: sent / delivered	617653 / 619881
CPU user / sys per msg	12.8 µs / 0.2 µs
CPU (share of a core)	100.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 790871 from the client; client sent 790871, completed 790871
broker_confirms_deliveries: broker sent 790871; peer received 790871
payloads_intact: 0 of 790871 payloads had an unexpected length
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid broker bound

client sent	799,807
client completed	799,807
broker received ($SYS)	799,807
broker sent ($SYS)	799,807
C sink received	799,807
in window: sent / delivered	631068 / 627384
CPU user / sys per msg	12.5 µs / 0.2 µs
CPU (share of a core)	99.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 799807 from the client; client sent 799807, completed 799807
broker_confirms_deliveries: broker sent 799807; peer received 799807
payloads_intact: 0 of 799807 payloads had an unexpected length
host_quiet: 0.14 cores busy outside the client, peer and broker

26,875

run 1 · valid

client sent	268,505
client completed	268,505
broker received ($SYS)	268,505
broker sent ($SYS)	268,505
C sink received	268,505
in window: sent / delivered	214997 / 215000
CPU user / sys per msg	35.4 µs / 1.7 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 268505 from the client; client sent 268505, completed 268505
broker_confirms_deliveries: broker sent 268505; peer received 268505
no_loss: client saw 268505 completions; peer received 268505
payloads_intact: 0 of 268505 payloads had an unexpected length
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

client sent	269,528
client completed	269,528
broker received ($SYS)	269,528
broker sent ($SYS)	269,528
C sink received	269,528
in window: sent / delivered	215377 / 215388
CPU user / sys per msg	35.5 µs / 1.6 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 269528 from the client; client sent 269528, completed 269528
broker_confirms_deliveries: broker sent 269528; peer received 269528
no_loss: client saw 269528 completions; peer received 269528
payloads_intact: 0 of 269528 payloads had an unexpected length
host_quiet: 0.22 cores busy outside the client, peer and broker

run 3 · valid

client sent	267,791
client completed	267,791
broker received ($SYS)	267,791
broker sent ($SYS)	267,791
C sink received	267,791
in window: sent / delivered	214340 / 214293
CPU user / sys per msg	35.5 µs / 1.8 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 267791 from the client; client sent 267791, completed 267791
broker_confirms_deliveries: broker sent 267791; peer received 267791
no_loss: client saw 267791 completions; peer received 267791
payloads_intact: 0 of 267791 payloads had an unexpected length
host_quiet: 0.18 cores busy outside the client, peer and broker

37.2 µs

run 1 · valid

client sent	268,505
client completed	268,505
broker received ($SYS)	268,505
broker sent ($SYS)	268,505
C sink received	268,505
in window: sent / delivered	214997 / 215000
CPU user / sys per msg	35.4 µs / 1.7 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 268505 from the client; client sent 268505, completed 268505
broker_confirms_deliveries: broker sent 268505; peer received 268505
no_loss: client saw 268505 completions; peer received 268505
payloads_intact: 0 of 268505 payloads had an unexpected length
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

client sent	269,528
client completed	269,528
broker received ($SYS)	269,528
broker sent ($SYS)	269,528
C sink received	269,528
in window: sent / delivered	215377 / 215388
CPU user / sys per msg	35.5 µs / 1.6 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 269528 from the client; client sent 269528, completed 269528
broker_confirms_deliveries: broker sent 269528; peer received 269528
no_loss: client saw 269528 completions; peer received 269528
payloads_intact: 0 of 269528 payloads had an unexpected length
host_quiet: 0.22 cores busy outside the client, peer and broker

run 3 · valid

client sent	267,791
client completed	267,791
broker received ($SYS)	267,791
broker sent ($SYS)	267,791
C sink received	267,791
in window: sent / delivered	214340 / 214293
CPU user / sys per msg	35.5 µs / 1.8 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 267791 from the client; client sent 267791, completed 267791
broker_confirms_deliveries: broker sent 267791; peer received 267791
no_loss: client saw 267791 completions; peer received 267791
payloads_intact: 0 of 267791 payloads had an unexpected length
host_quiet: 0.18 cores busy outside the client, peer and broker

gmqtt 0.7.0 asyncio

≥ 44,644broker bound

run 1 · valid

client sent	445,184
client completed	445,184
broker received ($SYS)	445,184
broker sent ($SYS)	445,184
C sink received	445,184
in window: sent / delivered	357153 / 357154
CPU user / sys per msg	12.4 µs / 10.0 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 445184 from the client; client sent 445184, completed 445184
broker_confirms_deliveries: broker sent 445184; peer received 445184
payloads_intact: 0 of 445184 payloads had an unexpected length
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid broker bound

client sent	488,320
client completed	488,320
broker received ($SYS)	488,320
broker sent ($SYS)	488,320
C sink received	488,320
in window: sent / delivered	393208 / 393208
CPU user / sys per msg	12.0 µs / 8.4 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 488320 from the client; client sent 488320, completed 488320
broker_confirms_deliveries: broker sent 488320; peer received 488320
payloads_intact: 0 of 488320 payloads had an unexpected length
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

client sent	438,336
client completed	438,336
broker received ($SYS)	438,336
broker sent ($SYS)	438,336
C sink received	438,336
in window: sent / delivered	350281 / 350282
CPU user / sys per msg	12.5 µs / 10.4 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 438336 from the client; client sent 438336, completed 438336
broker_confirms_deliveries: broker sent 438336; peer received 438336
payloads_intact: 0 of 438336 payloads had an unexpected length
host_quiet: 0.17 cores busy outside the client, peer and broker

24,757

run 1 · valid

client sent	246,509
client completed	246,509
broker received ($SYS)	246,509
broker sent ($SYS)	246,509
C sink received	246,509
in window: sent / delivered	198169 / 198134
CPU user / sys per msg	31.3 µs / 9.1 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 246509 from the client; client sent 246509, completed 246509
broker_confirms_deliveries: broker sent 246509; peer received 246509
no_loss: client saw 246509 completions; peer received 246509
payloads_intact: 0 of 246509 payloads had an unexpected length
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	245,570
client completed	245,570
broker received ($SYS)	245,570
broker sent ($SYS)	245,570
C sink received	245,570
in window: sent / delivered	197522 / 197523
CPU user / sys per msg	31.0 µs / 9.6 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 245570 from the client; client sent 245570, completed 245570
broker_confirms_deliveries: broker sent 245570; peer received 245570
no_loss: client saw 245570 completions; peer received 245570
payloads_intact: 0 of 245570 payloads had an unexpected length
host_quiet: 0.22 cores busy outside the client, peer and broker

run 3 · valid

client sent	246,943
client completed	246,943
broker received ($SYS)	246,943
broker sent ($SYS)	246,943
C sink received	246,943
in window: sent / delivered	198560 / 198560
CPU user / sys per msg	30.7 µs / 9.6 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 246943 from the client; client sent 246943, completed 246943
broker_confirms_deliveries: broker sent 246943; peer received 246943
no_loss: client saw 246943 completions; peer received 246943
payloads_intact: 0 of 246943 payloads had an unexpected length
host_quiet: 0.20 cores busy outside the client, peer and broker

40.4 µs

run 1 · valid

client sent	246,509
client completed	246,509
broker received ($SYS)	246,509
broker sent ($SYS)	246,509
C sink received	246,509
in window: sent / delivered	198169 / 198134
CPU user / sys per msg	31.3 µs / 9.1 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 246509 from the client; client sent 246509, completed 246509
broker_confirms_deliveries: broker sent 246509; peer received 246509
no_loss: client saw 246509 completions; peer received 246509
payloads_intact: 0 of 246509 payloads had an unexpected length
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	245,570
client completed	245,570
broker received ($SYS)	245,570
broker sent ($SYS)	245,570
C sink received	245,570
in window: sent / delivered	197522 / 197523
CPU user / sys per msg	31.0 µs / 9.6 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 245570 from the client; client sent 245570, completed 245570
broker_confirms_deliveries: broker sent 245570; peer received 245570
no_loss: client saw 245570 completions; peer received 245570
payloads_intact: 0 of 245570 payloads had an unexpected length
host_quiet: 0.22 cores busy outside the client, peer and broker

run 3 · valid

client sent	246,943
client completed	246,943
broker received ($SYS)	246,943
broker sent ($SYS)	246,943
C sink received	246,943
in window: sent / delivered	198560 / 198560
CPU user / sys per msg	30.7 µs / 9.6 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 246943 from the client; client sent 246943, completed 246943
broker_confirms_deliveries: broker sent 246943; peer received 246943
no_loss: client saw 246943 completions; peer received 246943
payloads_intact: 0 of 246943 payloads had an unexpected length
host_quiet: 0.20 cores busy outside the client, peer and broker

zmqtt 0.2.4 asyncio experimental

27,753

run 1 · valid

client sent	278,048
client completed	278,048
broker received ($SYS)	278,048
broker sent ($SYS)	278,048
C sink received	278,048
in window: sent / delivered	222022 / 222023
CPU user / sys per msg	25.9 µs / 10.1 µs
CPU (share of a core)	100.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 278048 from the client; client sent 278048, completed 278048
broker_confirms_deliveries: broker sent 278048; peer received 278048
payloads_intact: 0 of 278048 payloads had an unexpected length
host_quiet: 0.16 cores busy outside the client, peer and broker

run 2 · valid

client sent	279,482
client completed	279,482
broker received ($SYS)	279,482
broker sent ($SYS)	279,482
C sink received	279,482
in window: sent / delivered	222407 / 222408
CPU user / sys per msg	25.7 µs / 10.3 µs
CPU (share of a core)	100.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 279482 from the client; client sent 279482, completed 279482
broker_confirms_deliveries: broker sent 279482; peer received 279482
payloads_intact: 0 of 279482 payloads had an unexpected length
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	271,728
client completed	271,728
broker received ($SYS)	271,728
broker sent ($SYS)	271,728
C sink received	271,728
in window: sent / delivered	217448 / 217448
CPU user / sys per msg	26.4 µs / 10.3 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 271728 from the client; client sent 271728, completed 271728
broker_confirms_deliveries: broker sent 271728; peer received 271728
payloads_intact: 0 of 271728 payloads had an unexpected length
host_quiet: 0.18 cores busy outside the client, peer and broker

18,248

run 1 · valid

client sent	182,473
client completed	182,473
broker received ($SYS)	182,473
broker sent ($SYS)	182,473
C sink received	182,473
in window: sent / delivered	145994 / 145982
CPU user / sys per msg	42.9 µs / 11.8 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 182473 from the client; client sent 182473, completed 182473
broker_confirms_deliveries: broker sent 182473; peer received 182473
no_loss: client saw 182473 completions; peer received 182473
payloads_intact: 0 of 182473 payloads had an unexpected length
host_quiet: 0.16 cores busy outside the client, peer and broker

run 2 · valid

client sent	182,959
client completed	182,959
broker received ($SYS)	182,959
broker sent ($SYS)	182,959
C sink received	182,959
in window: sent / delivered	146347 / 146315
CPU user / sys per msg	43.3 µs / 11.4 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 182959 from the client; client sent 182959, completed 182959
broker_confirms_deliveries: broker sent 182959; peer received 182959
no_loss: client saw 182959 completions; peer received 182959
payloads_intact: 0 of 182959 payloads had an unexpected length
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	182,009
client completed	182,009
broker received ($SYS)	182,009
broker sent ($SYS)	182,009
C sink received	182,009
in window: sent / delivered	145720 / 145719
CPU user / sys per msg	44.1 µs / 10.8 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 182009 from the client; client sent 182009, completed 182009
broker_confirms_deliveries: broker sent 182009; peer received 182009
no_loss: client saw 182009 completions; peer received 182009
payloads_intact: 0 of 182009 payloads had an unexpected length
host_quiet: 0.18 cores busy outside the client, peer and broker

54.8 µs

run 1 · valid

client sent	182,473
client completed	182,473
broker received ($SYS)	182,473
broker sent ($SYS)	182,473
C sink received	182,473
in window: sent / delivered	145994 / 145982
CPU user / sys per msg	42.9 µs / 11.8 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 182473 from the client; client sent 182473, completed 182473
broker_confirms_deliveries: broker sent 182473; peer received 182473
no_loss: client saw 182473 completions; peer received 182473
payloads_intact: 0 of 182473 payloads had an unexpected length
host_quiet: 0.16 cores busy outside the client, peer and broker

run 2 · valid

client sent	182,959
client completed	182,959
broker received ($SYS)	182,959
broker sent ($SYS)	182,959
C sink received	182,959
in window: sent / delivered	146347 / 146315
CPU user / sys per msg	43.3 µs / 11.4 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 182959 from the client; client sent 182959, completed 182959
broker_confirms_deliveries: broker sent 182959; peer received 182959
no_loss: client saw 182959 completions; peer received 182959
payloads_intact: 0 of 182959 payloads had an unexpected length
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	182,009
client completed	182,009
broker received ($SYS)	182,009
broker sent ($SYS)	182,009
C sink received	182,009
in window: sent / delivered	145720 / 145719
CPU user / sys per msg	44.1 µs / 10.8 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 182009 from the client; client sent 182009, completed 182009
broker_confirms_deliveries: broker sent 182009; peer received 182009
no_loss: client saw 182009 completions; peer received 182009
payloads_intact: 0 of 182009 payloads had an unexpected length
host_quiet: 0.18 cores busy outside the client, peer and broker

awscrt 0.37.0 crt_event_loop native

16,456

run 1 · valid

client sent	163,478
client completed	163,478
broker received ($SYS)	163,478
broker sent ($SYS)	163,478
C sink received	163,478
in window: sent / delivered	130723 / 130721
CPU user / sys per msg	45.8 µs / 32.1 µs
CPU (share of a core)	127.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 163478 from the client; client sent 163478, completed 163478
broker_confirms_deliveries: broker sent 163478; peer received 163478
payloads_intact: 0 of 163478 payloads had an unexpected length
host_quiet: 0.08 cores busy outside the client, peer and broker

run 2 · valid

client sent	165,178
client completed	165,178
broker received ($SYS)	165,178
broker sent ($SYS)	165,178
C sink received	165,178
in window: sent / delivered	132226 / 132045
CPU user / sys per msg	45.1 µs / 31.8 µs
CPU (share of a core)	127.2 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 165178 from the client; client sent 165178, completed 165178
broker_confirms_deliveries: broker sent 165178; peer received 165178
payloads_intact: 0 of 165178 payloads had an unexpected length
host_quiet: 0.08 cores busy outside the client, peer and broker

run 3 · valid

client sent	164,648
client completed	164,648
broker received ($SYS)	164,648
broker sent ($SYS)	164,648
C sink received	164,648
in window: sent / delivered	131690 / 131650
CPU user / sys per msg	45.9 µs / 31.4 µs
CPU (share of a core)	127.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 164648 from the client; client sent 164648, completed 164648
broker_confirms_deliveries: broker sent 164648; peer received 164648
payloads_intact: 0 of 164648 payloads had an unexpected length
host_quiet: 0.08 cores busy outside the client, peer and broker

24,420

run 1 · valid

client sent	245,493
client completed	245,493
broker received ($SYS)	245,493
broker sent ($SYS)	245,493
C sink received	245,493
in window: sent / delivered	196394 / 196378
CPU user / sys per msg	31.2 µs / 21.8 µs
CPU (share of a core)	130.2 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 245493 from the client; client sent 245493, completed 245493
broker_confirms_deliveries: broker sent 245493; peer received 245493
no_loss: client saw 245493 completions; peer received 245493
payloads_intact: 0 of 245493 payloads had an unexpected length
host_quiet: 0.14 cores busy outside the client, peer and broker

run 2 · valid

client sent	244,152
client completed	244,152
broker received ($SYS)	244,152
broker sent ($SYS)	244,152
C sink received	244,152
in window: sent / delivered	195140 / 195145
CPU user / sys per msg	31.3 µs / 22.0 µs
CPU (share of a core)	130.0 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 244152 from the client; client sent 244152, completed 244152
broker_confirms_deliveries: broker sent 244152; peer received 244152
no_loss: client saw 244152 completions; peer received 244152
payloads_intact: 0 of 244152 payloads had an unexpected length
host_quiet: 0.13 cores busy outside the client, peer and broker

run 3 · valid

client sent	244,315
client completed	244,315
broker received ($SYS)	244,315
broker sent ($SYS)	244,315
C sink received	244,315
in window: sent / delivered	195334 / 195344
CPU user / sys per msg	31.4 µs / 21.9 µs
CPU (share of a core)	130.0 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 244315 from the client; client sent 244315, completed 244315
broker_confirms_deliveries: broker sent 244315; peer received 244315
no_loss: client saw 244315 completions; peer received 244315
payloads_intact: 0 of 244315 payloads had an unexpected length
host_quiet: 0.14 cores busy outside the client, peer and broker

53.2 µs

run 1 · valid

client sent	245,493
client completed	245,493
broker received ($SYS)	245,493
broker sent ($SYS)	245,493
C sink received	245,493
in window: sent / delivered	196394 / 196378
CPU user / sys per msg	31.2 µs / 21.8 µs
CPU (share of a core)	130.2 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 245493 from the client; client sent 245493, completed 245493
broker_confirms_deliveries: broker sent 245493; peer received 245493
no_loss: client saw 245493 completions; peer received 245493
payloads_intact: 0 of 245493 payloads had an unexpected length
host_quiet: 0.14 cores busy outside the client, peer and broker

run 2 · valid

client sent	244,152
client completed	244,152
broker received ($SYS)	244,152
broker sent ($SYS)	244,152
C sink received	244,152
in window: sent / delivered	195140 / 195145
CPU user / sys per msg	31.3 µs / 22.0 µs
CPU (share of a core)	130.0 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 244152 from the client; client sent 244152, completed 244152
broker_confirms_deliveries: broker sent 244152; peer received 244152
no_loss: client saw 244152 completions; peer received 244152
payloads_intact: 0 of 244152 payloads had an unexpected length
host_quiet: 0.13 cores busy outside the client, peer and broker

run 3 · valid

client sent	244,315
client completed	244,315
broker received ($SYS)	244,315
broker sent ($SYS)	244,315
C sink received	244,315
in window: sent / delivered	195334 / 195344
CPU user / sys per msg	31.4 µs / 21.9 µs
CPU (share of a core)	130.0 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 244315 from the client; client sent 244315, completed 244315
broker_confirms_deliveries: broker sent 244315; peer received 244315
no_loss: client saw 244315 completions; peer received 244315
payloads_intact: 0 of 244315 payloads had an unexpected length
host_quiet: 0.14 cores busy outside the client, peer and broker

paho 2.1.0 sync

12,609

run 1 · valid

client sent	125,725
client completed	125,725
broker received ($SYS)	125,725
broker sent ($SYS)	125,725
C sink received	125,725
in window: sent / delivered	100492 / 100492
CPU user / sys per msg	73.2 µs / 36.5 µs
CPU (share of a core)	137.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 125725 from the client; client sent 125725, completed 125725
broker_confirms_deliveries: broker sent 125725; peer received 125725
payloads_intact: 0 of 125725 payloads had an unexpected length
host_quiet: 0.08 cores busy outside the client, peer and broker

run 2 · valid

client sent	126,154
client completed	126,154
broker received ($SYS)	126,154
broker sent ($SYS)	126,154
C sink received	126,154
in window: sent / delivered	100905 / 100906
CPU user / sys per msg	72.6 µs / 36.7 µs
CPU (share of a core)	137.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 126154 from the client; client sent 126154, completed 126154
broker_confirms_deliveries: broker sent 126154; peer received 126154
payloads_intact: 0 of 126154 payloads had an unexpected length
host_quiet: 0.08 cores busy outside the client, peer and broker

run 3 · valid

client sent	125,937
client completed	125,937
broker received ($SYS)	125,937
broker sent ($SYS)	125,937
C sink received	125,937
in window: sent / delivered	100870 / 100870
CPU user / sys per msg	73.0 µs / 36.2 µs
CPU (share of a core)	137.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 125937 from the client; client sent 125937, completed 125937
broker_confirms_deliveries: broker sent 125937; peer received 125937
payloads_intact: 0 of 125937 payloads had an unexpected length
host_quiet: 0.06 cores busy outside the client, peer and broker

10,891

run 1 · valid

client sent	111,420
client completed	111,420
broker received ($SYS)	111,420
broker sent ($SYS)	111,420
C sink received	111,420
in window: sent / delivered	89163 / 89173
CPU user / sys per msg	80.3 µs / 29.0 µs
CPU (share of a core)	122.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 111420 from the client; client sent 111420, completed 111420
broker_confirms_deliveries: broker sent 111420; peer received 111420
no_loss: client saw 111420 completions; peer received 111420
payloads_intact: 0 of 111420 payloads had an unexpected length
host_quiet: 0.10 cores busy outside the client, peer and broker

run 2 · valid

client sent	109,123
client completed	109,123
broker received ($SYS)	109,123
broker sent ($SYS)	109,123
C sink received	109,123
in window: sent / delivered	87140 / 87127
CPU user / sys per msg	82.5 µs / 29.0 µs
CPU (share of a core)	121.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 109123 from the client; client sent 109123, completed 109123
broker_confirms_deliveries: broker sent 109123; peer received 109123
no_loss: client saw 109123 completions; peer received 109123
payloads_intact: 0 of 109123 payloads had an unexpected length
host_quiet: 0.10 cores busy outside the client, peer and broker

run 3 · valid

client sent	108,873
client completed	108,873
broker received ($SYS)	108,873
broker sent ($SYS)	108,873
C sink received	108,873
in window: sent / delivered	86995 / 87042
CPU user / sys per msg	82.4 µs / 29.3 µs
CPU (share of a core)	121.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 108873 from the client; client sent 108873, completed 108873
broker_confirms_deliveries: broker sent 108873; peer received 108873
no_loss: client saw 108873 completions; peer received 108873
payloads_intact: 0 of 108873 payloads had an unexpected length
host_quiet: 0.11 cores busy outside the client, peer and broker

112 µs

run 1 · valid

client sent	111,420
client completed	111,420
broker received ($SYS)	111,420
broker sent ($SYS)	111,420
C sink received	111,420
in window: sent / delivered	89163 / 89173
CPU user / sys per msg	80.3 µs / 29.0 µs
CPU (share of a core)	122.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 111420 from the client; client sent 111420, completed 111420
broker_confirms_deliveries: broker sent 111420; peer received 111420
no_loss: client saw 111420 completions; peer received 111420
payloads_intact: 0 of 111420 payloads had an unexpected length
host_quiet: 0.10 cores busy outside the client, peer and broker

run 2 · valid

client sent	109,123
client completed	109,123
broker received ($SYS)	109,123
broker sent ($SYS)	109,123
C sink received	109,123
in window: sent / delivered	87140 / 87127
CPU user / sys per msg	82.5 µs / 29.0 µs
CPU (share of a core)	121.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 109123 from the client; client sent 109123, completed 109123
broker_confirms_deliveries: broker sent 109123; peer received 109123
no_loss: client saw 109123 completions; peer received 109123
payloads_intact: 0 of 109123 payloads had an unexpected length
host_quiet: 0.10 cores busy outside the client, peer and broker

run 3 · valid

client sent	108,873
client completed	108,873
broker received ($SYS)	108,873
broker sent ($SYS)	108,873
C sink received	108,873
in window: sent / delivered	86995 / 87042
CPU user / sys per msg	82.4 µs / 29.3 µs
CPU (share of a core)	121.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 108873 from the client; client sent 108873, completed 108873
broker_confirms_deliveries: broker sent 108873; peer received 108873
no_loss: client saw 108873 completions; peer received 108873
payloads_intact: 0 of 108873 payloads had an unexpected length
host_quiet: 0.11 cores busy outside the client, peer and broker

aiomqtt 2.5.1 asyncio

12,461

run 1 · valid

client sent	123,648
client completed	123,648
broker received ($SYS)	123,648
broker sent ($SYS)	123,648
C sink received	123,648
in window: sent / delivered	99648 / 99665
CPU user / sys per msg	69.7 µs / 10.5 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 123648 from the client; client sent 123648, completed 123648
broker_confirms_deliveries: broker sent 123648; peer received 123648
payloads_intact: 0 of 123648 payloads had an unexpected length
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	125,312
client completed	125,312
broker received ($SYS)	125,312
broker sent ($SYS)	125,312
C sink received	125,312
in window: sent / delivered	100416 / 100343
CPU user / sys per msg	69.1 µs / 10.5 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 125312 from the client; client sent 125312, completed 125312
broker_confirms_deliveries: broker sent 125312; peer received 125312
payloads_intact: 0 of 125312 payloads had an unexpected length
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	122,944
client completed	122,944
broker received ($SYS)	122,944
broker sent ($SYS)	122,944
C sink received	122,944
in window: sent / delivered	98304 / 98360
CPU user / sys per msg	68.6 µs / 12.7 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 122944 from the client; client sent 122944, completed 122944
broker_confirms_deliveries: broker sent 122944; peer received 122944
payloads_intact: 0 of 122944 payloads had an unexpected length
host_quiet: 0.15 cores busy outside the client, peer and broker

10,812

run 1 · valid

client sent	108,992
client completed	108,992
broker received ($SYS)	108,992
broker sent ($SYS)	108,992
C sink received	108,992
in window: sent / delivered	87104 / 87104
CPU user / sys per msg	82.2 µs / 9.6 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 108992 from the client; client sent 108992, completed 108992
broker_confirms_deliveries: broker sent 108992; peer received 108992
no_loss: client saw 108992 completions; peer received 108992
payloads_intact: 0 of 108992 payloads had an unexpected length
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	106,880
client completed	106,880
broker received ($SYS)	106,880
broker sent ($SYS)	106,880
C sink received	106,880
in window: sent / delivered	85632 / 85639
CPU user / sys per msg	83.8 µs / 9.6 µs
CPU (share of a core)	100.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 106880 from the client; client sent 106880, completed 106880
broker_confirms_deliveries: broker sent 106880; peer received 106880
no_loss: client saw 106880 completions; peer received 106880
payloads_intact: 0 of 106880 payloads had an unexpected length
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	108,160
client completed	108,160
broker received ($SYS)	108,160
broker sent ($SYS)	108,160
C sink received	108,160
in window: sent / delivered	86464 / 86496
CPU user / sys per msg	82.7 µs / 9.6 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 108160 from the client; client sent 108160, completed 108160
broker_confirms_deliveries: broker sent 108160; peer received 108160
no_loss: client saw 108160 completions; peer received 108160
payloads_intact: 0 of 108160 payloads had an unexpected length
host_quiet: 0.18 cores busy outside the client, peer and broker

92.4 µs

run 1 · valid

client sent	108,992
client completed	108,992
broker received ($SYS)	108,992
broker sent ($SYS)	108,992
C sink received	108,992
in window: sent / delivered	87104 / 87104
CPU user / sys per msg	82.2 µs / 9.6 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 108992 from the client; client sent 108992, completed 108992
broker_confirms_deliveries: broker sent 108992; peer received 108992
no_loss: client saw 108992 completions; peer received 108992
payloads_intact: 0 of 108992 payloads had an unexpected length
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	106,880
client completed	106,880
broker received ($SYS)	106,880
broker sent ($SYS)	106,880
C sink received	106,880
in window: sent / delivered	85632 / 85639
CPU user / sys per msg	83.8 µs / 9.6 µs
CPU (share of a core)	100.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 106880 from the client; client sent 106880, completed 106880
broker_confirms_deliveries: broker sent 106880; peer received 106880
no_loss: client saw 106880 completions; peer received 106880
payloads_intact: 0 of 106880 payloads had an unexpected length
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	108,160
client completed	108,160
broker received ($SYS)	108,160
broker sent ($SYS)	108,160
C sink received	108,160
in window: sent / delivered	86464 / 86496
CPU user / sys per msg	82.7 µs / 9.6 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 108160 from the client; client sent 108160, completed 108160
broker_confirms_deliveries: broker sent 108160; peer received 108160
no_loss: client saw 108160 completions; peer received 108160
payloads_intact: 0 of 108160 payloads had an unexpected length
host_quiet: 0.18 cores busy outside the client, peer and broker

amqtt 0.12.1 asyncio

11,876

run 1 · valid

client sent	120,320
client completed	120,320
broker received ($SYS)	120,320
broker sent ($SYS)	120,320
C sink received	120,320
in window: sent / delivered	92527 / 92524
CPU user / sys per msg	74.0 µs / 12.3 µs
CPU (share of a core)	102.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 120320 from the client; client sent 120320, completed 120320
broker_confirms_deliveries: broker sent 120320; peer received 120320
payloads_intact: 0 of 120320 payloads had an unexpected length
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	121,106
client completed	121,106
broker received ($SYS)	121,106
broker sent ($SYS)	121,106
C sink received	121,106
in window: sent / delivered	93313 / 93310
CPU user / sys per msg	73.3 µs / 12.3 µs
CPU (share of a core)	101.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 121106 from the client; client sent 121106, completed 121106
broker_confirms_deliveries: broker sent 121106; peer received 121106
payloads_intact: 0 of 121106 payloads had an unexpected length
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	121,384
client completed	121,384
broker received ($SYS)	121,384
broker sent ($SYS)	121,384
C sink received	121,384
in window: sent / delivered	93591 / 93588
CPU user / sys per msg	72.3 µs / 13.1 µs
CPU (share of a core)	102.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 121384 from the client; client sent 121384, completed 121384
broker_confirms_deliveries: broker sent 121384; peer received 121384
payloads_intact: 0 of 121384 payloads had an unexpected length
host_quiet: 0.18 cores busy outside the client, peer and broker

8,779

run 1 · valid

client sent	87,983
client completed	87,983
broker received ($SYS)	87,983
broker sent ($SYS)	87,983
C sink received	87,983
in window: sent / delivered	70241 / 70242
CPU user / sys per msg	101 µs / 12.4 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 87983 from the client; client sent 87983, completed 87983
broker_confirms_deliveries: broker sent 87983; peer received 87983
no_loss: client saw 87983 completions; peer received 87983
payloads_intact: 0 of 87983 payloads had an unexpected length
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	88,319
client completed	88,319
broker received ($SYS)	88,319
broker sent ($SYS)	88,319
C sink received	88,319
in window: sent / delivered	70921 / 70922
CPU user / sys per msg	100 µs / 12.5 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 88319 from the client; client sent 88319, completed 88319
broker_confirms_deliveries: broker sent 88319; peer received 88319
no_loss: client saw 88319 completions; peer received 88319
payloads_intact: 0 of 88319 payloads had an unexpected length
host_quiet: 0.14 cores busy outside the client, peer and broker

run 3 · valid

client sent	87,750
client completed	87,750
broker received ($SYS)	87,750
broker sent ($SYS)	87,750
C sink received	87,750
in window: sent / delivered	70045 / 70045
CPU user / sys per msg	102 µs / 12.7 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 87750 from the client; client sent 87750, completed 87750
broker_confirms_deliveries: broker sent 87750; peer received 87750
no_loss: client saw 87750 completions; peer received 87750
payloads_intact: 0 of 87750 payloads had an unexpected length
host_quiet: 0.17 cores busy outside the client, peer and broker

114 µs

run 1 · valid

client sent	87,983
client completed	87,983
broker received ($SYS)	87,983
broker sent ($SYS)	87,983
C sink received	87,983
in window: sent / delivered	70241 / 70242
CPU user / sys per msg	101 µs / 12.4 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 87983 from the client; client sent 87983, completed 87983
broker_confirms_deliveries: broker sent 87983; peer received 87983
no_loss: client saw 87983 completions; peer received 87983
payloads_intact: 0 of 87983 payloads had an unexpected length
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	88,319
client completed	88,319
broker received ($SYS)	88,319
broker sent ($SYS)	88,319
C sink received	88,319
in window: sent / delivered	70921 / 70922
CPU user / sys per msg	100 µs / 12.5 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 88319 from the client; client sent 88319, completed 88319
broker_confirms_deliveries: broker sent 88319; peer received 88319
no_loss: client saw 88319 completions; peer received 88319
payloads_intact: 0 of 88319 payloads had an unexpected length
host_quiet: 0.14 cores busy outside the client, peer and broker

run 3 · valid

client sent	87,750
client completed	87,750
broker received ($SYS)	87,750
broker sent ($SYS)	87,750
C sink received	87,750
in window: sent / delivered	70045 / 70045
CPU user / sys per msg	102 µs / 12.7 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 87750 from the client; client sent 87750, completed 87750
broker_confirms_deliveries: broker sent 87750; peer received 87750
no_loss: client saw 87750 completions; peer received 87750
payloads_intact: 0 of 87750 payloads had an unexpected length
host_quiet: 0.17 cores busy outside the client, peer and broker

aiomqtt3 3.0.0a1 asyncio experimental

unsupported

How fast can each client receive?

Messages per second read by the client from a C publisher offering 90 % of the broker's own C→C ceiling. “≥” marks a client that took the whole offer: its capacity is higher still, and such clients tie.

client

QoS 0
msgs/s ↑

CPU / msg ↓

gmqtt 0.7.0 asyncio

≥ 70,795offer bound

run 1 · valid offer bound

C source sent	707,881
broker received ($SYS)	707,881
broker sent ($SYS)	707,881
broker dropped ($SYS)	0
client received	707,881
in window: offered / received	566356 / 566358
CPU user / sys per msg	11.7 µs / 2.4 µs
CPU (share of a core)	99.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707881; peer wrote 707881
broker_confirms_deliveries: broker sent 707881; client received 707881 by t_stop
host_quiet: 0.29 cores busy outside the client, peer and broker

run 2 · valid offer bound

C source sent	707,843
broker received ($SYS)	707,843
broker sent ($SYS)	707,843
broker dropped ($SYS)	0
client received	707,843
in window: offered / received	566239 / 566233
CPU user / sys per msg	11.2 µs / 2.9 µs
CPU (share of a core)	99.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707843; peer wrote 707843
broker_confirms_deliveries: broker sent 707843; client received 707843 by t_stop
host_quiet: 0.30 cores busy outside the client, peer and broker

run 3 · valid offer bound

C source sent	708,058
broker received ($SYS)	708,058
broker sent ($SYS)	708,058
broker dropped ($SYS)	0
client received	708,058
in window: offered / received	566552 / 566543
CPU user / sys per msg	11.3 µs / 2.8 µs
CPU (share of a core)	99.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708058; peer wrote 708058
broker_confirms_deliveries: broker sent 708058; client received 708058 by t_stop
host_quiet: 0.28 cores busy outside the client, peer and broker

14.1 µsoffer bound

run 1 · valid offer bound

C source sent	707,881
broker received ($SYS)	707,881
broker sent ($SYS)	707,881
broker dropped ($SYS)	0
client received	707,881
in window: offered / received	566356 / 566358
CPU user / sys per msg	11.7 µs / 2.4 µs
CPU (share of a core)	99.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707881; peer wrote 707881
broker_confirms_deliveries: broker sent 707881; client received 707881 by t_stop
host_quiet: 0.29 cores busy outside the client, peer and broker

run 2 · valid offer bound

C source sent	707,843
broker received ($SYS)	707,843
broker sent ($SYS)	707,843
broker dropped ($SYS)	0
client received	707,843
in window: offered / received	566239 / 566233
CPU user / sys per msg	11.2 µs / 2.9 µs
CPU (share of a core)	99.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707843; peer wrote 707843
broker_confirms_deliveries: broker sent 707843; client received 707843 by t_stop
host_quiet: 0.30 cores busy outside the client, peer and broker

run 3 · valid offer bound

C source sent	708,058
broker received ($SYS)	708,058
broker sent ($SYS)	708,058
broker dropped ($SYS)	0
client received	708,058
in window: offered / received	566552 / 566543
CPU user / sys per msg	11.3 µs / 2.8 µs
CPU (share of a core)	99.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708058; peer wrote 708058
broker_confirms_deliveries: broker sent 708058; client received 708058 by t_stop
host_quiet: 0.28 cores busy outside the client, peer and broker

mqttium 1.1.0 asyncio

≥ 70,784offer bound

run 1 · valid offer bound

C source sent	707,859
broker received ($SYS)	707,859
broker sent ($SYS)	707,859
broker dropped ($SYS)	0
client received	707,859
in window: offered / received	566265 / 566271
CPU user / sys per msg	12.4 µs / 1.6 µs
CPU (share of a core)	99.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707859; peer wrote 707859
broker_confirms_deliveries: broker sent 707859; client received 707859 by t_stop
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid offer bound

C source sent	708,002
broker received ($SYS)	708,002
broker sent ($SYS)	708,002
broker dropped ($SYS)	0
client received	708,002
in window: offered / received	566391 / 566399
CPU user / sys per msg	12.0 µs / 2.1 µs
CPU (share of a core)	99.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708002; peer wrote 708002
broker_confirms_deliveries: broker sent 708002; client received 708002 by t_stop
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid offer bound

C source sent	707,764
broker received ($SYS)	707,764
broker sent ($SYS)	707,764
broker dropped ($SYS)	0
client received	707,764
in window: offered / received	566189 / 566173
CPU user / sys per msg	12.6 µs / 1.5 µs
CPU (share of a core)	99.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707764; peer wrote 707764
broker_confirms_deliveries: broker sent 707764; client received 707764 by t_stop
host_quiet: 0.07 cores busy outside the client, peer and broker

14.1 µsoffer bound

run 1 · valid offer bound

C source sent	707,859
broker received ($SYS)	707,859
broker sent ($SYS)	707,859
broker dropped ($SYS)	0
client received	707,859
in window: offered / received	566265 / 566271
CPU user / sys per msg	12.4 µs / 1.6 µs
CPU (share of a core)	99.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707859; peer wrote 707859
broker_confirms_deliveries: broker sent 707859; client received 707859 by t_stop
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid offer bound

C source sent	708,002
broker received ($SYS)	708,002
broker sent ($SYS)	708,002
broker dropped ($SYS)	0
client received	708,002
in window: offered / received	566391 / 566399
CPU user / sys per msg	12.0 µs / 2.1 µs
CPU (share of a core)	99.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708002; peer wrote 708002
broker_confirms_deliveries: broker sent 708002; client received 708002 by t_stop
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid offer bound

C source sent	707,764
broker received ($SYS)	707,764
broker sent ($SYS)	707,764
broker dropped ($SYS)	0
client received	707,764
in window: offered / received	566189 / 566173
CPU user / sys per msg	12.6 µs / 1.5 µs
CPU (share of a core)	99.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707764; peer wrote 707764
broker_confirms_deliveries: broker sent 707764; client received 707764 by t_stop
host_quiet: 0.07 cores busy outside the client, peer and broker

awscrt 0.37.0 crt_event_loop native

58,137

run 1 · valid

C source sent	707,948
broker received ($SYS)	707,948
broker sent ($SYS)	617,115
broker dropped ($SYS)	90,833
client received	617,115
in window: offered / received	566340 / 467022
CPU user / sys per msg	9.3 µs / 7.9 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707948; peer wrote 707948
broker_confirms_deliveries: broker sent 617115; client received 617115 by t_stop
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

C source sent	707,943
broker received ($SYS)	707,943
broker sent ($SYS)	621,588
broker dropped ($SYS)	86,355
client received	621,588
in window: offered / received	566425 / 465131
CPU user / sys per msg	9.1 µs / 8.1 µs
CPU (share of a core)	99.9 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707943; peer wrote 707943
broker_confirms_deliveries: broker sent 621588; client received 621588 by t_stop
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

C source sent	707,897
broker received ($SYS)	707,897
broker sent ($SYS)	617,348
broker dropped ($SYS)	90,549
client received	617,348
in window: offered / received	566309 / 463256
CPU user / sys per msg	9.1 µs / 8.2 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707897; peer wrote 707897
broker_confirms_deliveries: broker sent 617348; client received 617348 by t_stop
host_quiet: 0.23 cores busy outside the client, peer and broker

17.2 µs

run 1 · valid

C source sent	707,948
broker received ($SYS)	707,948
broker sent ($SYS)	617,115
broker dropped ($SYS)	90,833
client received	617,115
in window: offered / received	566340 / 467022
CPU user / sys per msg	9.3 µs / 7.9 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707948; peer wrote 707948
broker_confirms_deliveries: broker sent 617115; client received 617115 by t_stop
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

C source sent	707,943
broker received ($SYS)	707,943
broker sent ($SYS)	621,588
broker dropped ($SYS)	86,355
client received	621,588
in window: offered / received	566425 / 465131
CPU user / sys per msg	9.1 µs / 8.1 µs
CPU (share of a core)	99.9 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707943; peer wrote 707943
broker_confirms_deliveries: broker sent 621588; client received 621588 by t_stop
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

C source sent	707,897
broker received ($SYS)	707,897
broker sent ($SYS)	617,348
broker dropped ($SYS)	90,549
client received	617,348
in window: offered / received	566309 / 463256
CPU user / sys per msg	9.1 µs / 8.2 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707897; peer wrote 707897
broker_confirms_deliveries: broker sent 617348; client received 617348 by t_stop
host_quiet: 0.23 cores busy outside the client, peer and broker

paho 2.1.0 sync

37,752

run 1 · valid

C source sent	708,229
broker received ($SYS)	708,229
broker sent ($SYS)	394,167
broker dropped ($SYS)	314,062
client received	394,167
in window: offered / received	566600 / 300132
CPU user / sys per msg	22.3 µs / 4.4 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708229; peer wrote 708229
broker_confirms_deliveries: broker sent 394167; client received 394167 by t_stop
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

C source sent	707,753
broker received ($SYS)	707,753
broker sent ($SYS)	399,694
broker dropped ($SYS)	308,059
client received	399,694
in window: offered / received	566054 / 302920
CPU user / sys per msg	22.2 µs / 4.2 µs
CPU (share of a core)	99.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707753; peer wrote 707753
broker_confirms_deliveries: broker sent 399694; client received 399694 by t_stop
host_quiet: 0.29 cores busy outside the client, peer and broker

run 3 · valid

C source sent	700,201
broker received ($SYS)	700,201
broker sent ($SYS)	399,916
broker dropped ($SYS)	300,285
client received	399,916
in window: offered / received	566825 / 302019
CPU user / sys per msg	22.4 µs / 4.1 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 700201; peer wrote 700201
broker_confirms_deliveries: broker sent 399916; client received 399916 by t_stop
host_quiet: 0.17 cores busy outside the client, peer and broker

26.5 µs

run 1 · valid

C source sent	708,229
broker received ($SYS)	708,229
broker sent ($SYS)	394,167
broker dropped ($SYS)	314,062
client received	394,167
in window: offered / received	566600 / 300132
CPU user / sys per msg	22.3 µs / 4.4 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708229; peer wrote 708229
broker_confirms_deliveries: broker sent 394167; client received 394167 by t_stop
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

C source sent	707,753
broker received ($SYS)	707,753
broker sent ($SYS)	399,694
broker dropped ($SYS)	308,059
client received	399,694
in window: offered / received	566054 / 302920
CPU user / sys per msg	22.2 µs / 4.2 µs
CPU (share of a core)	99.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707753; peer wrote 707753
broker_confirms_deliveries: broker sent 399694; client received 399694 by t_stop
host_quiet: 0.29 cores busy outside the client, peer and broker

run 3 · valid

C source sent	700,201
broker received ($SYS)	700,201
broker sent ($SYS)	399,916
broker dropped ($SYS)	300,285
client received	399,916
in window: offered / received	566825 / 302019
CPU user / sys per msg	22.4 µs / 4.1 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 700201; peer wrote 700201
broker_confirms_deliveries: broker sent 399916; client received 399916 by t_stop
host_quiet: 0.17 cores busy outside the client, peer and broker

amqtt 0.12.1 asyncio

16,384

run 1 · valid

C source sent	708,001
broker received ($SYS)	708,001
broker sent ($SYS)	198,420
broker dropped ($SYS)	509,582
client received	198,420
in window: offered / received	566490 / 131072
CPU user / sys per msg	60.7 µs / 0.3 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708001; peer wrote 708001
broker_confirms_deliveries: broker sent 198420; client received 198420 by t_stop
host_quiet: 0.12 cores busy outside the client, peer and broker

run 2 · valid

C source sent	708,321
broker received ($SYS)	708,321
broker sent ($SYS)	196,402
broker dropped ($SYS)	511,920
client received	196,402
in window: offered / received	566586 / 131072
CPU user / sys per msg	60.7 µs / 0.3 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708321; peer wrote 708321
broker_confirms_deliveries: broker sent 196402; client received 196402 by t_stop
host_quiet: 0.03 cores busy outside the client, peer and broker

run 3 · valid

C source sent	708,187
broker received ($SYS)	708,187
broker sent ($SYS)	194,223
broker dropped ($SYS)	513,965
client received	194,223
in window: offered / received	566613 / 130492
CPU user / sys per msg	60.9 µs / 0.4 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708187; peer wrote 708187
broker_confirms_deliveries: broker sent 194223; client received 194223 by t_stop
host_quiet: 0.35 cores busy outside the client, peer and broker

61.0 µs

run 1 · valid

C source sent	708,001
broker received ($SYS)	708,001
broker sent ($SYS)	198,420
broker dropped ($SYS)	509,582
client received	198,420
in window: offered / received	566490 / 131072
CPU user / sys per msg	60.7 µs / 0.3 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708001; peer wrote 708001
broker_confirms_deliveries: broker sent 198420; client received 198420 by t_stop
host_quiet: 0.12 cores busy outside the client, peer and broker

run 2 · valid

C source sent	708,321
broker received ($SYS)	708,321
broker sent ($SYS)	196,402
broker dropped ($SYS)	511,920
client received	196,402
in window: offered / received	566586 / 131072
CPU user / sys per msg	60.7 µs / 0.3 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708321; peer wrote 708321
broker_confirms_deliveries: broker sent 196402; client received 196402 by t_stop
host_quiet: 0.03 cores busy outside the client, peer and broker

run 3 · valid

C source sent	708,187
broker received ($SYS)	708,187
broker sent ($SYS)	194,223
broker dropped ($SYS)	513,965
client received	194,223
in window: offered / received	566613 / 130492
CPU user / sys per msg	60.9 µs / 0.4 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708187; peer wrote 708187
broker_confirms_deliveries: broker sent 194223; client received 194223 by t_stop
host_quiet: 0.35 cores busy outside the client, peer and broker

zmqtt 0.2.4 asyncio experimental

14,554

run 1 · valid

C source sent	708,200
broker received ($SYS)	708,200
broker sent ($SYS)	181,577
broker dropped ($SYS)	526,623
client received	174,673
in window: offered / received	566605 / 117225
CPU user / sys per msg	67.2 µs / 1.1 µs
CPU (share of a core)	99.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708200; peer wrote 708200
broker_confirms_deliveries: broker sent 181577; client received 174673 by t_stop
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	708,150
broker received ($SYS)	708,150
broker sent ($SYS)	177,712
broker dropped ($SYS)	530,438
client received	175,514
in window: offered / received	566633 / 117017
CPU user / sys per msg	67.1 µs / 1.3 µs
CPU (share of a core)	99.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708150; peer wrote 708150
broker_confirms_deliveries: broker sent 177712; client received 175514 by t_stop
host_quiet: 0.27 cores busy outside the client, peer and broker

run 3 · valid

C source sent	707,875
broker received ($SYS)	707,875
broker sent ($SYS)	170,334
broker dropped ($SYS)	537,541
client received	170,334
in window: offered / received	566143 / 116304
CPU user / sys per msg	67.5 µs / 1.3 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707875; peer wrote 707875
broker_confirms_deliveries: broker sent 170334; client received 170334 by t_stop
host_quiet: 0.12 cores busy outside the client, peer and broker

68.4 µs

run 1 · valid

C source sent	708,200
broker received ($SYS)	708,200
broker sent ($SYS)	181,577
broker dropped ($SYS)	526,623
client received	174,673
in window: offered / received	566605 / 117225
CPU user / sys per msg	67.2 µs / 1.1 µs
CPU (share of a core)	99.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708200; peer wrote 708200
broker_confirms_deliveries: broker sent 181577; client received 174673 by t_stop
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	708,150
broker received ($SYS)	708,150
broker sent ($SYS)	177,712
broker dropped ($SYS)	530,438
client received	175,514
in window: offered / received	566633 / 117017
CPU user / sys per msg	67.1 µs / 1.3 µs
CPU (share of a core)	99.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708150; peer wrote 708150
broker_confirms_deliveries: broker sent 177712; client received 175514 by t_stop
host_quiet: 0.27 cores busy outside the client, peer and broker

run 3 · valid

C source sent	707,875
broker received ($SYS)	707,875
broker sent ($SYS)	170,334
broker dropped ($SYS)	537,541
client received	170,334
in window: offered / received	566143 / 116304
CPU user / sys per msg	67.5 µs / 1.3 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707875; peer wrote 707875
broker_confirms_deliveries: broker sent 170334; client received 170334 by t_stop
host_quiet: 0.12 cores busy outside the client, peer and broker

aiomqtt 2.5.1 asyncio

7,042

run 1 · valid

C source sent	707,977
broker received ($SYS)	707,977
broker sent ($SYS)	234,734
broker dropped ($SYS)	473,243
client received	113,666
in window: offered / received	566393 / 56039
CPU user / sys per msg	129 µs / 13.2 µs
CPU (share of a core)	99.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707977; peer wrote 707977
broker_confirms_deliveries: broker sent 234734; client received 113666 by t_stop
host_quiet: 0.06 cores busy outside the client, peer and broker

run 2 · valid

C source sent	708,077
broker received ($SYS)	708,077
broker sent ($SYS)	235,566
broker dropped ($SYS)	472,511
client received	115,759
in window: offered / received	566480 / 56896
CPU user / sys per msg	127 µs / 13.9 µs
CPU (share of a core)	100.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708077; peer wrote 708077
broker_confirms_deliveries: broker sent 235566; client received 115759 by t_stop
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	708,263
broker received ($SYS)	708,263
broker sent ($SYS)	235,086
broker dropped ($SYS)	473,177
client received	113,881
in window: offered / received	566672 / 56338
CPU user / sys per msg	129 µs / 13.5 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708263; peer wrote 708263
broker_confirms_deliveries: broker sent 235086; client received 113881 by t_stop
host_quiet: 0.03 cores busy outside the client, peer and broker

142 µs

run 1 · valid

C source sent	707,977
broker received ($SYS)	707,977
broker sent ($SYS)	234,734
broker dropped ($SYS)	473,243
client received	113,666
in window: offered / received	566393 / 56039
CPU user / sys per msg	129 µs / 13.2 µs
CPU (share of a core)	99.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707977; peer wrote 707977
broker_confirms_deliveries: broker sent 234734; client received 113666 by t_stop
host_quiet: 0.06 cores busy outside the client, peer and broker

run 2 · valid

C source sent	708,077
broker received ($SYS)	708,077
broker sent ($SYS)	235,566
broker dropped ($SYS)	472,511
client received	115,759
in window: offered / received	566480 / 56896
CPU user / sys per msg	127 µs / 13.9 µs
CPU (share of a core)	100.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708077; peer wrote 708077
broker_confirms_deliveries: broker sent 235566; client received 115759 by t_stop
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	708,263
broker received ($SYS)	708,263
broker sent ($SYS)	235,086
broker dropped ($SYS)	473,177
client received	113,881
in window: offered / received	566672 / 56338
CPU user / sys per msg	129 µs / 13.5 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708263; peer wrote 708263
broker_confirms_deliveries: broker sent 235086; client received 113881 by t_stop
host_quiet: 0.03 cores busy outside the client, peer and broker

aiomqtt3 3.0.0a1 asyncio experimental

unsupported

What does a message cost at the same load?

Client CPU per message when every client gets the identical offer: 2,000 msgs/s, 1,000 requests/s for round trips and 16 KiB payloads.

client

publish QoS 1
CPU / msg ↓

receive QoS 1
CPU / msg ↓

round trip
CPU / msg ↓

publish 16 KiB
CPU / msg ↓

awscrt 0.37.0 crt_event_loop native

104 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	516 µs / 705 µs / 1,622 µs
due in window, never published	2
CPU user / sys per msg	85.0 µs / 19.4 µs
CPU (share of a core)	20.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	770 µs / 934 µs / 2,326 µs
due in window, never published	2
CPU user / sys per msg	50.6 µs / 53.1 µs
CPU (share of a core)	20.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.41 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	606 µs / 803 µs / 2,697 µs
due in window, never published	2
CPU user / sys per msg	88.1 µs / 15.6 µs
CPU (share of a core)	20.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

44.4 µs

run 1 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15995 / 15995
CPU user / sys per msg	27.5 µs / 16.9 µs
CPU (share of a core)	8.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
broker dropped ($SYS)	0
client received	19,997
in window: offered / received	15999 / 15999
CPU user / sys per msg	26.9 µs / 18.1 µs
CPU (share of a core)	9.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19997; peer wrote 19997
broker_confirms_deliveries: broker sent 19997; client received 19997
no_loss: broker acknowledged 19997 from the peer; client received 19997; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.42 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,985
broker received ($SYS)	19,985
broker sent ($SYS)	19,985
broker dropped ($SYS)	0
client received	19,985
in window: offered / received	15987 / 15987
CPU user / sys per msg	9.4 µs / 35.0 µs
CPU (share of a core)	8.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19985; peer wrote 19985
broker_confirms_deliveries: broker sent 19985; client received 19985
no_loss: broker acknowledged 19985 from the peer; client received 19985; broker dropped 0
offered_rate_held: peer wrote 15987 of 16000 offered in the window
client_kept_up: client received 15987 of 15987 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.01 cores busy outside the client, peer and broker

148 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	639 µs / 967 µs / 3,593 µs
due in window, never published	1
CPU user / sys per msg	77.5 µs / 68.8 µs
CPU (share of a core)	14.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7986 replies to 8000 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.05 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	125 µs / 737 µs / 3,373 µs
due in window, never published	1
CPU user / sys per msg	75.0 µs / 72.5 µs
CPU (share of a core)	14.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 7978 replies to 7999 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.08 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	418 µs / 639 µs / 2,549 µs
due in window, never published	1
CPU user / sys per msg	66.3 µs / 83.8 µs
CPU (share of a core)	15.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8003 replies to 7999 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

141 µs

run 1 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 7997
schedule lag p50 / p99 / max	639 µs / 672 µs / 2,159 µs
due in window, never published	1
CPU user / sys per msg	132 µs / 8.8 µs
CPU (share of a core)	14.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.06 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	152 µs / 500 µs / 3,089 µs
due in window, never published	1
CPU user / sys per msg	93.8 µs / 46.2 µs
CPU (share of a core)	14.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.06 of its core
host_quiet: 0.12 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	7999 / 8000
schedule lag p50 / p99 / max	770 µs / 901 µs / 1,827 µs
due in window, never published	1
CPU user / sys per msg	110 µs / 32.5 µs
CPU (share of a core)	14.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.06 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

gmqtt 0.7.0 asyncio

123 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,955 µs
due in window, never published	2
CPU user / sys per msg	86.2 µs / 35.6 µs
CPU (share of a core)	24.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,554 µs
due in window, never published	3
CPU user / sys per msg	90.0 µs / 33.1 µs
CPU (share of a core)	24.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,623 µs
due in window, never published	2
CPU user / sys per msg	87.5 µs / 35.0 µs
CPU (share of a core)	24.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

99.4 µs

run 1 · attempt 2 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15996 / 15996
CPU user / sys per msg	43.1 µs / 56.9 µs
CPU (share of a core)	20.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.31 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15998 / 15998
CPU user / sys per msg	74.4 µs / 25.0 µs
CPU (share of a core)	19.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15997 / 15997
CPU user / sys per msg	83.1 µs / 14.4 µs
CPU (share of a core)	19.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

255 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,409 µs / 3,735 µs
due in window, never published	1
CPU user / sys per msg	170 µs / 87.5 µs
CPU (share of a core)	25.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	541 µs / 1,409 µs / 3,646 µs
due in window, never published	2
CPU user / sys per msg	163 µs / 91.3 µs
CPU (share of a core)	25.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,343 µs / 2,330 µs
due in window, never published	1
CPU user / sys per msg	180 µs / 75.0 µs
CPU (share of a core)	25.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

194 µs

run 1 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	672 µs / 1,278 µs / 2,598 µs
due in window, never published	1
CPU user / sys per msg	139 µs / 56.2 µs
CPU (share of a core)	19.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	672 µs / 1,343 µs / 2,720 µs
due in window, never published	1
CPU user / sys per msg	146 µs / 46.2 µs
CPU (share of a core)	19.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.10 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8001 / 8001
schedule lag p50 / p99 / max	672 µs / 1,343 µs / 2,776 µs
due in window, never published	1
CPU user / sys per msg	142 µs / 51.2 µs
CPU (share of a core)	19.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8001 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.06 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

mqttium 1.1.0 asyncio

148 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	770 µs / 1,409 µs / 1,826 µs
due in window, never published	3
CPU user / sys per msg	128 µs / 20.0 µs
CPU (share of a core)	29.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,409 µs / 4,238 µs
due in window, never published	2
CPU user / sys per msg	127 µs / 20.0 µs
CPU (share of a core)	29.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15998
schedule lag p50 / p99 / max	672 µs / 1,409 µs / 3,013 µs
due in window, never published	1
CPU user / sys per msg	128 µs / 20.0 µs
CPU (share of a core)	29.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

93.8 µs

run 1 · valid

C source sent	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
broker dropped ($SYS)	0
client received	19,998
in window: offered / received	15999 / 15999
CPU user / sys per msg	50.0 µs / 43.8 µs
CPU (share of a core)	18.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19998; peer wrote 19998
broker_confirms_deliveries: broker sent 19998; client received 19998
no_loss: broker acknowledged 19998 from the peer; client received 19998; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.38 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15994 / 15994
CPU user / sys per msg	63.1 µs / 31.3 µs
CPU (share of a core)	18.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15994 of 16000 offered in the window
client_kept_up: client received 15994 of 15994 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15995 / 15995
CPU user / sys per msg	68.1 µs / 25.0 µs
CPU (share of a core)	18.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

264 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	573 µs / 1,409 µs / 3,536 µs
due in window, never published	1
CPU user / sys per msg	220 µs / 46.2 µs
CPU (share of a core)	26.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.24 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,409 µs / 3,839 µs
due in window, never published	1
CPU user / sys per msg	222 µs / 41.2 µs
CPU (share of a core)	26.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8001 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8001 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,343 µs / 2,630 µs
due in window, never published	1
CPU user / sys per msg	214 µs / 47.5 µs
CPU (share of a core)	26.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

194 µs

run 1 · valid

client sent	9,998
client completed	9,998
broker received ($SYS)	9,998
broker sent ($SYS)	9,998
C sink received	9,998
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	672 µs / 1,278 µs / 3,162 µs
due in window, never published	2
CPU user / sys per msg	161 µs / 32.5 µs
CPU (share of a core)	19.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 9998; peer received 9998
no_loss: client saw 9998 completions; peer received 9998
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.10 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,998
client completed	9,998
broker received ($SYS)	9,998
broker sent ($SYS)	9,998
C sink received	9,998
in window: sent / delivered	7999 / 7999
schedule lag p50 / p99 / max	705 µs / 1,278 µs / 2,196 µs
due in window, never published	2
CPU user / sys per msg	161 µs / 31.3 µs
CPU (share of a core)	19.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 9998; peer received 9998
no_loss: client saw 9998 completions; peer received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 3,524 µs
due in window, never published	1
CPU user / sys per msg	169 µs / 26.2 µs
CPU (share of a core)	19.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

paho 2.1.0 sync

161 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	500 µs / 573 µs / 2,448 µs
due in window, never published	2
CPU user / sys per msg	134 µs / 25.6 µs
CPU (share of a core)	32.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	573 µs / 639 µs / 1,411 µs
due in window, never published	2
CPU user / sys per msg	143 µs / 18.8 µs
CPU (share of a core)	32.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	541 µs / 770 µs / 1,710 µs
due in window, never published	2
CPU user / sys per msg	90.6 µs / 70.6 µs
CPU (share of a core)	32.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.26 cores busy outside the client, peer and broker

95.6 µs

run 1 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15996 / 15996
CPU user / sys per msg	73.8 µs / 21.9 µs
CPU (share of a core)	19.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
broker dropped ($SYS)	0
client received	19,999
in window: offered / received	16000 / 16000
CPU user / sys per msg	68.8 µs / 27.5 µs
CPU (share of a core)	19.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19999; peer wrote 19999
broker_confirms_deliveries: broker sent 19999; client received 19999
no_loss: broker acknowledged 19999 from the peer; client received 19999; broker dropped 0
offered_rate_held: peer wrote 16000 of 16000 offered in the window
client_kept_up: client received 16000 of 16000 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15996 / 15996
CPU user / sys per msg	81.9 µs / 13.1 µs
CPU (share of a core)	19.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

308 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	79.9 µs / 96.3 µs / 927 µs
due in window, never published	1
CPU user / sys per msg	238 µs / 58.8 µs
CPU (share of a core)	29.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	737 µs / 901 µs / 2,844 µs
due in window, never published	1
CPU user / sys per msg	248 µs / 60.0 µs
CPU (share of a core)	30.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	401 µs / 967 µs / 2,175 µs
due in window, never published	1
CPU user / sys per msg	255 µs / 55.0 µs
CPU (share of a core)	31.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8001 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

224 µs

run 1 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	96.3 µs / 303 µs / 2,031 µs
due in window, never published	1
CPU user / sys per msg	191 µs / 31.2 µs
CPU (share of a core)	22.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · attempt 2 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	934 µs / 967 µs / 1,536 µs
due in window, never published	1
CPU user / sys per msg	200 µs / 27.5 µs
CPU (share of a core)	22.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	770 µs / 803 µs / 2,406 µs
due in window, never published	1
CPU user / sys per msg	171 µs / 52.5 µs
CPU (share of a core)	22.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

aiomqtt 2.5.1 asyncio

274 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16004
schedule lag p50 / p99 / max	1,147 µs / 2,294 µs / 4,376 µs
due in window, never published	2
CPU user / sys per msg	253 µs / 16.2 µs
CPU (share of a core)	53.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16003 / 15999
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,860 µs
due in window, never published	1
CPU user / sys per msg	257 µs / 17.5 µs
CPU (share of a core)	54.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16003 of 16001 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,329 µs
due in window, never published	2
CPU user / sys per msg	257 µs / 16.2 µs
CPU (share of a core)	54.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

179 µs

run 1 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15996 / 15996
CPU user / sys per msg	152 µs / 27.5 µs
CPU (share of a core)	35.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15997 / 15997
CPU user / sys per msg	128 µs / 53.1 µs
CPU (share of a core)	36.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

C source sent	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
broker dropped ($SYS)	0
client received	19,999
in window: offered / received	16000 / 16000
CPU user / sys per msg	90.0 µs / 89.4 µs
CPU (share of a core)	35.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19999; peer wrote 19999
broker_confirms_deliveries: broker sent 19999; client received 19999
no_loss: broker acknowledged 19999 from the peer; client received 19999; broker dropped 0
offered_rate_held: peer wrote 16000 of 16000 offered in the window
client_kept_up: client received 16000 of 16000 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.32 cores busy outside the client, peer and broker

645 µs

run 1 · valid

client requests	9,997
C echo received	9,997
C echo replied	9,997
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
client replies	9,997
schedule lag p50 / p99 / max	803 µs / 2,064 µs / 4,557 µs
due in window, never published	3
CPU user / sys per msg	585 µs / 52.5 µs
CPU (share of a core)	63.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9997 from the client; client sent 9997, completed 9997
broker_confirms_deliveries: broker sent 19994; client received 9997, echo received 9997
no_loss: echo sent 9997 replies; client received 9997
offered_rate_held: client published 7998 of 8000 offered in the window
responses_kept_up: client received 7998 replies to 7998 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	868 µs / 2,163 µs / 4,328 µs
due in window, never published	2
CPU user / sys per msg	588 µs / 61.3 µs
CPU (share of a core)	64.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	737 µs / 2,064 µs / 4,598 µs
due in window, never published	2
CPU user / sys per msg	584 µs / 61.2 µs
CPU (share of a core)	64.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.28 cores busy outside the client, peer and broker

479 µs

run 1 · valid

client sent	9,998
client completed	9,998
broker received ($SYS)	9,998
broker sent ($SYS)	9,998
C sink received	9,998
in window: sent / delivered	7999 / 8003
schedule lag p50 / p99 / max	901 µs / 1,868 µs / 2,176 µs
due in window, never published	2
CPU user / sys per msg	459 µs / 20.0 µs
CPU (share of a core)	47.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 9998; peer received 9998
no_loss: client saw 9998 completions; peer received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,998
client completed	9,998
broker received ($SYS)	9,998
broker sent ($SYS)	9,998
C sink received	9,998
in window: sent / delivered	7999 / 7999
schedule lag p50 / p99 / max	868 µs / 1,868 µs / 2,230 µs
due in window, never published	2
CPU user / sys per msg	464 µs / 25.0 µs
CPU (share of a core)	48.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 9998; peer received 9998
no_loss: client saw 9998 completions; peer received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8002
schedule lag p50 / p99 / max	868 µs / 1,802 µs / 2,073 µs
due in window, never published	1
CPU user / sys per msg	448 µs / 17.5 µs
CPU (share of a core)	46.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

amqtt 0.12.1 asyncio

294 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15999
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,609 µs
due in window, never published	1
CPU user / sys per msg	269 µs / 25.0 µs
CPU (share of a core)	58.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 2,332 µs
due in window, never published	4
CPU user / sys per msg	269 µs / 26.9 µs
CPU (share of a core)	59.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,153 µs
due in window, never published	4
CPU user / sys per msg	272 µs / 22.5 µs
CPU (share of a core)	58.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

213 µs

run 1 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15995 / 15995
CPU user / sys per msg	173 µs / 39.4 µs
CPU (share of a core)	42.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.03 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15996 / 15996
CPU user / sys per msg	133 µs / 75.6 µs
CPU (share of a core)	41.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

C source sent	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
broker dropped ($SYS)	0
client received	19,998
in window: offered / received	15999 / 15999
CPU user / sys per msg	203 µs / 10.0 µs
CPU (share of a core)	42.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19998; peer wrote 19998
broker_confirms_deliveries: broker sent 19998; client received 19998
no_loss: broker acknowledged 19998 from the peer; client received 19998; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

636 µs

run 1 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	967 µs / 2,064 µs / 2,323 µs
due in window, never published	2
CPU user / sys per msg	570 µs / 56.3 µs
CPU (share of a core)	62.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	901 µs / 2,064 µs / 2,222 µs
due in window, never published	1
CPU user / sys per msg	574 µs / 62.5 µs
CPU (share of a core)	63.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	934 µs / 2,064 µs / 4,036 µs
due in window, never published	1
CPU user / sys per msg	581 µs / 53.8 µs
CPU (share of a core)	63.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8001 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

554 µs

run 1 · valid

client sent	9,998
client completed	9,998
broker received ($SYS)	9,998
broker sent ($SYS)	9,998
C sink received	9,998
in window: sent / delivered	7999 / 7999
schedule lag p50 / p99 / max	737 µs / 1,802 µs / 3,098 µs
due in window, never published	2
CPU user / sys per msg	525 µs / 28.8 µs
CPU (share of a core)	55.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 9998; peer received 9998
no_loss: client saw 9998 completions; peer received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.10 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	7999 / 8001
schedule lag p50 / p99 / max	803 µs / 1,933 µs / 2,546 µs
due in window, never published	1
CPU user / sys per msg	495 µs / 50.0 µs
CPU (share of a core)	54.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 7999 of 7999 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8001
schedule lag p50 / p99 / max	737 µs / 1,802 µs / 2,568 µs
due in window, never published	1
CPU user / sys per msg	521 µs / 35.0 µs
CPU (share of a core)	55.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8001 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.11 cores busy outside the client, peer and broker

zmqtt 0.2.4 asyncio experimental

307 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16001
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 2,428 µs
due in window, never published	3
CPU user / sys per msg	280 µs / 30.0 µs
CPU (share of a core)	62.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 3,204 µs
due in window, never published	1
CPU user / sys per msg	283 µs / 24.4 µs
CPU (share of a core)	61.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	868 µs / 1,868 µs / 2,209 µs
due in window, never published	4
CPU user / sys per msg	256 µs / 30.0 µs
CPU (share of a core)	57.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15999 of 16002 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

168 µs

run 1 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15997 / 15997
CPU user / sys per msg	166 µs / 19.4 µs
CPU (share of a core)	37.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,991
broker received ($SYS)	19,991
broker sent ($SYS)	19,991
broker dropped ($SYS)	0
client received	19,991
in window: offered / received	15994 / 15994
CPU user / sys per msg	151 µs / 13.8 µs
CPU (share of a core)	32.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19991; peer wrote 19991
broker_confirms_deliveries: broker sent 19991; client received 19991
no_loss: broker acknowledged 19991 from the peer; client received 19991; broker dropped 0
offered_rate_held: peer wrote 15994 of 16000 offered in the window
client_kept_up: client received 15994 of 15994 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,988
broker received ($SYS)	19,988
broker sent ($SYS)	19,988
broker dropped ($SYS)	0
client received	19,988
in window: offered / received	15991 / 15991
CPU user / sys per msg	108 µs / 59.4 µs
CPU (share of a core)	33.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19988; peer wrote 19988
broker_confirms_deliveries: broker sent 19988; client received 19988
no_loss: broker acknowledged 19988 from the peer; client received 19988; broker dropped 0
offered_rate_held: peer wrote 15991 of 16000 offered in the window
client_kept_up: client received 15991 of 15991 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.10 cores busy outside the client, peer and broker

519 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 4,179 µs
due in window, never published	1
CPU user / sys per msg	471 µs / 60.0 µs
CPU (share of a core)	53.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	1,147 µs / 2,163 µs / 3,056 µs
due in window, never published	1
CPU user / sys per msg	470 µs / 48.8 µs
CPU (share of a core)	51.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	1,147 µs / 2,163 µs / 3,110 µs
due in window, never published	1
CPU user / sys per msg	465 µs / 53.7 µs
CPU (share of a core)	51.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8001 of 8001 offered in the window
responses_kept_up: client received 8001 replies to 8001 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

477 µs

run 1 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	934 µs / 1,737 µs / 3,031 µs
due in window, never published	1
CPU user / sys per msg	421 µs / 58.8 µs
CPU (share of a core)	48.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8001 / 8001
schedule lag p50 / p99 / max	901 µs / 1,737 µs / 2,020 µs
due in window, never published	1
CPU user / sys per msg	396 µs / 80.0 µs
CPU (share of a core)	47.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8001 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	901 µs / 1,671 µs / 1,894 µs
due in window, never published	1
CPU user / sys per msg	450 µs / 26.2 µs
CPU (share of a core)	47.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.23 cores busy outside the client, peer and broker

aiomqtt3 3.0.0a1 asyncio experimental

unsupported

How late do messages arrive?

From the stamp written at the actual publish to its arrival at the subscriber, same clock, 2,000 QoS 1 msgs/s. Publish: the client publishes, C receives. Receive: C publishes, the client's callback receives. Time a client spent behind its schedule before publishing is the next question's.

client

publish p50 ↓

publish p99 ↓

receive p50 ↓

receive p99 ↓

amqtt 0.12.1 asyncio

96.3 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15999
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,609 µs
due in window, never published	1
CPU user / sys per msg	269 µs / 25.0 µs
CPU (share of a core)	58.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 2,332 µs
due in window, never published	4
CPU user / sys per msg	269 µs / 26.9 µs
CPU (share of a core)	59.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,153 µs
due in window, never published	4
CPU user / sys per msg	272 µs / 22.5 µs
CPU (share of a core)	58.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

135 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15999
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,609 µs
due in window, never published	1
CPU user / sys per msg	269 µs / 25.0 µs
CPU (share of a core)	58.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 2,332 µs
due in window, never published	4
CPU user / sys per msg	269 µs / 26.9 µs
CPU (share of a core)	59.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,153 µs
due in window, never published	4
CPU user / sys per msg	272 µs / 22.5 µs
CPU (share of a core)	58.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

258 µs

run 1 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15995 / 15995
CPU user / sys per msg	173 µs / 39.4 µs
CPU (share of a core)	42.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.03 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15996 / 15996
CPU user / sys per msg	133 µs / 75.6 µs
CPU (share of a core)	41.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

C source sent	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
broker dropped ($SYS)	0
client received	19,998
in window: offered / received	15999 / 15999
CPU user / sys per msg	203 µs / 10.0 µs
CPU (share of a core)	42.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19998; peer wrote 19998
broker_confirms_deliveries: broker sent 19998; client received 19998
no_loss: broker acknowledged 19998 from the peer; client received 19998; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

369 µs

run 1 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15995 / 15995
CPU user / sys per msg	173 µs / 39.4 µs
CPU (share of a core)	42.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.03 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15996 / 15996
CPU user / sys per msg	133 µs / 75.6 µs
CPU (share of a core)	41.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

C source sent	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
broker dropped ($SYS)	0
client received	19,998
in window: offered / received	15999 / 15999
CPU user / sys per msg	203 µs / 10.0 µs
CPU (share of a core)	42.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19998; peer wrote 19998
broker_confirms_deliveries: broker sent 19998; client received 19998
no_loss: broker acknowledged 19998 from the peer; client received 19998; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

zmqtt 0.2.4 asyncio experimental

96.3 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16001
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 2,428 µs
due in window, never published	3
CPU user / sys per msg	280 µs / 30.0 µs
CPU (share of a core)	62.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 3,204 µs
due in window, never published	1
CPU user / sys per msg	283 µs / 24.4 µs
CPU (share of a core)	61.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	868 µs / 1,868 µs / 2,209 µs
due in window, never published	4
CPU user / sys per msg	256 µs / 30.0 µs
CPU (share of a core)	57.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15999 of 16002 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

143 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16001
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 2,428 µs
due in window, never published	3
CPU user / sys per msg	280 µs / 30.0 µs
CPU (share of a core)	62.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 3,204 µs
due in window, never published	1
CPU user / sys per msg	283 µs / 24.4 µs
CPU (share of a core)	61.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	868 µs / 1,868 µs / 2,209 µs
due in window, never published	4
CPU user / sys per msg	256 µs / 30.0 µs
CPU (share of a core)	57.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15999 of 16002 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

217 µs

run 1 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15997 / 15997
CPU user / sys per msg	166 µs / 19.4 µs
CPU (share of a core)	37.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,991
broker received ($SYS)	19,991
broker sent ($SYS)	19,991
broker dropped ($SYS)	0
client received	19,991
in window: offered / received	15994 / 15994
CPU user / sys per msg	151 µs / 13.8 µs
CPU (share of a core)	32.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19991; peer wrote 19991
broker_confirms_deliveries: broker sent 19991; client received 19991
no_loss: broker acknowledged 19991 from the peer; client received 19991; broker dropped 0
offered_rate_held: peer wrote 15994 of 16000 offered in the window
client_kept_up: client received 15994 of 15994 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,988
broker received ($SYS)	19,988
broker sent ($SYS)	19,988
broker dropped ($SYS)	0
client received	19,988
in window: offered / received	15991 / 15991
CPU user / sys per msg	108 µs / 59.4 µs
CPU (share of a core)	33.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19988; peer wrote 19988
broker_confirms_deliveries: broker sent 19988; client received 19988
no_loss: broker acknowledged 19988 from the peer; client received 19988; broker dropped 0
offered_rate_held: peer wrote 15991 of 16000 offered in the window
client_kept_up: client received 15991 of 15991 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.10 cores busy outside the client, peer and broker

303 µs

run 1 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15997 / 15997
CPU user / sys per msg	166 µs / 19.4 µs
CPU (share of a core)	37.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,991
broker received ($SYS)	19,991
broker sent ($SYS)	19,991
broker dropped ($SYS)	0
client received	19,991
in window: offered / received	15994 / 15994
CPU user / sys per msg	151 µs / 13.8 µs
CPU (share of a core)	32.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19991; peer wrote 19991
broker_confirms_deliveries: broker sent 19991; client received 19991
no_loss: broker acknowledged 19991 from the peer; client received 19991; broker dropped 0
offered_rate_held: peer wrote 15994 of 16000 offered in the window
client_kept_up: client received 15994 of 15994 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,988
broker received ($SYS)	19,988
broker sent ($SYS)	19,988
broker dropped ($SYS)	0
client received	19,988
in window: offered / received	15991 / 15991
CPU user / sys per msg	108 µs / 59.4 µs
CPU (share of a core)	33.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19988; peer wrote 19988
broker_confirms_deliveries: broker sent 19988; client received 19988
no_loss: broker acknowledged 19988 from the peer; client received 19988; broker dropped 0
offered_rate_held: peer wrote 15991 of 16000 offered in the window
client_kept_up: client received 15991 of 15991 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.10 cores busy outside the client, peer and broker

gmqtt 0.7.0 asyncio

104 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,955 µs
due in window, never published	2
CPU user / sys per msg	86.2 µs / 35.6 µs
CPU (share of a core)	24.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,554 µs
due in window, never published	3
CPU user / sys per msg	90.0 µs / 33.1 µs
CPU (share of a core)	24.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,623 µs
due in window, never published	2
CPU user / sys per msg	87.5 µs / 35.0 µs
CPU (share of a core)	24.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

160 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,955 µs
due in window, never published	2
CPU user / sys per msg	86.2 µs / 35.6 µs
CPU (share of a core)	24.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,554 µs
due in window, never published	3
CPU user / sys per msg	90.0 µs / 33.1 µs
CPU (share of a core)	24.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,623 µs
due in window, never published	2
CPU user / sys per msg	87.5 µs / 35.0 µs
CPU (share of a core)	24.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

160 µs

run 1 · attempt 2 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15996 / 15996
CPU user / sys per msg	43.1 µs / 56.9 µs
CPU (share of a core)	20.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.31 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15998 / 15998
CPU user / sys per msg	74.4 µs / 25.0 µs
CPU (share of a core)	19.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15997 / 15997
CPU user / sys per msg	83.1 µs / 14.4 µs
CPU (share of a core)	19.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

217 µs

run 1 · attempt 2 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15996 / 15996
CPU user / sys per msg	43.1 µs / 56.9 µs
CPU (share of a core)	20.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.31 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15998 / 15998
CPU user / sys per msg	74.4 µs / 25.0 µs
CPU (share of a core)	19.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15997 / 15997
CPU user / sys per msg	83.1 µs / 14.4 µs
CPU (share of a core)	19.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

awscrt 0.37.0 crt_event_loop native

135 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	516 µs / 705 µs / 1,622 µs
due in window, never published	2
CPU user / sys per msg	85.0 µs / 19.4 µs
CPU (share of a core)	20.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	770 µs / 934 µs / 2,326 µs
due in window, never published	2
CPU user / sys per msg	50.6 µs / 53.1 µs
CPU (share of a core)	20.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.41 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	606 µs / 803 µs / 2,697 µs
due in window, never published	2
CPU user / sys per msg	88.1 µs / 15.6 µs
CPU (share of a core)	20.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

209 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	516 µs / 705 µs / 1,622 µs
due in window, never published	2
CPU user / sys per msg	85.0 µs / 19.4 µs
CPU (share of a core)	20.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	770 µs / 934 µs / 2,326 µs
due in window, never published	2
CPU user / sys per msg	50.6 µs / 53.1 µs
CPU (share of a core)	20.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.41 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	606 µs / 803 µs / 2,697 µs
due in window, never published	2
CPU user / sys per msg	88.1 µs / 15.6 µs
CPU (share of a core)	20.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

125 µs

run 1 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15995 / 15995
CPU user / sys per msg	27.5 µs / 16.9 µs
CPU (share of a core)	8.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
broker dropped ($SYS)	0
client received	19,997
in window: offered / received	15999 / 15999
CPU user / sys per msg	26.9 µs / 18.1 µs
CPU (share of a core)	9.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19997; peer wrote 19997
broker_confirms_deliveries: broker sent 19997; client received 19997
no_loss: broker acknowledged 19997 from the peer; client received 19997; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.42 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,985
broker received ($SYS)	19,985
broker sent ($SYS)	19,985
broker dropped ($SYS)	0
client received	19,985
in window: offered / received	15987 / 15987
CPU user / sys per msg	9.4 µs / 35.0 µs
CPU (share of a core)	8.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19985; peer wrote 19985
broker_confirms_deliveries: broker sent 19985; client received 19985
no_loss: broker acknowledged 19985 from the peer; client received 19985; broker dropped 0
offered_rate_held: peer wrote 15987 of 16000 offered in the window
client_kept_up: client received 15987 of 15987 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.01 cores busy outside the client, peer and broker

160 µs

run 1 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15995 / 15995
CPU user / sys per msg	27.5 µs / 16.9 µs
CPU (share of a core)	8.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
broker dropped ($SYS)	0
client received	19,997
in window: offered / received	15999 / 15999
CPU user / sys per msg	26.9 µs / 18.1 µs
CPU (share of a core)	9.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19997; peer wrote 19997
broker_confirms_deliveries: broker sent 19997; client received 19997
no_loss: broker acknowledged 19997 from the peer; client received 19997; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.42 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,985
broker received ($SYS)	19,985
broker sent ($SYS)	19,985
broker dropped ($SYS)	0
client received	19,985
in window: offered / received	15987 / 15987
CPU user / sys per msg	9.4 µs / 35.0 µs
CPU (share of a core)	8.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19985; peer wrote 19985
broker_confirms_deliveries: broker sent 19985; client received 19985
no_loss: broker acknowledged 19985 from the peer; client received 19985; broker dropped 0
offered_rate_held: peer wrote 15987 of 16000 offered in the window
client_kept_up: client received 15987 of 15987 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.01 cores busy outside the client, peer and broker

mqttium 1.1.0 asyncio

143 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	770 µs / 1,409 µs / 1,826 µs
due in window, never published	3
CPU user / sys per msg	128 µs / 20.0 µs
CPU (share of a core)	29.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,409 µs / 4,238 µs
due in window, never published	2
CPU user / sys per msg	127 µs / 20.0 µs
CPU (share of a core)	29.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15998
schedule lag p50 / p99 / max	672 µs / 1,409 µs / 3,013 µs
due in window, never published	1
CPU user / sys per msg	128 µs / 20.0 µs
CPU (share of a core)	29.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

233 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	770 µs / 1,409 µs / 1,826 µs
due in window, never published	3
CPU user / sys per msg	128 µs / 20.0 µs
CPU (share of a core)	29.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,409 µs / 4,238 µs
due in window, never published	2
CPU user / sys per msg	127 µs / 20.0 µs
CPU (share of a core)	29.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15998
schedule lag p50 / p99 / max	672 µs / 1,409 µs / 3,013 µs
due in window, never published	1
CPU user / sys per msg	128 µs / 20.0 µs
CPU (share of a core)	29.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

168 µs

run 1 · valid

C source sent	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
broker dropped ($SYS)	0
client received	19,998
in window: offered / received	15999 / 15999
CPU user / sys per msg	50.0 µs / 43.8 µs
CPU (share of a core)	18.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19998; peer wrote 19998
broker_confirms_deliveries: broker sent 19998; client received 19998
no_loss: broker acknowledged 19998 from the peer; client received 19998; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.38 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15994 / 15994
CPU user / sys per msg	63.1 µs / 31.3 µs
CPU (share of a core)	18.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15994 of 16000 offered in the window
client_kept_up: client received 15994 of 15994 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15995 / 15995
CPU user / sys per msg	68.1 µs / 25.0 µs
CPU (share of a core)	18.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

217 µs

run 1 · valid

C source sent	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
broker dropped ($SYS)	0
client received	19,998
in window: offered / received	15999 / 15999
CPU user / sys per msg	50.0 µs / 43.8 µs
CPU (share of a core)	18.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19998; peer wrote 19998
broker_confirms_deliveries: broker sent 19998; client received 19998
no_loss: broker acknowledged 19998 from the peer; client received 19998; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.38 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15994 / 15994
CPU user / sys per msg	63.1 µs / 31.3 µs
CPU (share of a core)	18.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15994 of 16000 offered in the window
client_kept_up: client received 15994 of 15994 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15995 / 15995
CPU user / sys per msg	68.1 µs / 25.0 µs
CPU (share of a core)	18.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

paho 2.1.0 sync

193 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	500 µs / 573 µs / 2,448 µs
due in window, never published	2
CPU user / sys per msg	134 µs / 25.6 µs
CPU (share of a core)	32.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	573 µs / 639 µs / 1,411 µs
due in window, never published	2
CPU user / sys per msg	143 µs / 18.8 µs
CPU (share of a core)	32.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	541 µs / 770 µs / 1,710 µs
due in window, never published	2
CPU user / sys per msg	90.6 µs / 70.6 µs
CPU (share of a core)	32.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.26 cores busy outside the client, peer and broker

270 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	500 µs / 573 µs / 2,448 µs
due in window, never published	2
CPU user / sys per msg	134 µs / 25.6 µs
CPU (share of a core)	32.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	573 µs / 639 µs / 1,411 µs
due in window, never published	2
CPU user / sys per msg	143 µs / 18.8 µs
CPU (share of a core)	32.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	541 µs / 770 µs / 1,710 µs
due in window, never published	2
CPU user / sys per msg	90.6 µs / 70.6 µs
CPU (share of a core)	32.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.26 cores busy outside the client, peer and broker

113 µs

run 1 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15996 / 15996
CPU user / sys per msg	73.8 µs / 21.9 µs
CPU (share of a core)	19.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
broker dropped ($SYS)	0
client received	19,999
in window: offered / received	16000 / 16000
CPU user / sys per msg	68.8 µs / 27.5 µs
CPU (share of a core)	19.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19999; peer wrote 19999
broker_confirms_deliveries: broker sent 19999; client received 19999
no_loss: broker acknowledged 19999 from the peer; client received 19999; broker dropped 0
offered_rate_held: peer wrote 16000 of 16000 offered in the window
client_kept_up: client received 16000 of 16000 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15996 / 15996
CPU user / sys per msg	81.9 µs / 13.1 µs
CPU (share of a core)	19.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

201 µs

run 1 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15996 / 15996
CPU user / sys per msg	73.8 µs / 21.9 µs
CPU (share of a core)	19.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
broker dropped ($SYS)	0
client received	19,999
in window: offered / received	16000 / 16000
CPU user / sys per msg	68.8 µs / 27.5 µs
CPU (share of a core)	19.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19999; peer wrote 19999
broker_confirms_deliveries: broker sent 19999; client received 19999
no_loss: broker acknowledged 19999 from the peer; client received 19999; broker dropped 0
offered_rate_held: peer wrote 16000 of 16000 offered in the window
client_kept_up: client received 16000 of 16000 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15996 / 15996
CPU user / sys per msg	81.9 µs / 13.1 µs
CPU (share of a core)	19.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

aiomqtt 2.5.1 asyncio

500 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16004
schedule lag p50 / p99 / max	1,147 µs / 2,294 µs / 4,376 µs
due in window, never published	2
CPU user / sys per msg	253 µs / 16.2 µs
CPU (share of a core)	53.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16003 / 15999
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,860 µs
due in window, never published	1
CPU user / sys per msg	257 µs / 17.5 µs
CPU (share of a core)	54.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16003 of 16001 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,329 µs
due in window, never published	2
CPU user / sys per msg	257 µs / 16.2 µs
CPU (share of a core)	54.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

1,343 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16004
schedule lag p50 / p99 / max	1,147 µs / 2,294 µs / 4,376 µs
due in window, never published	2
CPU user / sys per msg	253 µs / 16.2 µs
CPU (share of a core)	53.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16003 / 15999
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,860 µs
due in window, never published	1
CPU user / sys per msg	257 µs / 17.5 µs
CPU (share of a core)	54.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16003 of 16001 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,329 µs
due in window, never published	2
CPU user / sys per msg	257 µs / 16.2 µs
CPU (share of a core)	54.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

242 µs

run 1 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15996 / 15996
CPU user / sys per msg	152 µs / 27.5 µs
CPU (share of a core)	35.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15997 / 15997
CPU user / sys per msg	128 µs / 53.1 µs
CPU (share of a core)	36.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

C source sent	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
broker dropped ($SYS)	0
client received	19,999
in window: offered / received	16000 / 16000
CPU user / sys per msg	90.0 µs / 89.4 µs
CPU (share of a core)	35.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19999; peer wrote 19999
broker_confirms_deliveries: broker sent 19999; client received 19999
no_loss: broker acknowledged 19999 from the peer; client received 19999; broker dropped 0
offered_rate_held: peer wrote 16000 of 16000 offered in the window
client_kept_up: client received 16000 of 16000 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.32 cores busy outside the client, peer and broker

336 µs

run 1 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15996 / 15996
CPU user / sys per msg	152 µs / 27.5 µs
CPU (share of a core)	35.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15997 / 15997
CPU user / sys per msg	128 µs / 53.1 µs
CPU (share of a core)	36.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

C source sent	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
broker dropped ($SYS)	0
client received	19,999
in window: offered / received	16000 / 16000
CPU user / sys per msg	90.0 µs / 89.4 µs
CPU (share of a core)	35.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19999; peer wrote 19999
broker_confirms_deliveries: broker sent 19999; client received 19999
no_loss: broker acknowledged 19999 from the peer; client received 19999; broker dropped 0
offered_rate_held: peer wrote 16000 of 16000 offered in the window
client_kept_up: client received 16000 of 16000 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.32 cores busy outside the client, peer and broker

aiomqtt3 3.0.0a1 asyncio experimental

unsupported

Does each client publish on time?

How late each publish left against its due time in the fixed offer, on the same clock. Latency starts at the actual publish; this is the wait before it, which a client that stalls or runs out of in-flight slots cannot hide. Up to 1 ms is the harness's pacing tick, the same for every client.

client

publish p99
lag p99 ↓

publish max
lag max ↓

round trip p99
lag p99 ↓

16 KiB p99
lag p99 ↓

paho 2.1.0 sync

770 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	500 µs / 573 µs / 2,448 µs
due in window, never published	2
CPU user / sys per msg	134 µs / 25.6 µs
CPU (share of a core)	32.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	573 µs / 639 µs / 1,411 µs
due in window, never published	2
CPU user / sys per msg	143 µs / 18.8 µs
CPU (share of a core)	32.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	541 µs / 770 µs / 1,710 µs
due in window, never published	2
CPU user / sys per msg	90.6 µs / 70.6 µs
CPU (share of a core)	32.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.26 cores busy outside the client, peer and broker

2,448 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	500 µs / 573 µs / 2,448 µs
due in window, never published	2
CPU user / sys per msg	134 µs / 25.6 µs
CPU (share of a core)	32.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	573 µs / 639 µs / 1,411 µs
due in window, never published	2
CPU user / sys per msg	143 µs / 18.8 µs
CPU (share of a core)	32.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	541 µs / 770 µs / 1,710 µs
due in window, never published	2
CPU user / sys per msg	90.6 µs / 70.6 µs
CPU (share of a core)	32.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.26 cores busy outside the client, peer and broker

934 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	79.9 µs / 96.3 µs / 927 µs
due in window, never published	1
CPU user / sys per msg	238 µs / 58.8 µs
CPU (share of a core)	29.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	737 µs / 901 µs / 2,844 µs
due in window, never published	1
CPU user / sys per msg	248 µs / 60.0 µs
CPU (share of a core)	30.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	401 µs / 967 µs / 2,175 µs
due in window, never published	1
CPU user / sys per msg	255 µs / 55.0 µs
CPU (share of a core)	31.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8001 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

934 µs

run 1 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	96.3 µs / 303 µs / 2,031 µs
due in window, never published	1
CPU user / sys per msg	191 µs / 31.2 µs
CPU (share of a core)	22.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · attempt 2 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	934 µs / 967 µs / 1,536 µs
due in window, never published	1
CPU user / sys per msg	200 µs / 27.5 µs
CPU (share of a core)	22.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	770 µs / 803 µs / 2,406 µs
due in window, never published	1
CPU user / sys per msg	171 µs / 52.5 µs
CPU (share of a core)	22.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

awscrt 0.37.0 crt_event_loop native

934 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	516 µs / 705 µs / 1,622 µs
due in window, never published	2
CPU user / sys per msg	85.0 µs / 19.4 µs
CPU (share of a core)	20.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	770 µs / 934 µs / 2,326 µs
due in window, never published	2
CPU user / sys per msg	50.6 µs / 53.1 µs
CPU (share of a core)	20.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.41 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	606 µs / 803 µs / 2,697 µs
due in window, never published	2
CPU user / sys per msg	88.1 µs / 15.6 µs
CPU (share of a core)	20.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

2,697 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	516 µs / 705 µs / 1,622 µs
due in window, never published	2
CPU user / sys per msg	85.0 µs / 19.4 µs
CPU (share of a core)	20.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	770 µs / 934 µs / 2,326 µs
due in window, never published	2
CPU user / sys per msg	50.6 µs / 53.1 µs
CPU (share of a core)	20.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.41 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	606 µs / 803 µs / 2,697 µs
due in window, never published	2
CPU user / sys per msg	88.1 µs / 15.6 µs
CPU (share of a core)	20.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

934 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	639 µs / 967 µs / 3,593 µs
due in window, never published	1
CPU user / sys per msg	77.5 µs / 68.8 µs
CPU (share of a core)	14.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7986 replies to 8000 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.05 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	125 µs / 737 µs / 3,373 µs
due in window, never published	1
CPU user / sys per msg	75.0 µs / 72.5 µs
CPU (share of a core)	14.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 7978 replies to 7999 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.08 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	418 µs / 639 µs / 2,549 µs
due in window, never published	1
CPU user / sys per msg	66.3 µs / 83.8 µs
CPU (share of a core)	15.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8003 replies to 7999 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

901 µs

run 1 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 7997
schedule lag p50 / p99 / max	639 µs / 672 µs / 2,159 µs
due in window, never published	1
CPU user / sys per msg	132 µs / 8.8 µs
CPU (share of a core)	14.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.06 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	152 µs / 500 µs / 3,089 µs
due in window, never published	1
CPU user / sys per msg	93.8 µs / 46.2 µs
CPU (share of a core)	14.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.06 of its core
host_quiet: 0.12 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	7999 / 8000
schedule lag p50 / p99 / max	770 µs / 901 µs / 1,827 µs
due in window, never published	1
CPU user / sys per msg	110 µs / 32.5 µs
CPU (share of a core)	14.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.06 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

gmqtt 0.7.0 asyncio

1,343 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,955 µs
due in window, never published	2
CPU user / sys per msg	86.2 µs / 35.6 µs
CPU (share of a core)	24.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,554 µs
due in window, never published	3
CPU user / sys per msg	90.0 µs / 33.1 µs
CPU (share of a core)	24.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,623 µs
due in window, never published	2
CPU user / sys per msg	87.5 µs / 35.0 µs
CPU (share of a core)	24.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

2,955 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,955 µs
due in window, never published	2
CPU user / sys per msg	86.2 µs / 35.6 µs
CPU (share of a core)	24.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,554 µs
due in window, never published	3
CPU user / sys per msg	90.0 µs / 33.1 µs
CPU (share of a core)	24.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,623 µs
due in window, never published	2
CPU user / sys per msg	87.5 µs / 35.0 µs
CPU (share of a core)	24.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

1,409 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,409 µs / 3,735 µs
due in window, never published	1
CPU user / sys per msg	170 µs / 87.5 µs
CPU (share of a core)	25.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	541 µs / 1,409 µs / 3,646 µs
due in window, never published	2
CPU user / sys per msg	163 µs / 91.3 µs
CPU (share of a core)	25.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,343 µs / 2,330 µs
due in window, never published	1
CPU user / sys per msg	180 µs / 75.0 µs
CPU (share of a core)	25.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

1,343 µs

run 1 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	672 µs / 1,278 µs / 2,598 µs
due in window, never published	1
CPU user / sys per msg	139 µs / 56.2 µs
CPU (share of a core)	19.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	672 µs / 1,343 µs / 2,720 µs
due in window, never published	1
CPU user / sys per msg	146 µs / 46.2 µs
CPU (share of a core)	19.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.10 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8001 / 8001
schedule lag p50 / p99 / max	672 µs / 1,343 µs / 2,776 µs
due in window, never published	1
CPU user / sys per msg	142 µs / 51.2 µs
CPU (share of a core)	19.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8001 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.06 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

mqttium 1.1.0 asyncio

1,409 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	770 µs / 1,409 µs / 1,826 µs
due in window, never published	3
CPU user / sys per msg	128 µs / 20.0 µs
CPU (share of a core)	29.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,409 µs / 4,238 µs
due in window, never published	2
CPU user / sys per msg	127 µs / 20.0 µs
CPU (share of a core)	29.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15998
schedule lag p50 / p99 / max	672 µs / 1,409 µs / 3,013 µs
due in window, never published	1
CPU user / sys per msg	128 µs / 20.0 µs
CPU (share of a core)	29.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

4,238 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	770 µs / 1,409 µs / 1,826 µs
due in window, never published	3
CPU user / sys per msg	128 µs / 20.0 µs
CPU (share of a core)	29.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,409 µs / 4,238 µs
due in window, never published	2
CPU user / sys per msg	127 µs / 20.0 µs
CPU (share of a core)	29.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15998
schedule lag p50 / p99 / max	672 µs / 1,409 µs / 3,013 µs
due in window, never published	1
CPU user / sys per msg	128 µs / 20.0 µs
CPU (share of a core)	29.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

1,343 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	573 µs / 1,409 µs / 3,536 µs
due in window, never published	1
CPU user / sys per msg	220 µs / 46.2 µs
CPU (share of a core)	26.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.24 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,409 µs / 3,839 µs
due in window, never published	1
CPU user / sys per msg	222 µs / 41.2 µs
CPU (share of a core)	26.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8001 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8001 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,343 µs / 2,630 µs
due in window, never published	1
CPU user / sys per msg	214 µs / 47.5 µs
CPU (share of a core)	26.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

1,343 µs

run 1 · valid

client sent	9,998
client completed	9,998
broker received ($SYS)	9,998
broker sent ($SYS)	9,998
C sink received	9,998
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	672 µs / 1,278 µs / 3,162 µs
due in window, never published	2
CPU user / sys per msg	161 µs / 32.5 µs
CPU (share of a core)	19.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 9998; peer received 9998
no_loss: client saw 9998 completions; peer received 9998
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.10 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,998
client completed	9,998
broker received ($SYS)	9,998
broker sent ($SYS)	9,998
C sink received	9,998
in window: sent / delivered	7999 / 7999
schedule lag p50 / p99 / max	705 µs / 1,278 µs / 2,196 µs
due in window, never published	2
CPU user / sys per msg	161 µs / 31.3 µs
CPU (share of a core)	19.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 9998; peer received 9998
no_loss: client saw 9998 completions; peer received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 3,524 µs
due in window, never published	1
CPU user / sys per msg	169 µs / 26.2 µs
CPU (share of a core)	19.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

zmqtt 0.2.4 asyncio experimental

1,868 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16001
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 2,428 µs
due in window, never published	3
CPU user / sys per msg	280 µs / 30.0 µs
CPU (share of a core)	62.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 3,204 µs
due in window, never published	1
CPU user / sys per msg	283 µs / 24.4 µs
CPU (share of a core)	61.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	868 µs / 1,868 µs / 2,209 µs
due in window, never published	4
CPU user / sys per msg	256 µs / 30.0 µs
CPU (share of a core)	57.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15999 of 16002 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

3,204 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16001
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 2,428 µs
due in window, never published	3
CPU user / sys per msg	280 µs / 30.0 µs
CPU (share of a core)	62.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 3,204 µs
due in window, never published	1
CPU user / sys per msg	283 µs / 24.4 µs
CPU (share of a core)	61.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	868 µs / 1,868 µs / 2,209 µs
due in window, never published	4
CPU user / sys per msg	256 µs / 30.0 µs
CPU (share of a core)	57.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15999 of 16002 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

2,163 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 4,179 µs
due in window, never published	1
CPU user / sys per msg	471 µs / 60.0 µs
CPU (share of a core)	53.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	1,147 µs / 2,163 µs / 3,056 µs
due in window, never published	1
CPU user / sys per msg	470 µs / 48.8 µs
CPU (share of a core)	51.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	1,147 µs / 2,163 µs / 3,110 µs
due in window, never published	1
CPU user / sys per msg	465 µs / 53.7 µs
CPU (share of a core)	51.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8001 of 8001 offered in the window
responses_kept_up: client received 8001 replies to 8001 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

1,737 µs

run 1 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	934 µs / 1,737 µs / 3,031 µs
due in window, never published	1
CPU user / sys per msg	421 µs / 58.8 µs
CPU (share of a core)	48.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8001 / 8001
schedule lag p50 / p99 / max	901 µs / 1,737 µs / 2,020 µs
due in window, never published	1
CPU user / sys per msg	396 µs / 80.0 µs
CPU (share of a core)	47.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8001 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	901 µs / 1,671 µs / 1,894 µs
due in window, never published	1
CPU user / sys per msg	450 µs / 26.2 µs
CPU (share of a core)	47.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.23 cores busy outside the client, peer and broker

amqtt 0.12.1 asyncio

2,163 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15999
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,609 µs
due in window, never published	1
CPU user / sys per msg	269 µs / 25.0 µs
CPU (share of a core)	58.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 2,332 µs
due in window, never published	4
CPU user / sys per msg	269 µs / 26.9 µs
CPU (share of a core)	59.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,153 µs
due in window, never published	4
CPU user / sys per msg	272 µs / 22.5 µs
CPU (share of a core)	58.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

3,609 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15999
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,609 µs
due in window, never published	1
CPU user / sys per msg	269 µs / 25.0 µs
CPU (share of a core)	58.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 2,332 µs
due in window, never published	4
CPU user / sys per msg	269 µs / 26.9 µs
CPU (share of a core)	59.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,153 µs
due in window, never published	4
CPU user / sys per msg	272 µs / 22.5 µs
CPU (share of a core)	58.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

2,064 µs

run 1 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	967 µs / 2,064 µs / 2,323 µs
due in window, never published	2
CPU user / sys per msg	570 µs / 56.3 µs
CPU (share of a core)	62.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	901 µs / 2,064 µs / 2,222 µs
due in window, never published	1
CPU user / sys per msg	574 µs / 62.5 µs
CPU (share of a core)	63.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	934 µs / 2,064 µs / 4,036 µs
due in window, never published	1
CPU user / sys per msg	581 µs / 53.8 µs
CPU (share of a core)	63.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8001 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

1,868 µs

run 1 · valid

client sent	9,998
client completed	9,998
broker received ($SYS)	9,998
broker sent ($SYS)	9,998
C sink received	9,998
in window: sent / delivered	7999 / 7999
schedule lag p50 / p99 / max	737 µs / 1,802 µs / 3,098 µs
due in window, never published	2
CPU user / sys per msg	525 µs / 28.8 µs
CPU (share of a core)	55.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 9998; peer received 9998
no_loss: client saw 9998 completions; peer received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.10 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	7999 / 8001
schedule lag p50 / p99 / max	803 µs / 1,933 µs / 2,546 µs
due in window, never published	1
CPU user / sys per msg	495 µs / 50.0 µs
CPU (share of a core)	54.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 7999 of 7999 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8001
schedule lag p50 / p99 / max	737 µs / 1,802 µs / 2,568 µs
due in window, never published	1
CPU user / sys per msg	521 µs / 35.0 µs
CPU (share of a core)	55.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8001 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.11 cores busy outside the client, peer and broker

aiomqtt 2.5.1 asyncio

2,294 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16004
schedule lag p50 / p99 / max	1,147 µs / 2,294 µs / 4,376 µs
due in window, never published	2
CPU user / sys per msg	253 µs / 16.2 µs
CPU (share of a core)	53.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16003 / 15999
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,860 µs
due in window, never published	1
CPU user / sys per msg	257 µs / 17.5 µs
CPU (share of a core)	54.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16003 of 16001 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,329 µs
due in window, never published	2
CPU user / sys per msg	257 µs / 16.2 µs
CPU (share of a core)	54.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

4,376 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16004
schedule lag p50 / p99 / max	1,147 µs / 2,294 µs / 4,376 µs
due in window, never published	2
CPU user / sys per msg	253 µs / 16.2 µs
CPU (share of a core)	53.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16003 / 15999
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,860 µs
due in window, never published	1
CPU user / sys per msg	257 µs / 17.5 µs
CPU (share of a core)	54.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16003 of 16001 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,329 µs
due in window, never published	2
CPU user / sys per msg	257 µs / 16.2 µs
CPU (share of a core)	54.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

2,064 µs

run 1 · valid

client requests	9,997
C echo received	9,997
C echo replied	9,997
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
client replies	9,997
schedule lag p50 / p99 / max	803 µs / 2,064 µs / 4,557 µs
due in window, never published	3
CPU user / sys per msg	585 µs / 52.5 µs
CPU (share of a core)	63.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9997 from the client; client sent 9997, completed 9997
broker_confirms_deliveries: broker sent 19994; client received 9997, echo received 9997
no_loss: echo sent 9997 replies; client received 9997
offered_rate_held: client published 7998 of 8000 offered in the window
responses_kept_up: client received 7998 replies to 7998 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	868 µs / 2,163 µs / 4,328 µs
due in window, never published	2
CPU user / sys per msg	588 µs / 61.3 µs
CPU (share of a core)	64.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	737 µs / 2,064 µs / 4,598 µs
due in window, never published	2
CPU user / sys per msg	584 µs / 61.2 µs
CPU (share of a core)	64.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.28 cores busy outside the client, peer and broker

1,868 µs

run 1 · valid

client sent	9,998
client completed	9,998
broker received ($SYS)	9,998
broker sent ($SYS)	9,998
C sink received	9,998
in window: sent / delivered	7999 / 8003
schedule lag p50 / p99 / max	901 µs / 1,868 µs / 2,176 µs
due in window, never published	2
CPU user / sys per msg	459 µs / 20.0 µs
CPU (share of a core)	47.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 9998; peer received 9998
no_loss: client saw 9998 completions; peer received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,998
client completed	9,998
broker received ($SYS)	9,998
broker sent ($SYS)	9,998
C sink received	9,998
in window: sent / delivered	7999 / 7999
schedule lag p50 / p99 / max	868 µs / 1,868 µs / 2,230 µs
due in window, never published	2
CPU user / sys per msg	464 µs / 25.0 µs
CPU (share of a core)	48.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 9998; peer received 9998
no_loss: client saw 9998 completions; peer received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8002
schedule lag p50 / p99 / max	868 µs / 1,802 µs / 2,073 µs
due in window, never published	1
CPU user / sys per msg	448 µs / 17.5 µs
CPU (share of a core)	46.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

aiomqtt3 3.0.0a1 asyncio experimental

unsupported

What is the application round trip?

The client publishes a request at 1,000/s and a C echo republishes it; timed in the client from publish to its callback on the reply. Two broker hops, QoS 1 both ways.

client

p50 ↓

p99 ↓

p99.9 ↓

gmqtt 0.7.0 asyncio

270 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,409 µs / 3,735 µs
due in window, never published	1
CPU user / sys per msg	170 µs / 87.5 µs
CPU (share of a core)	25.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	541 µs / 1,409 µs / 3,646 µs
due in window, never published	2
CPU user / sys per msg	163 µs / 91.3 µs
CPU (share of a core)	25.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,343 µs / 2,330 µs
due in window, never published	1
CPU user / sys per msg	180 µs / 75.0 µs
CPU (share of a core)	25.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

401 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,409 µs / 3,735 µs
due in window, never published	1
CPU user / sys per msg	170 µs / 87.5 µs
CPU (share of a core)	25.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	541 µs / 1,409 µs / 3,646 µs
due in window, never published	2
CPU user / sys per msg	163 µs / 91.3 µs
CPU (share of a core)	25.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,343 µs / 2,330 µs
due in window, never published	1
CPU user / sys per msg	180 µs / 75.0 µs
CPU (share of a core)	25.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

1,999 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,409 µs / 3,735 µs
due in window, never published	1
CPU user / sys per msg	170 µs / 87.5 µs
CPU (share of a core)	25.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	541 µs / 1,409 µs / 3,646 µs
due in window, never published	2
CPU user / sys per msg	163 µs / 91.3 µs
CPU (share of a core)	25.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,343 µs / 2,330 µs
due in window, never published	1
CPU user / sys per msg	180 µs / 75.0 µs
CPU (share of a core)	25.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

mqttium 1.1.0 asyncio

270 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	573 µs / 1,409 µs / 3,536 µs
due in window, never published	1
CPU user / sys per msg	220 µs / 46.2 µs
CPU (share of a core)	26.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.24 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,409 µs / 3,839 µs
due in window, never published	1
CPU user / sys per msg	222 µs / 41.2 µs
CPU (share of a core)	26.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8001 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8001 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,343 µs / 2,630 µs
due in window, never published	1
CPU user / sys per msg	214 µs / 47.5 µs
CPU (share of a core)	26.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

418 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	573 µs / 1,409 µs / 3,536 µs
due in window, never published	1
CPU user / sys per msg	220 µs / 46.2 µs
CPU (share of a core)	26.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.24 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,409 µs / 3,839 µs
due in window, never published	1
CPU user / sys per msg	222 µs / 41.2 µs
CPU (share of a core)	26.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8001 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8001 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,343 µs / 2,630 µs
due in window, never published	1
CPU user / sys per msg	214 µs / 47.5 µs
CPU (share of a core)	26.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

1,081 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	573 µs / 1,409 µs / 3,536 µs
due in window, never published	1
CPU user / sys per msg	220 µs / 46.2 µs
CPU (share of a core)	26.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.24 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,409 µs / 3,839 µs
due in window, never published	1
CPU user / sys per msg	222 µs / 41.2 µs
CPU (share of a core)	26.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8001 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8001 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,343 µs / 2,630 µs
due in window, never published	1
CPU user / sys per msg	214 µs / 47.5 µs
CPU (share of a core)	26.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

paho 2.1.0 sync

270 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	79.9 µs / 96.3 µs / 927 µs
due in window, never published	1
CPU user / sys per msg	238 µs / 58.8 µs
CPU (share of a core)	29.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	737 µs / 901 µs / 2,844 µs
due in window, never published	1
CPU user / sys per msg	248 µs / 60.0 µs
CPU (share of a core)	30.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	401 µs / 967 µs / 2,175 µs
due in window, never published	1
CPU user / sys per msg	255 µs / 55.0 µs
CPU (share of a core)	31.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8001 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

369 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	79.9 µs / 96.3 µs / 927 µs
due in window, never published	1
CPU user / sys per msg	238 µs / 58.8 µs
CPU (share of a core)	29.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	737 µs / 901 µs / 2,844 µs
due in window, never published	1
CPU user / sys per msg	248 µs / 60.0 µs
CPU (share of a core)	30.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	401 µs / 967 µs / 2,175 µs
due in window, never published	1
CPU user / sys per msg	255 µs / 55.0 µs
CPU (share of a core)	31.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8001 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

1,868 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	79.9 µs / 96.3 µs / 927 µs
due in window, never published	1
CPU user / sys per msg	238 µs / 58.8 µs
CPU (share of a core)	29.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	737 µs / 901 µs / 2,844 µs
due in window, never published	1
CPU user / sys per msg	248 µs / 60.0 µs
CPU (share of a core)	30.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	401 µs / 967 µs / 2,175 µs
due in window, never published	1
CPU user / sys per msg	255 µs / 55.0 µs
CPU (share of a core)	31.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8001 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

zmqtt 0.2.4 asyncio experimental

672 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 4,179 µs
due in window, never published	1
CPU user / sys per msg	471 µs / 60.0 µs
CPU (share of a core)	53.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	1,147 µs / 2,163 µs / 3,056 µs
due in window, never published	1
CPU user / sys per msg	470 µs / 48.8 µs
CPU (share of a core)	51.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	1,147 µs / 2,163 µs / 3,110 µs
due in window, never published	1
CPU user / sys per msg	465 µs / 53.7 µs
CPU (share of a core)	51.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8001 of 8001 offered in the window
responses_kept_up: client received 8001 replies to 8001 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

3,080 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 4,179 µs
due in window, never published	1
CPU user / sys per msg	471 µs / 60.0 µs
CPU (share of a core)	53.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	1,147 µs / 2,163 µs / 3,056 µs
due in window, never published	1
CPU user / sys per msg	470 µs / 48.8 µs
CPU (share of a core)	51.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	1,147 µs / 2,163 µs / 3,110 µs
due in window, never published	1
CPU user / sys per msg	465 µs / 53.7 µs
CPU (share of a core)	51.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8001 of 8001 offered in the window
responses_kept_up: client received 8001 replies to 8001 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

6,685 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 4,179 µs
due in window, never published	1
CPU user / sys per msg	471 µs / 60.0 µs
CPU (share of a core)	53.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	1,147 µs / 2,163 µs / 3,056 µs
due in window, never published	1
CPU user / sys per msg	470 µs / 48.8 µs
CPU (share of a core)	51.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	1,147 µs / 2,163 µs / 3,110 µs
due in window, never published	1
CPU user / sys per msg	465 µs / 53.7 µs
CPU (share of a core)	51.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8001 of 8001 offered in the window
responses_kept_up: client received 8001 replies to 8001 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

amqtt 0.12.1 asyncio

770 µs

run 1 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	967 µs / 2,064 µs / 2,323 µs
due in window, never published	2
CPU user / sys per msg	570 µs / 56.3 µs
CPU (share of a core)	62.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	901 µs / 2,064 µs / 2,222 µs
due in window, never published	1
CPU user / sys per msg	574 µs / 62.5 µs
CPU (share of a core)	63.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	934 µs / 2,064 µs / 4,036 µs
due in window, never published	1
CPU user / sys per msg	581 µs / 53.8 µs
CPU (share of a core)	63.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8001 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

1,802 µs

run 1 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	967 µs / 2,064 µs / 2,323 µs
due in window, never published	2
CPU user / sys per msg	570 µs / 56.3 µs
CPU (share of a core)	62.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	901 µs / 2,064 µs / 2,222 µs
due in window, never published	1
CPU user / sys per msg	574 µs / 62.5 µs
CPU (share of a core)	63.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	934 µs / 2,064 µs / 4,036 µs
due in window, never published	1
CPU user / sys per msg	581 µs / 53.8 µs
CPU (share of a core)	63.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8001 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

2,818 µs

run 1 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	967 µs / 2,064 µs / 2,323 µs
due in window, never published	2
CPU user / sys per msg	570 µs / 56.3 µs
CPU (share of a core)	62.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	901 µs / 2,064 µs / 2,222 µs
due in window, never published	1
CPU user / sys per msg	574 µs / 62.5 µs
CPU (share of a core)	63.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	934 µs / 2,064 µs / 4,036 µs
due in window, never published	1
CPU user / sys per msg	581 µs / 53.8 µs
CPU (share of a core)	63.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8001 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

aiomqtt 2.5.1 asyncio

803 µs

run 1 · valid

client requests	9,997
C echo received	9,997
C echo replied	9,997
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
client replies	9,997
schedule lag p50 / p99 / max	803 µs / 2,064 µs / 4,557 µs
due in window, never published	3
CPU user / sys per msg	585 µs / 52.5 µs
CPU (share of a core)	63.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9997 from the client; client sent 9997, completed 9997
broker_confirms_deliveries: broker sent 19994; client received 9997, echo received 9997
no_loss: echo sent 9997 replies; client received 9997
offered_rate_held: client published 7998 of 8000 offered in the window
responses_kept_up: client received 7998 replies to 7998 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	868 µs / 2,163 µs / 4,328 µs
due in window, never published	2
CPU user / sys per msg	588 µs / 61.3 µs
CPU (share of a core)	64.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	737 µs / 2,064 µs / 4,598 µs
due in window, never published	2
CPU user / sys per msg	584 µs / 61.2 µs
CPU (share of a core)	64.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.28 cores busy outside the client, peer and broker

3,736 µs

run 1 · valid

client requests	9,997
C echo received	9,997
C echo replied	9,997
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
client replies	9,997
schedule lag p50 / p99 / max	803 µs / 2,064 µs / 4,557 µs
due in window, never published	3
CPU user / sys per msg	585 µs / 52.5 µs
CPU (share of a core)	63.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9997 from the client; client sent 9997, completed 9997
broker_confirms_deliveries: broker sent 19994; client received 9997, echo received 9997
no_loss: echo sent 9997 replies; client received 9997
offered_rate_held: client published 7998 of 8000 offered in the window
responses_kept_up: client received 7998 replies to 7998 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	868 µs / 2,163 µs / 4,328 µs
due in window, never published	2
CPU user / sys per msg	588 µs / 61.3 µs
CPU (share of a core)	64.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	737 µs / 2,064 µs / 4,598 µs
due in window, never published	2
CPU user / sys per msg	584 µs / 61.2 µs
CPU (share of a core)	64.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.28 cores busy outside the client, peer and broker

11.8 ms

run 1 · valid

client requests	9,997
C echo received	9,997
C echo replied	9,997
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
client replies	9,997
schedule lag p50 / p99 / max	803 µs / 2,064 µs / 4,557 µs
due in window, never published	3
CPU user / sys per msg	585 µs / 52.5 µs
CPU (share of a core)	63.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9997 from the client; client sent 9997, completed 9997
broker_confirms_deliveries: broker sent 19994; client received 9997, echo received 9997
no_loss: echo sent 9997 replies; client received 9997
offered_rate_held: client published 7998 of 8000 offered in the window
responses_kept_up: client received 7998 replies to 7998 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	868 µs / 2,163 µs / 4,328 µs
due in window, never published	2
CPU user / sys per msg	588 µs / 61.3 µs
CPU (share of a core)	64.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	737 µs / 2,064 µs / 4,598 µs
due in window, never published	2
CPU user / sys per msg	584 µs / 61.2 µs
CPU (share of a core)	64.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.28 cores busy outside the client, peer and broker

awscrt 0.37.0 crt_event_loop native

23.6 ms

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	639 µs / 967 µs / 3,593 µs
due in window, never published	1
CPU user / sys per msg	77.5 µs / 68.8 µs
CPU (share of a core)	14.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7986 replies to 8000 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.05 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	125 µs / 737 µs / 3,373 µs
due in window, never published	1
CPU user / sys per msg	75.0 µs / 72.5 µs
CPU (share of a core)	14.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 7978 replies to 7999 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.08 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	418 µs / 639 µs / 2,549 µs
due in window, never published	1
CPU user / sys per msg	66.3 µs / 83.8 µs
CPU (share of a core)	15.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8003 replies to 7999 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

43.0 ms

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	639 µs / 967 µs / 3,593 µs
due in window, never published	1
CPU user / sys per msg	77.5 µs / 68.8 µs
CPU (share of a core)	14.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7986 replies to 8000 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.05 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	125 µs / 737 µs / 3,373 µs
due in window, never published	1
CPU user / sys per msg	75.0 µs / 72.5 µs
CPU (share of a core)	14.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 7978 replies to 7999 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.08 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	418 µs / 639 µs / 2,549 µs
due in window, never published	1
CPU user / sys per msg	66.3 µs / 83.8 µs
CPU (share of a core)	15.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8003 replies to 7999 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

43.0 ms

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	639 µs / 967 µs / 3,593 µs
due in window, never published	1
CPU user / sys per msg	77.5 µs / 68.8 µs
CPU (share of a core)	14.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7986 replies to 8000 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.05 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	125 µs / 737 µs / 3,373 µs
due in window, never published	1
CPU user / sys per msg	75.0 µs / 72.5 µs
CPU (share of a core)	14.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 7978 replies to 7999 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.08 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	418 µs / 639 µs / 2,549 µs
due in window, never published	1
CPU user / sys per msg	66.3 µs / 83.8 µs
CPU (share of a core)	15.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8003 replies to 7999 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

aiomqtt3 3.0.0a1 asyncio experimental

unsupported

awscrt · aws-c-io does not expose TCP_NODELAY, and a trace of the library's connect shows it never sets it, so Nagle's algorithm stays on. A QoS 1 round trip then waits tens of milliseconds, against hundreds of microseconds at QoS 0, where no acknowledgement is pending: the pattern of Nagle's algorithm waiting for a delayed ACK. This is the library as shipped, reported as measured. It says nothing about the library's publish or receive cost, which the other points show.

How much memory does each client hold?

Peak resident set of the client process during the window, including the interpreter.

client

idle
peak RSS ↓

publish 2k/s
peak RSS ↓

receive at capacity
peak RSS ↓

publish 16 KiB
peak RSS ↓

gmqtt 0.7.0 asyncio

22.2 MiB

run 1 · valid

connect	1.0 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

connect	0.8 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

connect	0.9 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

22.5 MiB

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,955 µs
due in window, never published	2
CPU user / sys per msg	86.2 µs / 35.6 µs
CPU (share of a core)	24.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,554 µs
due in window, never published	3
CPU user / sys per msg	90.0 µs / 33.1 µs
CPU (share of a core)	24.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,623 µs
due in window, never published	2
CPU user / sys per msg	87.5 µs / 35.0 µs
CPU (share of a core)	24.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

22.5 MiBoffer bound

run 1 · valid offer bound

C source sent	707,881
broker received ($SYS)	707,881
broker sent ($SYS)	707,881
broker dropped ($SYS)	0
client received	707,881
in window: offered / received	566356 / 566358
CPU user / sys per msg	11.7 µs / 2.4 µs
CPU (share of a core)	99.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707881; peer wrote 707881
broker_confirms_deliveries: broker sent 707881; client received 707881 by t_stop
host_quiet: 0.29 cores busy outside the client, peer and broker

run 2 · valid offer bound

C source sent	707,843
broker received ($SYS)	707,843
broker sent ($SYS)	707,843
broker dropped ($SYS)	0
client received	707,843
in window: offered / received	566239 / 566233
CPU user / sys per msg	11.2 µs / 2.9 µs
CPU (share of a core)	99.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707843; peer wrote 707843
broker_confirms_deliveries: broker sent 707843; client received 707843 by t_stop
host_quiet: 0.30 cores busy outside the client, peer and broker

run 3 · valid offer bound

C source sent	708,058
broker received ($SYS)	708,058
broker sent ($SYS)	708,058
broker dropped ($SYS)	0
client received	708,058
in window: offered / received	566552 / 566543
CPU user / sys per msg	11.3 µs / 2.8 µs
CPU (share of a core)	99.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708058; peer wrote 708058
broker_confirms_deliveries: broker sent 708058; client received 708058 by t_stop
host_quiet: 0.28 cores busy outside the client, peer and broker

22.5 MiB

run 1 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	672 µs / 1,278 µs / 2,598 µs
due in window, never published	1
CPU user / sys per msg	139 µs / 56.2 µs
CPU (share of a core)	19.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	672 µs / 1,343 µs / 2,720 µs
due in window, never published	1
CPU user / sys per msg	146 µs / 46.2 µs
CPU (share of a core)	19.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.10 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8001 / 8001
schedule lag p50 / p99 / max	672 µs / 1,343 µs / 2,776 µs
due in window, never published	1
CPU user / sys per msg	142 µs / 51.2 µs
CPU (share of a core)	19.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8001 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.06 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

zmqtt 0.2.4 asyncio experimental

25.4 MiB

run 1 · valid

connect	0.8 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

connect	0.8 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

connect	0.8 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

25.8 MiB

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16001
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 2,428 µs
due in window, never published	3
CPU user / sys per msg	280 µs / 30.0 µs
CPU (share of a core)	62.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 3,204 µs
due in window, never published	1
CPU user / sys per msg	283 µs / 24.4 µs
CPU (share of a core)	61.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	868 µs / 1,868 µs / 2,209 µs
due in window, never published	4
CPU user / sys per msg	256 µs / 30.0 µs
CPU (share of a core)	57.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15999 of 16002 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

26.7 MiB

run 1 · valid

C source sent	708,200
broker received ($SYS)	708,200
broker sent ($SYS)	181,577
broker dropped ($SYS)	526,623
client received	174,673
in window: offered / received	566605 / 117225
CPU user / sys per msg	67.2 µs / 1.1 µs
CPU (share of a core)	99.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708200; peer wrote 708200
broker_confirms_deliveries: broker sent 181577; client received 174673 by t_stop
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	708,150
broker received ($SYS)	708,150
broker sent ($SYS)	177,712
broker dropped ($SYS)	530,438
client received	175,514
in window: offered / received	566633 / 117017
CPU user / sys per msg	67.1 µs / 1.3 µs
CPU (share of a core)	99.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708150; peer wrote 708150
broker_confirms_deliveries: broker sent 177712; client received 175514 by t_stop
host_quiet: 0.27 cores busy outside the client, peer and broker

run 3 · valid

C source sent	707,875
broker received ($SYS)	707,875
broker sent ($SYS)	170,334
broker dropped ($SYS)	537,541
client received	170,334
in window: offered / received	566143 / 116304
CPU user / sys per msg	67.5 µs / 1.3 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707875; peer wrote 707875
broker_confirms_deliveries: broker sent 170334; client received 170334 by t_stop
host_quiet: 0.12 cores busy outside the client, peer and broker

25.8 MiB

run 1 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	934 µs / 1,737 µs / 3,031 µs
due in window, never published	1
CPU user / sys per msg	421 µs / 58.8 µs
CPU (share of a core)	48.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8001 / 8001
schedule lag p50 / p99 / max	901 µs / 1,737 µs / 2,020 µs
due in window, never published	1
CPU user / sys per msg	396 µs / 80.0 µs
CPU (share of a core)	47.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8001 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	901 µs / 1,671 µs / 1,894 µs
due in window, never published	1
CPU user / sys per msg	450 µs / 26.2 µs
CPU (share of a core)	47.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.23 cores busy outside the client, peer and broker

paho 2.1.0 sync

25.5 MiB

run 1 · valid

connect	1.7 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

connect	1.7 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

connect	1.7 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

25.7 MiB

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	500 µs / 573 µs / 2,448 µs
due in window, never published	2
CPU user / sys per msg	134 µs / 25.6 µs
CPU (share of a core)	32.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	573 µs / 639 µs / 1,411 µs
due in window, never published	2
CPU user / sys per msg	143 µs / 18.8 µs
CPU (share of a core)	32.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	541 µs / 770 µs / 1,710 µs
due in window, never published	2
CPU user / sys per msg	90.6 µs / 70.6 µs
CPU (share of a core)	32.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.26 cores busy outside the client, peer and broker

25.7 MiB

run 1 · valid

C source sent	708,229
broker received ($SYS)	708,229
broker sent ($SYS)	394,167
broker dropped ($SYS)	314,062
client received	394,167
in window: offered / received	566600 / 300132
CPU user / sys per msg	22.3 µs / 4.4 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708229; peer wrote 708229
broker_confirms_deliveries: broker sent 394167; client received 394167 by t_stop
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

C source sent	707,753
broker received ($SYS)	707,753
broker sent ($SYS)	399,694
broker dropped ($SYS)	308,059
client received	399,694
in window: offered / received	566054 / 302920
CPU user / sys per msg	22.2 µs / 4.2 µs
CPU (share of a core)	99.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707753; peer wrote 707753
broker_confirms_deliveries: broker sent 399694; client received 399694 by t_stop
host_quiet: 0.29 cores busy outside the client, peer and broker

run 3 · valid

C source sent	700,201
broker received ($SYS)	700,201
broker sent ($SYS)	399,916
broker dropped ($SYS)	300,285
client received	399,916
in window: offered / received	566825 / 302019
CPU user / sys per msg	22.4 µs / 4.1 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 700201; peer wrote 700201
broker_confirms_deliveries: broker sent 399916; client received 399916 by t_stop
host_quiet: 0.17 cores busy outside the client, peer and broker

25.6 MiB

run 1 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	96.3 µs / 303 µs / 2,031 µs
due in window, never published	1
CPU user / sys per msg	191 µs / 31.2 µs
CPU (share of a core)	22.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · attempt 2 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	934 µs / 967 µs / 1,536 µs
due in window, never published	1
CPU user / sys per msg	200 µs / 27.5 µs
CPU (share of a core)	22.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	770 µs / 803 µs / 2,406 µs
due in window, never published	1
CPU user / sys per msg	171 µs / 52.5 µs
CPU (share of a core)	22.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

mqttium 1.1.0 asyncio

26.3 MiB

run 1 · valid

connect	1.2 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 2 · valid

connect	1.2 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

connect	1.2 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

26.7 MiB

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	770 µs / 1,409 µs / 1,826 µs
due in window, never published	3
CPU user / sys per msg	128 µs / 20.0 µs
CPU (share of a core)	29.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,409 µs / 4,238 µs
due in window, never published	2
CPU user / sys per msg	127 µs / 20.0 µs
CPU (share of a core)	29.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15998
schedule lag p50 / p99 / max	672 µs / 1,409 µs / 3,013 µs
due in window, never published	1
CPU user / sys per msg	128 µs / 20.0 µs
CPU (share of a core)	29.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

26.5 MiBoffer bound

run 1 · valid offer bound

C source sent	707,859
broker received ($SYS)	707,859
broker sent ($SYS)	707,859
broker dropped ($SYS)	0
client received	707,859
in window: offered / received	566265 / 566271
CPU user / sys per msg	12.4 µs / 1.6 µs
CPU (share of a core)	99.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707859; peer wrote 707859
broker_confirms_deliveries: broker sent 707859; client received 707859 by t_stop
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid offer bound

C source sent	708,002
broker received ($SYS)	708,002
broker sent ($SYS)	708,002
broker dropped ($SYS)	0
client received	708,002
in window: offered / received	566391 / 566399
CPU user / sys per msg	12.0 µs / 2.1 µs
CPU (share of a core)	99.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708002; peer wrote 708002
broker_confirms_deliveries: broker sent 708002; client received 708002 by t_stop
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid offer bound

C source sent	707,764
broker received ($SYS)	707,764
broker sent ($SYS)	707,764
broker dropped ($SYS)	0
client received	707,764
in window: offered / received	566189 / 566173
CPU user / sys per msg	12.6 µs / 1.5 µs
CPU (share of a core)	99.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707764; peer wrote 707764
broker_confirms_deliveries: broker sent 707764; client received 707764 by t_stop
host_quiet: 0.07 cores busy outside the client, peer and broker

26.7 MiB

run 1 · valid

client sent	9,998
client completed	9,998
broker received ($SYS)	9,998
broker sent ($SYS)	9,998
C sink received	9,998
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	672 µs / 1,278 µs / 3,162 µs
due in window, never published	2
CPU user / sys per msg	161 µs / 32.5 µs
CPU (share of a core)	19.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 9998; peer received 9998
no_loss: client saw 9998 completions; peer received 9998
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.10 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,998
client completed	9,998
broker received ($SYS)	9,998
broker sent ($SYS)	9,998
C sink received	9,998
in window: sent / delivered	7999 / 7999
schedule lag p50 / p99 / max	705 µs / 1,278 µs / 2,196 µs
due in window, never published	2
CPU user / sys per msg	161 µs / 31.3 µs
CPU (share of a core)	19.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 9998; peer received 9998
no_loss: client saw 9998 completions; peer received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 3,524 µs
due in window, never published	1
CPU user / sys per msg	169 µs / 26.2 µs
CPU (share of a core)	19.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

aiomqtt 2.5.1 asyncio

26.4 MiB

run 1 · valid

connect	3.0 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

connect	3.5 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

connect	3.0 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

27.2 MiB

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16004
schedule lag p50 / p99 / max	1,147 µs / 2,294 µs / 4,376 µs
due in window, never published	2
CPU user / sys per msg	253 µs / 16.2 µs
CPU (share of a core)	53.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16003 / 15999
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,860 µs
due in window, never published	1
CPU user / sys per msg	257 µs / 17.5 µs
CPU (share of a core)	54.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16003 of 16001 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,329 µs
due in window, never published	2
CPU user / sys per msg	257 µs / 16.2 µs
CPU (share of a core)	54.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

106.3 MiB

run 1 · valid

C source sent	707,977
broker received ($SYS)	707,977
broker sent ($SYS)	234,734
broker dropped ($SYS)	473,243
client received	113,666
in window: offered / received	566393 / 56039
CPU user / sys per msg	129 µs / 13.2 µs
CPU (share of a core)	99.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707977; peer wrote 707977
broker_confirms_deliveries: broker sent 234734; client received 113666 by t_stop
host_quiet: 0.06 cores busy outside the client, peer and broker

run 2 · valid

C source sent	708,077
broker received ($SYS)	708,077
broker sent ($SYS)	235,566
broker dropped ($SYS)	472,511
client received	115,759
in window: offered / received	566480 / 56896
CPU user / sys per msg	127 µs / 13.9 µs
CPU (share of a core)	100.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708077; peer wrote 708077
broker_confirms_deliveries: broker sent 235566; client received 115759 by t_stop
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	708,263
broker received ($SYS)	708,263
broker sent ($SYS)	235,086
broker dropped ($SYS)	473,177
client received	113,881
in window: offered / received	566672 / 56338
CPU user / sys per msg	129 µs / 13.5 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708263; peer wrote 708263
broker_confirms_deliveries: broker sent 235086; client received 113881 by t_stop
host_quiet: 0.03 cores busy outside the client, peer and broker

27.2 MiB

run 1 · valid

client sent	9,998
client completed	9,998
broker received ($SYS)	9,998
broker sent ($SYS)	9,998
C sink received	9,998
in window: sent / delivered	7999 / 8003
schedule lag p50 / p99 / max	901 µs / 1,868 µs / 2,176 µs
due in window, never published	2
CPU user / sys per msg	459 µs / 20.0 µs
CPU (share of a core)	47.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 9998; peer received 9998
no_loss: client saw 9998 completions; peer received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,998
client completed	9,998
broker received ($SYS)	9,998
broker sent ($SYS)	9,998
C sink received	9,998
in window: sent / delivered	7999 / 7999
schedule lag p50 / p99 / max	868 µs / 1,868 µs / 2,230 µs
due in window, never published	2
CPU user / sys per msg	464 µs / 25.0 µs
CPU (share of a core)	48.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 9998; peer received 9998
no_loss: client saw 9998 completions; peer received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8002
schedule lag p50 / p99 / max	868 µs / 1,802 µs / 2,073 µs
due in window, never published	1
CPU user / sys per msg	448 µs / 17.5 µs
CPU (share of a core)	46.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

awscrt 0.37.0 crt_event_loop native

26.5 MiB

run 1 · valid

connect	61.7 ms
CPU (share of a core)	0.0 %
threads	4

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

connect	62.6 ms
CPU (share of a core)	0.0 %
threads	4

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

connect	62.3 ms
CPU (share of a core)	0.0 %
threads	4

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

26.7 MiB

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	516 µs / 705 µs / 1,622 µs
due in window, never published	2
CPU user / sys per msg	85.0 µs / 19.4 µs
CPU (share of a core)	20.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	770 µs / 934 µs / 2,326 µs
due in window, never published	2
CPU user / sys per msg	50.6 µs / 53.1 µs
CPU (share of a core)	20.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.41 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	606 µs / 803 µs / 2,697 µs
due in window, never published	2
CPU user / sys per msg	88.1 µs / 15.6 µs
CPU (share of a core)	20.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

26.5 MiB

run 1 · valid

C source sent	707,948
broker received ($SYS)	707,948
broker sent ($SYS)	617,115
broker dropped ($SYS)	90,833
client received	617,115
in window: offered / received	566340 / 467022
CPU user / sys per msg	9.3 µs / 7.9 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707948; peer wrote 707948
broker_confirms_deliveries: broker sent 617115; client received 617115 by t_stop
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

C source sent	707,943
broker received ($SYS)	707,943
broker sent ($SYS)	621,588
broker dropped ($SYS)	86,355
client received	621,588
in window: offered / received	566425 / 465131
CPU user / sys per msg	9.1 µs / 8.1 µs
CPU (share of a core)	99.9 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707943; peer wrote 707943
broker_confirms_deliveries: broker sent 621588; client received 621588 by t_stop
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

C source sent	707,897
broker received ($SYS)	707,897
broker sent ($SYS)	617,348
broker dropped ($SYS)	90,549
client received	617,348
in window: offered / received	566309 / 463256
CPU user / sys per msg	9.1 µs / 8.2 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707897; peer wrote 707897
broker_confirms_deliveries: broker sent 617348; client received 617348 by t_stop
host_quiet: 0.23 cores busy outside the client, peer and broker

26.7 MiB

run 1 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 7997
schedule lag p50 / p99 / max	639 µs / 672 µs / 2,159 µs
due in window, never published	1
CPU user / sys per msg	132 µs / 8.8 µs
CPU (share of a core)	14.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.06 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8000
schedule lag p50 / p99 / max	152 µs / 500 µs / 3,089 µs
due in window, never published	1
CPU user / sys per msg	93.8 µs / 46.2 µs
CPU (share of a core)	14.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.06 of its core
host_quiet: 0.12 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	7999 / 8000
schedule lag p50 / p99 / max	770 µs / 901 µs / 1,827 µs
due in window, never published	1
CPU user / sys per msg	110 µs / 32.5 µs
CPU (share of a core)	14.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 7999 of 8000 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.06 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

amqtt 0.12.1 asyncio

28.6 MiB

run 1 · valid

connect	1.3 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 2 · valid

connect	1.3 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

connect	1.4 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

29.3 MiB

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15999
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,609 µs
due in window, never published	1
CPU user / sys per msg	269 µs / 25.0 µs
CPU (share of a core)	58.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 2,332 µs
due in window, never published	4
CPU user / sys per msg	269 µs / 26.9 µs
CPU (share of a core)	59.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,153 µs
due in window, never published	4
CPU user / sys per msg	272 µs / 22.5 µs
CPU (share of a core)	58.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

32.8 MiB

run 1 · valid

C source sent	708,001
broker received ($SYS)	708,001
broker sent ($SYS)	198,420
broker dropped ($SYS)	509,582
client received	198,420
in window: offered / received	566490 / 131072
CPU user / sys per msg	60.7 µs / 0.3 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708001; peer wrote 708001
broker_confirms_deliveries: broker sent 198420; client received 198420 by t_stop
host_quiet: 0.12 cores busy outside the client, peer and broker

run 2 · valid

C source sent	708,321
broker received ($SYS)	708,321
broker sent ($SYS)	196,402
broker dropped ($SYS)	511,920
client received	196,402
in window: offered / received	566586 / 131072
CPU user / sys per msg	60.7 µs / 0.3 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708321; peer wrote 708321
broker_confirms_deliveries: broker sent 196402; client received 196402 by t_stop
host_quiet: 0.03 cores busy outside the client, peer and broker

run 3 · valid

C source sent	708,187
broker received ($SYS)	708,187
broker sent ($SYS)	194,223
broker dropped ($SYS)	513,965
client received	194,223
in window: offered / received	566613 / 130492
CPU user / sys per msg	60.9 µs / 0.4 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708187; peer wrote 708187
broker_confirms_deliveries: broker sent 194223; client received 194223 by t_stop
host_quiet: 0.35 cores busy outside the client, peer and broker

29.3 MiB

run 1 · valid

client sent	9,998
client completed	9,998
broker received ($SYS)	9,998
broker sent ($SYS)	9,998
C sink received	9,998
in window: sent / delivered	7999 / 7999
schedule lag p50 / p99 / max	737 µs / 1,802 µs / 3,098 µs
due in window, never published	2
CPU user / sys per msg	525 µs / 28.8 µs
CPU (share of a core)	55.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 9998; peer received 9998
no_loss: client saw 9998 completions; peer received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.10 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	7999 / 8001
schedule lag p50 / p99 / max	803 µs / 1,933 µs / 2,546 µs
due in window, never published	1
CPU user / sys per msg	495 µs / 50.0 µs
CPU (share of a core)	54.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 7999 of 7999 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
broker received ($SYS)	9,999
broker sent ($SYS)	9,999
C sink received	9,999
in window: sent / delivered	8000 / 8001
schedule lag p50 / p99 / max	737 µs / 1,802 µs / 2,568 µs
due in window, never published	1
CPU user / sys per msg	521 µs / 35.0 µs
CPU (share of a core)	55.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 9999; peer received 9999
no_loss: client saw 9999 completions; peer received 9999
offered_rate_held: client published 8000 of 8001 offered in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.07 of its core
host_quiet: 0.11 cores busy outside the client, peer and broker

aiomqtt3 3.0.0a1 asyncio experimental

unsupported

What do connecting and idling cost?

One connection with nothing to do but keep alive.

client

connect ↓

idle CPU ↓

threads ↓

zmqtt 0.2.4 asyncio experimental

0.8 ms

run 1 · valid

connect	0.8 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

connect	0.8 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

connect	0.8 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

0.0 %

run 1 · valid

connect	0.8 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

connect	0.8 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

connect	0.8 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 1 · valid

connect	0.8 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

connect	0.8 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

connect	0.8 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

gmqtt 0.7.0 asyncio

0.9 ms

run 1 · valid

connect	1.0 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

connect	0.8 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

connect	0.9 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

0.0 %

run 1 · valid

connect	1.0 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

connect	0.8 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

connect	0.9 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 1 · valid

connect	1.0 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

connect	0.8 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

connect	0.9 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

mqttium 1.1.0 asyncio

1.2 ms

run 1 · valid

connect	1.2 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 2 · valid

connect	1.2 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

connect	1.2 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

0.0 %

run 1 · valid

connect	1.2 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 2 · valid

connect	1.2 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

connect	1.2 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 1 · valid

connect	1.2 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 2 · valid

connect	1.2 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

connect	1.2 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

amqtt 0.12.1 asyncio

1.3 ms

run 1 · valid

connect	1.3 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 2 · valid

connect	1.3 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

connect	1.4 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

0.0 %

run 1 · valid

connect	1.3 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 2 · valid

connect	1.3 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

connect	1.4 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 1 · valid

connect	1.3 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 2 · valid

connect	1.3 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

connect	1.4 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

paho 2.1.0 sync

1.7 ms

run 1 · valid

connect	1.7 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

connect	1.7 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

connect	1.7 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

0.0 %

run 1 · valid

connect	1.7 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

connect	1.7 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

connect	1.7 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 1 · valid

connect	1.7 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

connect	1.7 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

connect	1.7 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

aiomqtt 2.5.1 asyncio

3.0 ms

run 1 · valid

connect	3.0 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

connect	3.5 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

connect	3.0 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

0.0 %

run 1 · valid

connect	3.0 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

connect	3.5 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

connect	3.0 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 1 · valid

connect	3.0 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

connect	3.5 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

connect	3.0 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

awscrt 0.37.0 crt_event_loop native

62.3 ms

run 1 · valid

connect	61.7 ms
CPU (share of a core)	0.0 %
threads	4

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

connect	62.6 ms
CPU (share of a core)	0.0 %
threads	4

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

connect	62.3 ms
CPU (share of a core)	0.0 %
threads	4

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

0.0 %

run 1 · valid

connect	61.7 ms
CPU (share of a core)	0.0 %
threads	4

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

connect	62.6 ms
CPU (share of a core)	0.0 %
threads	4

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

connect	62.3 ms
CPU (share of a core)	0.0 %
threads	4

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 1 · valid

connect	61.7 ms
CPU (share of a core)	0.0 %
threads	4

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

connect	62.6 ms
CPU (share of a core)	0.0 %
threads	4

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

connect	62.3 ms
CPU (share of a core)	0.0 %
threads	4

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

aiomqtt3 3.0.0a1 asyncio experimental

unsupported

Does MQTT 5 cost more?

The fixed-rate points again over MQTT 5 — the only rows for aiomqtt3, which speaks nothing else.

client

publish CPU / msg ↓

receive CPU / msg ↓

publish p99 ↓

round trip p99 ↓

awscrt 0.37.0 crt_event_loop native

110 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	516 µs / 639 µs / 1,555 µs
due in window, never published	2
CPU user / sys per msg	95.6 µs / 13.1 µs
CPU (share of a core)	21.8 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	516 µs / 934 µs / 3,353 µs
due in window, never published	2
CPU user / sys per msg	72.5 µs / 37.5 µs
CPU (share of a core)	22.0 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	500 µs / 934 µs / 2,952 µs
due in window, never published	1
CPU user / sys per msg	104 µs / 6.9 µs
CPU (share of a core)	22.1 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

65.0 µs

run 1 · attempt 2 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15995 / 15995
CPU user / sys per msg	45.6 µs / 19.4 µs
CPU (share of a core)	13.0 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15996 / 15996
CPU user / sys per msg	45.0 µs / 20.0 µs
CPU (share of a core)	13.0 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,986
broker received ($SYS)	19,986
broker sent ($SYS)	19,986
broker dropped ($SYS)	0
client received	19,986
in window: offered / received	15987 / 15987
CPU user / sys per msg	38.2 µs / 25.6 µs
CPU (share of a core)	12.7 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19986; peer wrote 19986
broker_confirms_deliveries: broker sent 19986; client received 19986
no_loss: broker acknowledged 19986 from the peer; client received 19986; broker dropped 0
offered_rate_held: peer wrote 15987 of 16000 offered in the window
client_kept_up: client received 15987 of 15987 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.39 cores busy outside the client, peer and broker

209 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	516 µs / 639 µs / 1,555 µs
due in window, never published	2
CPU user / sys per msg	95.6 µs / 13.1 µs
CPU (share of a core)	21.8 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	516 µs / 934 µs / 3,353 µs
due in window, never published	2
CPU user / sys per msg	72.5 µs / 37.5 µs
CPU (share of a core)	22.0 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	500 µs / 934 µs / 2,952 µs
due in window, never published	1
CPU user / sys per msg	104 µs / 6.9 µs
CPU (share of a core)	22.1 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

40.9 ms

run 1 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	46.1 µs / 1,032 µs / 1,964 µs
due in window, never published	2
CPU user / sys per msg	106 µs / 63.8 µs
CPU (share of a core)	17.0 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7998 of 8000 offered in the window
responses_kept_up: client received 8029 replies to 7998 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.03 cores busy outside the client, peer and broker

run 2 · attempt 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	319 µs / 705 µs / 3,232 µs
due in window, never published	1
CPU user / sys per msg	114 µs / 48.8 µs
CPU (share of a core)	16.3 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.03 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	770 µs / 967 µs / 3,012 µs
due in window, never published	1
CPU user / sys per msg	109 µs / 63.8 µs
CPU (share of a core)	17.3 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8004 replies to 8000 requests in the window
broker_headroom: broker used 0.05 of its core
host_quiet: 0.04 cores busy outside the client, peer and broker

gmqtt 0.7.0 asyncio

123 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,733 µs
due in window, never published	2
CPU user / sys per msg	91.9 µs / 33.1 µs
CPU (share of a core)	25.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,847 µs
due in window, never published	2
CPU user / sys per msg	92.5 µs / 30.6 µs
CPU (share of a core)	24.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16002 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 3,279 µs
due in window, never published	1
CPU user / sys per msg	90.6 µs / 31.9 µs
CPU (share of a core)	24.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16002 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.25 cores busy outside the client, peer and broker

102 µs

run 1 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15996 / 15996
CPU user / sys per msg	66.3 µs / 35.6 µs
CPU (share of a core)	20.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.02 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
broker dropped ($SYS)	0
client received	19,998
in window: offered / received	15999 / 15999
CPU user / sys per msg	78.8 µs / 24.4 µs
CPU (share of a core)	20.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19998; peer wrote 19998
broker_confirms_deliveries: broker sent 19998; client received 19998
no_loss: broker acknowledged 19998 from the peer; client received 19998; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15998 / 15998
CPU user / sys per msg	83.8 µs / 18.1 µs
CPU (share of a core)	20.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

160 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,733 µs
due in window, never published	2
CPU user / sys per msg	91.9 µs / 33.1 µs
CPU (share of a core)	25.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,847 µs
due in window, never published	2
CPU user / sys per msg	92.5 µs / 30.6 µs
CPU (share of a core)	24.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16002 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 3,279 µs
due in window, never published	1
CPU user / sys per msg	90.6 µs / 31.9 µs
CPU (share of a core)	24.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16002 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.25 cores busy outside the client, peer and broker

385 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	500 µs / 1,343 µs / 1,650 µs
due in window, never published	1
CPU user / sys per msg	176 µs / 81.2 µs
CPU (share of a core)	25.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,343 µs / 3,358 µs
due in window, never published	1
CPU user / sys per msg	180 µs / 80.0 µs
CPU (share of a core)	26.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8001 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.28 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	541 µs / 1,343 µs / 3,116 µs
due in window, never published	2
CPU user / sys per msg	183 µs / 76.3 µs
CPU (share of a core)	25.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 7999 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.24 cores busy outside the client, peer and broker

mqttium 1.1.0 asyncio

149 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15999 / 16000
schedule lag p50 / p99 / max	672 µs / 1,409 µs / 3,223 µs
due in window, never published	3
CPU user / sys per msg	126 µs / 21.9 µs
CPU (share of a core)	29.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.12 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	770 µs / 1,475 µs / 2,740 µs
due in window, never published	2
CPU user / sys per msg	129 µs / 20.0 µs
CPU (share of a core)	29.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	672 µs / 1,475 µs / 2,853 µs
due in window, never published	3
CPU user / sys per msg	128 µs / 21.9 µs
CPU (share of a core)	29.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.11 cores busy outside the client, peer and broker

96.9 µs

run 1 · valid

C source sent	19,991
broker received ($SYS)	19,991
broker sent ($SYS)	19,991
broker dropped ($SYS)	0
client received	19,991
in window: offered / received	15993 / 15993
CPU user / sys per msg	67.5 µs / 30.0 µs
CPU (share of a core)	19.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19991; peer wrote 19991
broker_confirms_deliveries: broker sent 19991; client received 19991
no_loss: broker acknowledged 19991 from the peer; client received 19991; broker dropped 0
offered_rate_held: peer wrote 15993 of 16000 offered in the window
client_kept_up: client received 15993 of 15993 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · attempt 2 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15997 / 15997
CPU user / sys per msg	86.9 µs / 9.4 µs
CPU (share of a core)	19.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15999 / 15999
CPU user / sys per msg	83.1 µs / 13.8 µs
CPU (share of a core)	19.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

242 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15999 / 16000
schedule lag p50 / p99 / max	672 µs / 1,409 µs / 3,223 µs
due in window, never published	3
CPU user / sys per msg	126 µs / 21.9 µs
CPU (share of a core)	29.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.12 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	770 µs / 1,475 µs / 2,740 µs
due in window, never published	2
CPU user / sys per msg	129 µs / 20.0 µs
CPU (share of a core)	29.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	672 µs / 1,475 µs / 2,853 µs
due in window, never published	3
CPU user / sys per msg	128 µs / 21.9 µs
CPU (share of a core)	29.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.11 cores busy outside the client, peer and broker

418 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	573 µs / 1,409 µs / 1,593 µs
due in window, never published	1
CPU user / sys per msg	235 µs / 31.2 µs
CPU (share of a core)	26.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.12 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,343 µs / 2,409 µs
due in window, never published	1
CPU user / sys per msg	224 µs / 42.5 µs
CPU (share of a core)	26.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	541 µs / 1,343 µs / 2,706 µs
due in window, never published	1
CPU user / sys per msg	210 µs / 55.0 µs
CPU (share of a core)	26.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8001 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.23 cores busy outside the client, peer and broker

paho 2.1.0 sync

159 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	516 µs / 770 µs / 2,684 µs
due in window, never published	2
CPU user / sys per msg	142 µs / 19.4 µs
CPU (share of a core)	32.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 15999
schedule lag p50 / p99 / max	672 µs / 836 µs / 2,265 µs
due in window, never published	1
CPU user / sys per msg	94.4 µs / 59.4 µs
CPU (share of a core)	30.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	541 µs / 803 µs / 3,199 µs
due in window, never published	1
CPU user / sys per msg	41.9 µs / 117 µs
CPU (share of a core)	31.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.10 cores busy outside the client, peer and broker

114 µs

run 1 · attempt 2 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15999 / 15999
CPU user / sys per msg	93.8 µs / 20.6 µs
CPU (share of a core)	22.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
broker dropped ($SYS)	0
client received	19,998
in window: offered / received	15999 / 15999
CPU user / sys per msg	81.3 µs / 35.0 µs
CPU (share of a core)	23.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19998; peer wrote 19998
broker_confirms_deliveries: broker sent 19998; client received 19998
no_loss: broker acknowledged 19998 from the peer; client received 19998; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,989
broker received ($SYS)	19,989
broker sent ($SYS)	19,989
broker dropped ($SYS)	0
client received	19,989
in window: offered / received	15992 / 15992
CPU user / sys per msg	92.5 µs / 21.9 µs
CPU (share of a core)	22.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19989; peer wrote 19989
broker_confirms_deliveries: broker sent 19989; client received 19989
no_loss: broker acknowledged 19989 from the peer; client received 19989; broker dropped 0
offered_rate_held: peer wrote 15992 of 16000 offered in the window
client_kept_up: client received 15992 of 15992 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

258 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	516 µs / 770 µs / 2,684 µs
due in window, never published	2
CPU user / sys per msg	142 µs / 19.4 µs
CPU (share of a core)	32.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 15999
schedule lag p50 / p99 / max	672 µs / 836 µs / 2,265 µs
due in window, never published	1
CPU user / sys per msg	94.4 µs / 59.4 µs
CPU (share of a core)	30.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	541 µs / 803 µs / 3,199 µs
due in window, never published	1
CPU user / sys per msg	41.9 µs / 117 µs
CPU (share of a core)	31.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.10 cores busy outside the client, peer and broker

418 µs 2/3 valid

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	770 µs / 803 µs / 2,717 µs
due in window, never published	1
CPU user / sys per msg	268 µs / 66.2 µs
CPU (share of a core)	33.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	434 µs / 901 µs / 2,515 µs
due in window, never published	1
CPU user / sys per msg	212 µs / 126 µs
CPU (share of a core)	33.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.10 of its core
host_quiet: 0.32 cores busy outside the client, peer and broker

run 3 · attempt 2 · invalid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	135 µs / 934 µs / 2,047 µs
due in window, never published	1
CPU user / sys per msg	205 µs / 175 µs
CPU (share of a core)	38.0 %
threads	2

host_quiet: 1.31 cores busy outside the client, peer and broker
worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.11 of its core

aiomqtt 2.5.1 asyncio

271 µs

run 1 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15997 / 16001
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,428 µs
due in window, never published	4
CPU user / sys per msg	261 µs / 18.8 µs
CPU (share of a core)	55.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15997 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 2,297 µs
due in window, never published	3
CPU user / sys per msg	252 µs / 19.4 µs
CPU (share of a core)	54.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 15996
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,759 µs
due in window, never published	2
CPU user / sys per msg	247 µs / 23.1 µs
CPU (share of a core)	54.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

206 µs

run 1 · valid

C source sent	19,991
broker received ($SYS)	19,991
broker sent ($SYS)	19,991
broker dropped ($SYS)	0
client received	19,991
in window: offered / received	15992 / 15992
CPU user / sys per msg	187 µs / 20.6 µs
CPU (share of a core)	41.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19991; peer wrote 19991
broker_confirms_deliveries: broker sent 19991; client received 19991
no_loss: broker acknowledged 19991 from the peer; client received 19991; broker dropped 0
offered_rate_held: peer wrote 15992 of 16000 offered in the window
client_kept_up: client received 15992 of 15992 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15996 / 15996
CPU user / sys per msg	177 µs / 28.8 µs
CPU (share of a core)	41.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.10 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,988
broker received ($SYS)	19,988
broker sent ($SYS)	19,988
broker dropped ($SYS)	0
client received	19,988
in window: offered / received	15989 / 15989
CPU user / sys per msg	186 µs / 20.0 µs
CPU (share of a core)	41.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19988; peer wrote 19988
broker_confirms_deliveries: broker sent 19988; client received 19988
no_loss: broker acknowledged 19988 from the peer; client received 19988; broker dropped 0
offered_rate_held: peer wrote 15989 of 16000 offered in the window
client_kept_up: client received 15989 of 15989 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.05 cores busy outside the client, peer and broker

1,278 µs

run 1 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15997 / 16001
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,428 µs
due in window, never published	4
CPU user / sys per msg	261 µs / 18.8 µs
CPU (share of a core)	55.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15997 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 2,297 µs
due in window, never published	3
CPU user / sys per msg	252 µs / 19.4 µs
CPU (share of a core)	54.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 15996
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,759 µs
due in window, never published	2
CPU user / sys per msg	247 µs / 23.1 µs
CPU (share of a core)	54.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

4,850 µs

run 1 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	541 µs / 2,064 µs / 4,243 µs
due in window, never published	2
CPU user / sys per msg	680 µs / 40.0 µs
CPU (share of a core)	71.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	737 µs / 2,163 µs / 4,618 µs
due in window, never published	2
CPU user / sys per msg	639 µs / 70.0 µs
CPU (share of a core)	70.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 7998 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.29 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,997
C echo received	9,997
C echo replied	9,997
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
client replies	9,997
schedule lag p50 / p99 / max	516 µs / 2,064 µs / 4,482 µs
due in window, never published	3
CPU user / sys per msg	675 µs / 50.0 µs
CPU (share of a core)	72.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9997 from the client; client sent 9997, completed 9997
broker_confirms_deliveries: broker sent 19994; client received 9997, echo received 9997
no_loss: echo sent 9997 replies; client received 9997
offered_rate_held: client published 7998 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 7998 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

aiomqtt3 3.0.0a1 asyncio experimental

291 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	803 µs / 1,933 µs / 3,445 µs
due in window, never published	3
CPU user / sys per msg	259 µs / 30.0 µs
CPU (share of a core)	57.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	770 µs / 1,868 µs / 4,065 µs
due in window, never published	1
CPU user / sys per msg	272 µs / 28.8 µs
CPU (share of a core)	60.1 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	803 µs / 1,933 µs / 2,742 µs
due in window, never published	4
CPU user / sys per msg	258 µs / 32.5 µs
CPU (share of a core)	58.2 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16002 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

124 µs

run 1 · valid

C source sent	19,989
broker received ($SYS)	19,989
broker sent ($SYS)	19,989
broker dropped ($SYS)	0
client received	19,989
in window: offered / received	15991 / 15991
CPU user / sys per msg	104 µs / 17.5 µs
CPU (share of a core)	24.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19989; peer wrote 19989
broker_confirms_deliveries: broker sent 19989; client received 19989
no_loss: broker acknowledged 19989 from the peer; client received 19989; broker dropped 0
offered_rate_held: peer wrote 15991 of 16000 offered in the window
client_kept_up: client received 15991 of 15991 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,976
broker received ($SYS)	19,976
broker sent ($SYS)	19,976
broker dropped ($SYS)	0
client received	19,976
in window: offered / received	15982 / 15982
CPU user / sys per msg	88.2 µs / 35.7 µs
CPU (share of a core)	24.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19976; peer wrote 19976
broker_confirms_deliveries: broker sent 19976; client received 19976
no_loss: broker acknowledged 19976 from the peer; client received 19976; broker dropped 0
offered_rate_held: peer wrote 15982 of 16000 offered in the window
client_kept_up: client received 15982 of 15982 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.26 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,991
broker received ($SYS)	19,991
broker sent ($SYS)	19,991
broker dropped ($SYS)	0
client received	19,991
in window: offered / received	15993 / 15993
CPU user / sys per msg	117 µs / 8.8 µs
CPU (share of a core)	25.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19991; peer wrote 19991
broker_confirms_deliveries: broker sent 19991; client received 19991
no_loss: broker acknowledged 19991 from the peer; client received 19991; broker dropped 0
offered_rate_held: peer wrote 15993 of 16000 offered in the window
client_kept_up: client received 15993 of 15993 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

135 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	803 µs / 1,933 µs / 3,445 µs
due in window, never published	3
CPU user / sys per msg	259 µs / 30.0 µs
CPU (share of a core)	57.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	770 µs / 1,868 µs / 4,065 µs
due in window, never published	1
CPU user / sys per msg	272 µs / 28.8 µs
CPU (share of a core)	60.1 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	803 µs / 1,933 µs / 2,742 µs
due in window, never published	4
CPU user / sys per msg	258 µs / 32.5 µs
CPU (share of a core)	58.2 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16002 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

1,540 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	934 µs / 1,802 µs / 2,971 µs
due in window, never published	1
CPU user / sys per msg	430 µs / 56.2 µs
CPU (share of a core)	48.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.07 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	934 µs / 1,802 µs / 3,324 µs
due in window, never published	2
CPU user / sys per msg	431 µs / 50.0 µs
CPU (share of a core)	48.2 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8001 offered in the window
responses_kept_up: client received 7999 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	934 µs / 1,868 µs / 1,999 µs
due in window, never published	1
CPU user / sys per msg	435 µs / 52.5 µs
CPU (share of a core)	48.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8001 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

zmqtt 0.2.4 asyncio experimental

296 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16002 / 16003
schedule lag p50 / p99 / max	836 µs / 1,868 µs / 2,381 µs
due in window, never published	1
CPU user / sys per msg	281 µs / 26.9 µs
CPU (share of a core)	61.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16002 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,992
client completed	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
C sink received	19,992
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	836 µs / 1,868 µs / 2,673 µs
due in window, never published	4
CPU user / sys per msg	256 µs / 41.3 µs
CPU (share of a core)	59.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19992 from the client; client sent 19992, completed 19992
broker_confirms_deliveries: broker sent 19992; peer received 19992
no_loss: client saw 19992 completions; peer received 19992
offered_rate_held: client published 15999 of 16002 offered in the window
payloads_intact: 0 of 19992 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.27 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 3,145 µs
due in window, never published	3
CPU user / sys per msg	273 µs / 16.9 µs
CPU (share of a core)	58.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.12 cores busy outside the client, peer and broker

169 µs

run 1 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15995 / 15995
CPU user / sys per msg	164 µs / 6.9 µs
CPU (share of a core)	34.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15997 / 15997
CPU user / sys per msg	153 µs / 15.6 µs
CPU (share of a core)	33.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.05 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15993 / 15993
CPU user / sys per msg	151 µs / 18.1 µs
CPU (share of a core)	33.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15993 of 16000 offered in the window
client_kept_up: client received 15993 of 15993 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

143 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16002 / 16003
schedule lag p50 / p99 / max	836 µs / 1,868 µs / 2,381 µs
due in window, never published	1
CPU user / sys per msg	281 µs / 26.9 µs
CPU (share of a core)	61.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16002 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,992
client completed	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
C sink received	19,992
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	836 µs / 1,868 µs / 2,673 µs
due in window, never published	4
CPU user / sys per msg	256 µs / 41.3 µs
CPU (share of a core)	59.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19992 from the client; client sent 19992, completed 19992
broker_confirms_deliveries: broker sent 19992; peer received 19992
no_loss: client saw 19992 completions; peer received 19992
offered_rate_held: client published 15999 of 16002 offered in the window
payloads_intact: 0 of 19992 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.27 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 3,145 µs
due in window, never published	3
CPU user / sys per msg	273 µs / 16.9 µs
CPU (share of a core)	58.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.12 cores busy outside the client, peer and broker

4,588 µs

run 1 · valid

client requests	9,999
C echo received	9,999
C echo replied	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
client replies	9,999
schedule lag p50 / p99 / max	1,147 µs / 2,163 µs / 3,271 µs
due in window, never published	1
CPU user / sys per msg	472 µs / 47.5 µs
CPU (share of a core)	52.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, echo received 9999
no_loss: echo sent 9999 replies; client received 9999
offered_rate_held: client published 8001 of 8000 offered in the window
responses_kept_up: client received 7999 replies to 8001 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	1,147 µs / 2,163 µs / 2,290 µs
due in window, never published	2
CPU user / sys per msg	486 µs / 45.0 µs
CPU (share of a core)	53.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 7999 of 8000 offered in the window
responses_kept_up: client received 8001 replies to 7999 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client requests	9,998
C echo received	9,998
C echo replied	9,998
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
client replies	9,998
schedule lag p50 / p99 / max	1,147 µs / 2,163 µs / 2,314 µs
due in window, never published	2
CPU user / sys per msg	476 µs / 46.2 µs
CPU (share of a core)	52.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19996; client received 9998, echo received 9998
no_loss: echo sent 9998 replies; client received 9998
offered_rate_held: client published 8000 of 8000 offered in the window
responses_kept_up: client received 8000 replies to 8000 requests in the window
broker_headroom: broker used 0.09 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

amqtt 0.12.1 asyncio

unsupported

How does the cost change with the load?

Client CPU per message at 500, 2,000 and 5,000 QoS 1 msgs/s, the same absolute offers for every client. A client that cannot hold 5,000/s shows as not sustained there.

client

publish 500/s
CPU / msg ↓

publish 2k/s
CPU / msg ↓

publish 5k/s
CPU / msg ↓

receive 500/s
CPU / msg ↓

receive 2k/s
CPU / msg ↓

receive 5k/s
CPU / msg ↓

awscrt 0.37.0 crt_event_loop native

182 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	287 µs / 770 µs / 2,023 µs
due in window, never published	1
CPU user / sys per msg	92.5 µs / 90.0 µs
CPU (share of a core)	9.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.05 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	967 µs / 999 µs / 2,906 µs
due in window, never published	1
CPU user / sys per msg	97.5 µs / 82.5 µs
CPU (share of a core)	9.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.23 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	737 µs / 967 µs / 2,385 µs
due in window, never published	1
CPU user / sys per msg	72.5 µs / 110 µs
CPU (share of a core)	9.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.05 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

104 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	516 µs / 705 µs / 1,622 µs
due in window, never published	2
CPU user / sys per msg	85.0 µs / 19.4 µs
CPU (share of a core)	20.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	770 µs / 934 µs / 2,326 µs
due in window, never published	2
CPU user / sys per msg	50.6 µs / 53.1 µs
CPU (share of a core)	20.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.41 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	606 µs / 803 µs / 2,697 µs
due in window, never published	2
CPU user / sys per msg	88.1 µs / 15.6 µs
CPU (share of a core)	20.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

78.0 µs

run 1 · valid

client sent	49,996
client completed	49,996
broker received ($SYS)	49,996
broker sent ($SYS)	49,996
C sink received	49,996
in window: sent / delivered	39996 / 40001
schedule lag p50 / p99 / max	573 µs / 934 µs / 3,863 µs
due in window, never published	4
CPU user / sys per msg	70.3 µs / 7.8 µs
CPU (share of a core)	39.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49996 from the client; client sent 49996, completed 49996
broker_confirms_deliveries: broker sent 49996; peer received 49996
no_loss: client saw 49996 completions; peer received 49996
offered_rate_held: client published 39996 of 39999 offered in the window
payloads_intact: 0 of 49996 payloads had an unexpected length
broker_headroom: broker used 0.18 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	49,999
client completed	49,999
broker received ($SYS)	49,999
broker sent ($SYS)	49,999
C sink received	49,999
in window: sent / delivered	39999 / 39999
schedule lag p50 / p99 / max	573 µs / 999 µs / 2,545 µs
due in window, never published	1
CPU user / sys per msg	25.5 µs / 51.0 µs
CPU (share of a core)	38.2 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49999 from the client; client sent 49999, completed 49999
broker_confirms_deliveries: broker sent 49999; peer received 49999
no_loss: client saw 49999 completions; peer received 49999
offered_rate_held: client published 39999 of 40000 offered in the window
payloads_intact: 0 of 49999 payloads had an unexpected length
broker_headroom: broker used 0.18 of its core
host_quiet: 0.46 cores busy outside the client, peer and broker

run 3 · valid

client sent	49,998
client completed	49,998
broker received ($SYS)	49,998
broker sent ($SYS)	49,998
C sink received	49,998
in window: sent / delivered	39998 / 40002
schedule lag p50 / p99 / max	541 µs / 934 µs / 2,752 µs
due in window, never published	2
CPU user / sys per msg	33.0 µs / 45.3 µs
CPU (share of a core)	39.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49998 from the client; client sent 49998, completed 49998
broker_confirms_deliveries: broker sent 49998; peer received 49998
no_loss: client saw 49998 completions; peer received 49998
offered_rate_held: client published 39998 of 39999 offered in the window
payloads_intact: 0 of 49998 payloads had an unexpected length
broker_headroom: broker used 0.18 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

79.8 µs

run 1 · valid

C source sent	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
broker dropped ($SYS)	0
client received	4,999
in window: offered / received	4000 / 4000
CPU user / sys per msg	40.0 µs / 35.0 µs
CPU (share of a core)	3.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4999; peer wrote 4999
broker_confirms_deliveries: broker sent 4999; client received 4999
no_loss: broker acknowledged 4999 from the peer; client received 4999; broker dropped 0
offered_rate_held: peer wrote 4000 of 4000 offered in the window
client_kept_up: client received 4000 of 4000 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.29 cores busy outside the client, peer and broker

run 2 · valid

C source sent	4,997
broker received ($SYS)	4,997
broker sent ($SYS)	4,997
broker dropped ($SYS)	0
client received	4,997
in window: offered / received	3998 / 3998
CPU user / sys per msg	80.0 µs / 10.0 µs
CPU (share of a core)	4.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4997; peer wrote 4997
broker_confirms_deliveries: broker sent 4997; client received 4997
no_loss: broker acknowledged 4997 from the peer; client received 4997; broker dropped 0
offered_rate_held: peer wrote 3998 of 4000 offered in the window
client_kept_up: client received 3998 of 3998 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.05 cores busy outside the client, peer and broker

run 3 · valid

C source sent	4,998
broker received ($SYS)	4,998
broker sent ($SYS)	4,998
broker dropped ($SYS)	0
client received	4,998
in window: offered / received	3999 / 3999
CPU user / sys per msg	75.0 µs / 5.0 µs
CPU (share of a core)	4.0 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4998; peer wrote 4998
broker_confirms_deliveries: broker sent 4998; client received 4998
no_loss: broker acknowledged 4998 from the peer; client received 4998; broker dropped 0
offered_rate_held: peer wrote 3999 of 4000 offered in the window
client_kept_up: client received 3999 of 3999 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

44.4 µs

run 1 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15995 / 15995
CPU user / sys per msg	27.5 µs / 16.9 µs
CPU (share of a core)	8.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
broker dropped ($SYS)	0
client received	19,997
in window: offered / received	15999 / 15999
CPU user / sys per msg	26.9 µs / 18.1 µs
CPU (share of a core)	9.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19997; peer wrote 19997
broker_confirms_deliveries: broker sent 19997; client received 19997
no_loss: broker acknowledged 19997 from the peer; client received 19997; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.42 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,985
broker received ($SYS)	19,985
broker sent ($SYS)	19,985
broker dropped ($SYS)	0
client received	19,985
in window: offered / received	15987 / 15987
CPU user / sys per msg	9.4 µs / 35.0 µs
CPU (share of a core)	8.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19985; peer wrote 19985
broker_confirms_deliveries: broker sent 19985; client received 19985
no_loss: broker acknowledged 19985 from the peer; client received 19985; broker dropped 0
offered_rate_held: peer wrote 15987 of 16000 offered in the window
client_kept_up: client received 15987 of 15987 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.01 cores busy outside the client, peer and broker

40.0 µs

run 1 · valid

C source sent	49,970
broker received ($SYS)	49,970
broker sent ($SYS)	49,970
broker dropped ($SYS)	0
client received	49,970
in window: offered / received	39975 / 39975
CPU user / sys per msg	13.0 µs / 26.3 µs
CPU (share of a core)	19.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49970; peer wrote 49970
broker_confirms_deliveries: broker sent 49970; client received 49970
no_loss: broker acknowledged 49970 from the peer; client received 49970; broker dropped 0
offered_rate_held: peer wrote 39975 of 40000 offered in the window
client_kept_up: client received 39975 of 39975 in the window
broker_headroom: broker used 0.26 of its core
host_quiet: 0.07 cores busy outside the client, peer and broker

run 2 · valid

C source sent	49,973
broker received ($SYS)	49,973
broker sent ($SYS)	49,973
broker dropped ($SYS)	0
client received	49,973
in window: offered / received	39988 / 39989
CPU user / sys per msg	18.0 µs / 22.8 µs
CPU (share of a core)	20.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49973; peer wrote 49973
broker_confirms_deliveries: broker sent 49973; client received 49973
no_loss: broker acknowledged 49973 from the peer; client received 49973; broker dropped 0
offered_rate_held: peer wrote 39988 of 40000 offered in the window
client_kept_up: client received 39989 of 39988 in the window
broker_headroom: broker used 0.26 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

run 3 · valid

C source sent	49,982
broker received ($SYS)	49,982
broker sent ($SYS)	49,982
broker dropped ($SYS)	0
client received	49,982
in window: offered / received	39986 / 39986
CPU user / sys per msg	13.0 µs / 27.0 µs
CPU (share of a core)	20.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49982; peer wrote 49982
broker_confirms_deliveries: broker sent 49982; client received 49982
no_loss: broker acknowledged 49982 from the peer; client received 49982; broker dropped 0
offered_rate_held: peer wrote 39986 of 40000 offered in the window
client_kept_up: client received 39986 of 39986 in the window
broker_headroom: broker used 0.26 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

paho 2.1.0 sync

248 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 803 µs / 2,717 µs
due in window, never published	1
CPU user / sys per msg	232 µs / 22.5 µs
CPU (share of a core)	12.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.39 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	75.8 µs / 737 µs / 2,008 µs
due in window, never published	1
CPU user / sys per msg	175 µs / 72.5 µs
CPU (share of a core)	12.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.05 of its core
host_quiet: 0.41 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 705 µs / 1,561 µs
due in window, never published	1
CPU user / sys per msg	222 µs / 22.5 µs
CPU (share of a core)	12.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.05 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

161 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	500 µs / 573 µs / 2,448 µs
due in window, never published	2
CPU user / sys per msg	134 µs / 25.6 µs
CPU (share of a core)	32.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	573 µs / 639 µs / 1,411 µs
due in window, never published	2
CPU user / sys per msg	143 µs / 18.8 µs
CPU (share of a core)	32.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	541 µs / 770 µs / 1,710 µs
due in window, never published	2
CPU user / sys per msg	90.6 µs / 70.6 µs
CPU (share of a core)	32.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.26 cores busy outside the client, peer and broker

108 µs

run 1 · valid

client sent	49,996
client completed	49,996
broker received ($SYS)	49,996
broker sent ($SYS)	49,996
C sink received	49,996
in window: sent / delivered	40001 / 40001
schedule lag p50 / p99 / max	606 µs / 934 µs / 2,654 µs
due in window, never published	4
CPU user / sys per msg	68.0 µs / 36.2 µs
CPU (share of a core)	52.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49996 from the client; client sent 49996, completed 49996
broker_confirms_deliveries: broker sent 49996; peer received 49996
no_loss: client saw 49996 completions; peer received 49996
offered_rate_held: client published 40001 of 40000 offered in the window
payloads_intact: 0 of 49996 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.34 cores busy outside the client, peer and broker

run 2 · valid

client sent	49,995
client completed	49,995
broker received ($SYS)	49,995
broker sent ($SYS)	49,995
C sink received	49,995
in window: sent / delivered	39995 / 40000
schedule lag p50 / p99 / max	483 µs / 868 µs / 1,419 µs
due in window, never published	5
CPU user / sys per msg	86.5 µs / 21.0 µs
CPU (share of a core)	53.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49995 from the client; client sent 49995, completed 49995
broker_confirms_deliveries: broker sent 49995; peer received 49995
no_loss: client saw 49995 completions; peer received 49995
offered_rate_held: client published 39995 of 39999 offered in the window
payloads_intact: 0 of 49995 payloads had an unexpected length
broker_headroom: broker used 0.16 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	49,998
client completed	49,998
broker received ($SYS)	49,998
broker sent ($SYS)	49,998
C sink received	49,998
in window: sent / delivered	40001 / 40001
schedule lag p50 / p99 / max	541 µs / 901 µs / 1,968 µs
due in window, never published	2
CPU user / sys per msg	55.2 µs / 56.2 µs
CPU (share of a core)	55.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49998 from the client; client sent 49998, completed 49998
broker_confirms_deliveries: broker sent 49998; peer received 49998
no_loss: client saw 49998 completions; peer received 49998
offered_rate_held: client published 40001 of 40000 offered in the window
payloads_intact: 0 of 49998 payloads had an unexpected length
broker_headroom: broker used 0.16 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

154 µs

run 1 · valid

C source sent	4,998
broker received ($SYS)	4,998
broker sent ($SYS)	4,998
broker dropped ($SYS)	0
client received	4,998
in window: offered / received	3999 / 3999
CPU user / sys per msg	115 µs / 40.0 µs
CPU (share of a core)	7.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4998; peer wrote 4998
broker_confirms_deliveries: broker sent 4998; client received 4998
no_loss: broker acknowledged 4998 from the peer; client received 4998; broker dropped 0
offered_rate_held: peer wrote 3999 of 4000 offered in the window
client_kept_up: client received 3999 of 3999 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.26 cores busy outside the client, peer and broker

run 2 · valid

C source sent	4,998
broker received ($SYS)	4,998
broker sent ($SYS)	4,998
broker dropped ($SYS)	0
client received	4,998
in window: offered / received	3999 / 3999
CPU user / sys per msg	128 µs / 25.0 µs
CPU (share of a core)	7.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4998; peer wrote 4998
broker_confirms_deliveries: broker sent 4998; client received 4998
no_loss: broker acknowledged 4998 from the peer; client received 4998; broker dropped 0
offered_rate_held: peer wrote 3999 of 4000 offered in the window
client_kept_up: client received 3999 of 3999 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.49 cores busy outside the client, peer and broker

run 3 · valid

C source sent	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
broker dropped ($SYS)	0
client received	4,999
in window: offered / received	4000 / 4000
CPU user / sys per msg	120 µs / 25.0 µs
CPU (share of a core)	7.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4999; peer wrote 4999
broker_confirms_deliveries: broker sent 4999; client received 4999
no_loss: broker acknowledged 4999 from the peer; client received 4999; broker dropped 0
offered_rate_held: peer wrote 4000 of 4000 offered in the window
client_kept_up: client received 4000 of 4000 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

95.6 µs

run 1 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15996 / 15996
CPU user / sys per msg	73.8 µs / 21.9 µs
CPU (share of a core)	19.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
broker dropped ($SYS)	0
client received	19,999
in window: offered / received	16000 / 16000
CPU user / sys per msg	68.8 µs / 27.5 µs
CPU (share of a core)	19.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19999; peer wrote 19999
broker_confirms_deliveries: broker sent 19999; client received 19999
no_loss: broker acknowledged 19999 from the peer; client received 19999; broker dropped 0
offered_rate_held: peer wrote 16000 of 16000 offered in the window
client_kept_up: client received 16000 of 16000 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15996 / 15996
CPU user / sys per msg	81.9 µs / 13.1 µs
CPU (share of a core)	19.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

85.8 µs

run 1 · valid

C source sent	49,983
broker received ($SYS)	49,983
broker sent ($SYS)	49,983
broker dropped ($SYS)	0
client received	49,983
in window: offered / received	39985 / 39985
CPU user / sys per msg	31.8 µs / 54.0 µs
CPU (share of a core)	42.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49983; peer wrote 49983
broker_confirms_deliveries: broker sent 49983; client received 49983
no_loss: broker acknowledged 49983 from the peer; client received 49983; broker dropped 0
offered_rate_held: peer wrote 39985 of 40000 offered in the window
client_kept_up: client received 39985 of 39985 in the window
broker_headroom: broker used 0.25 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	49,969
broker received ($SYS)	49,969
broker sent ($SYS)	49,969
broker dropped ($SYS)	0
client received	49,969
in window: offered / received	39970 / 39970
CPU user / sys per msg	22.0 µs / 63.5 µs
CPU (share of a core)	42.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49969; peer wrote 49969
broker_confirms_deliveries: broker sent 49969; client received 49969
no_loss: broker acknowledged 49969 from the peer; client received 49969; broker dropped 0
offered_rate_held: peer wrote 39970 of 40000 offered in the window
client_kept_up: client received 39970 of 39970 in the window
broker_headroom: broker used 0.26 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

C source sent	49,976
broker received ($SYS)	49,976
broker sent ($SYS)	49,976
broker dropped ($SYS)	0
client received	49,976
in window: offered / received	39977 / 39977
CPU user / sys per msg	31.8 µs / 54.8 µs
CPU (share of a core)	43.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49976; peer wrote 49976
broker_confirms_deliveries: broker sent 49976; client received 49976
no_loss: broker acknowledged 49976 from the peer; client received 49976; broker dropped 0
offered_rate_held: peer wrote 39977 of 40000 offered in the window
client_kept_up: client received 39977 of 39977 in the window
broker_headroom: broker used 0.25 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

mqttium 1.1.0 asyncio

265 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	541 µs / 1,147 µs / 1,508 µs
due in window, never published	1
CPU user / sys per msg	232 µs / 32.5 µs
CPU (share of a core)	13.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	541 µs / 1,147 µs / 2,220 µs
due in window, never published	1
CPU user / sys per msg	232 µs / 32.5 µs
CPU (share of a core)	13.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.05 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	606 µs / 1,147 µs / 1,399 µs
due in window, never published	1
CPU user / sys per msg	232 µs / 30.0 µs
CPU (share of a core)	13.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

148 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	770 µs / 1,409 µs / 1,826 µs
due in window, never published	3
CPU user / sys per msg	128 µs / 20.0 µs
CPU (share of a core)	29.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,409 µs / 4,238 µs
due in window, never published	2
CPU user / sys per msg	127 µs / 20.0 µs
CPU (share of a core)	29.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15998
schedule lag p50 / p99 / max	672 µs / 1,409 µs / 3,013 µs
due in window, never published	1
CPU user / sys per msg	128 µs / 20.0 µs
CPU (share of a core)	29.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

92.3 µs

run 1 · valid

client sent	49,999
client completed	49,999
broker received ($SYS)	49,999
broker sent ($SYS)	49,999
C sink received	49,999
in window: sent / delivered	40000 / 39999
schedule lag p50 / p99 / max	672 µs / 1,540 µs / 2,005 µs
due in window, never published	1
CPU user / sys per msg	84.8 µs / 7.5 µs
CPU (share of a core)	46.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49999 from the client; client sent 49999, completed 49999
broker_confirms_deliveries: broker sent 49999; peer received 49999
no_loss: client saw 49999 completions; peer received 49999
offered_rate_held: client published 40000 of 40000 offered in the window
payloads_intact: 0 of 49999 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 2 · valid

client sent	49,993
client completed	49,993
broker received ($SYS)	49,993
broker sent ($SYS)	49,993
C sink received	49,993
in window: sent / delivered	39999 / 39999
schedule lag p50 / p99 / max	672 µs / 1,540 µs / 3,069 µs
due in window, never published	7
CPU user / sys per msg	85.5 µs / 7.3 µs
CPU (share of a core)	46.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49993 from the client; client sent 49993, completed 49993
broker_confirms_deliveries: broker sent 49993; peer received 49993
no_loss: client saw 49993 completions; peer received 49993
offered_rate_held: client published 39999 of 40000 offered in the window
payloads_intact: 0 of 49993 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	49,999
client completed	49,999
broker received ($SYS)	49,999
broker sent ($SYS)	49,999
C sink received	49,999
in window: sent / delivered	40001 / 39997
schedule lag p50 / p99 / max	672 µs / 1,540 µs / 1,974 µs
due in window, never published	1
CPU user / sys per msg	85.5 µs / 6.5 µs
CPU (share of a core)	46.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49999 from the client; client sent 49999, completed 49999
broker_confirms_deliveries: broker sent 49999; peer received 49999
no_loss: client saw 49999 completions; peer received 49999
offered_rate_held: client published 40001 of 40000 offered in the window
payloads_intact: 0 of 49999 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

158 µs

run 1 · valid

C source sent	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
broker dropped ($SYS)	0
client received	4,999
in window: offered / received	4000 / 4000
CPU user / sys per msg	135 µs / 17.5 µs
CPU (share of a core)	7.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4999; peer wrote 4999
broker_confirms_deliveries: broker sent 4999; client received 4999
no_loss: broker acknowledged 4999 from the peer; client received 4999; broker dropped 0
offered_rate_held: peer wrote 4000 of 4000 offered in the window
client_kept_up: client received 4000 of 4000 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.06 cores busy outside the client, peer and broker

run 2 · valid

C source sent	4,998
broker received ($SYS)	4,998
broker sent ($SYS)	4,998
broker dropped ($SYS)	0
client received	4,998
in window: offered / received	3999 / 3999
CPU user / sys per msg	138 µs / 20.0 µs
CPU (share of a core)	7.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4998; peer wrote 4998
broker_confirms_deliveries: broker sent 4998; client received 4998
no_loss: broker acknowledged 4998 from the peer; client received 4998; broker dropped 0
offered_rate_held: peer wrote 3999 of 4000 offered in the window
client_kept_up: client received 3999 of 3999 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.44 cores busy outside the client, peer and broker

run 3 · valid

C source sent	4,998
broker received ($SYS)	4,998
broker sent ($SYS)	4,998
broker dropped ($SYS)	0
client received	4,998
in window: offered / received	3999 / 3999
CPU user / sys per msg	148 µs / 20.0 µs
CPU (share of a core)	8.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4998; peer wrote 4998
broker_confirms_deliveries: broker sent 4998; client received 4998
no_loss: broker acknowledged 4998 from the peer; client received 4998; broker dropped 0
offered_rate_held: peer wrote 3999 of 4000 offered in the window
client_kept_up: client received 3999 of 3999 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.44 cores busy outside the client, peer and broker

93.8 µs

run 1 · valid

C source sent	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
broker dropped ($SYS)	0
client received	19,998
in window: offered / received	15999 / 15999
CPU user / sys per msg	50.0 µs / 43.8 µs
CPU (share of a core)	18.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19998; peer wrote 19998
broker_confirms_deliveries: broker sent 19998; client received 19998
no_loss: broker acknowledged 19998 from the peer; client received 19998; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.38 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15994 / 15994
CPU user / sys per msg	63.1 µs / 31.3 µs
CPU (share of a core)	18.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15994 of 16000 offered in the window
client_kept_up: client received 15994 of 15994 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15995 / 15995
CPU user / sys per msg	68.1 µs / 25.0 µs
CPU (share of a core)	18.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

83.3 µs

run 1 · valid

C source sent	49,966
broker received ($SYS)	49,966
broker sent ($SYS)	49,966
broker dropped ($SYS)	0
client received	49,966
in window: offered / received	39975 / 39975
CPU user / sys per msg	51.5 µs / 31.8 µs
CPU (share of a core)	41.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49966; peer wrote 49966
broker_confirms_deliveries: broker sent 49966; client received 49966
no_loss: broker acknowledged 49966 from the peer; client received 49966; broker dropped 0
offered_rate_held: peer wrote 39975 of 40000 offered in the window
client_kept_up: client received 39975 of 39975 in the window
broker_headroom: broker used 0.27 of its core
host_quiet: 0.32 cores busy outside the client, peer and broker

run 2 · valid

C source sent	49,972
broker received ($SYS)	49,972
broker sent ($SYS)	49,972
broker dropped ($SYS)	0
client received	49,972
in window: offered / received	39980 / 39980
CPU user / sys per msg	61.5 µs / 22.5 µs
CPU (share of a core)	42.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49972; peer wrote 49972
broker_confirms_deliveries: broker sent 49972; client received 49972
no_loss: broker acknowledged 49972 from the peer; client received 49972; broker dropped 0
offered_rate_held: peer wrote 39980 of 40000 offered in the window
client_kept_up: client received 39980 of 39980 in the window
broker_headroom: broker used 0.27 of its core
host_quiet: 0.45 cores busy outside the client, peer and broker

run 3 · valid

C source sent	49,961
broker received ($SYS)	49,961
broker sent ($SYS)	49,961
broker dropped ($SYS)	0
client received	49,961
in window: offered / received	39977 / 39977
CPU user / sys per msg	58.5 µs / 24.0 µs
CPU (share of a core)	41.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49961; peer wrote 49961
broker_confirms_deliveries: broker sent 49961; client received 49961
no_loss: broker acknowledged 49961 from the peer; client received 49961; broker dropped 0
offered_rate_held: peer wrote 39977 of 40000 offered in the window
client_kept_up: client received 39977 of 39977 in the window
broker_headroom: broker used 0.26 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

gmqtt 0.7.0 asyncio

272 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	541 µs / 1,147 µs / 2,289 µs
due in window, never published	1
CPU user / sys per msg	212 µs / 60.0 µs
CPU (share of a core)	13.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 1,081 µs / 2,270 µs
due in window, never published	1
CPU user / sys per msg	215 µs / 57.5 µs
CPU (share of a core)	13.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 1,081 µs / 2,860 µs
due in window, never published	1
CPU user / sys per msg	218 µs / 52.5 µs
CPU (share of a core)	13.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

123 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,955 µs
due in window, never published	2
CPU user / sys per msg	86.2 µs / 35.6 µs
CPU (share of a core)	24.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,554 µs
due in window, never published	3
CPU user / sys per msg	90.0 µs / 33.1 µs
CPU (share of a core)	24.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,623 µs
due in window, never published	2
CPU user / sys per msg	87.5 µs / 35.0 µs
CPU (share of a core)	24.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

72.2 µs

run 1 · valid

client sent	49,999
client completed	49,999
broker received ($SYS)	49,999
broker sent ($SYS)	49,999
C sink received	49,999
in window: sent / delivered	40003 / 40002
schedule lag p50 / p99 / max	803 µs / 1,540 µs / 3,638 µs
due in window, never published	1
CPU user / sys per msg	53.5 µs / 19.5 µs
CPU (share of a core)	36.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49999 from the client; client sent 49999, completed 49999
broker_confirms_deliveries: broker sent 49999; peer received 49999
no_loss: client saw 49999 completions; peer received 49999
offered_rate_held: client published 40003 of 40001 offered in the window
payloads_intact: 0 of 49999 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	49,996
client completed	49,996
broker received ($SYS)	49,996
broker sent ($SYS)	49,996
C sink received	49,996
in window: sent / delivered	40000 / 40003
schedule lag p50 / p99 / max	803 µs / 1,540 µs / 3,191 µs
due in window, never published	4
CPU user / sys per msg	54.5 µs / 17.8 µs
CPU (share of a core)	36.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49996 from the client; client sent 49996, completed 49996
broker_confirms_deliveries: broker sent 49996; peer received 49996
no_loss: client saw 49996 completions; peer received 49996
offered_rate_held: client published 40000 of 40000 offered in the window
payloads_intact: 0 of 49996 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

client sent	49,993
client completed	49,993
broker received ($SYS)	49,993
broker sent ($SYS)	49,993
C sink received	49,993
in window: sent / delivered	39997 / 39997
schedule lag p50 / p99 / max	803 µs / 1,540 µs / 3,529 µs
due in window, never published	7
CPU user / sys per msg	55.3 µs / 16.8 µs
CPU (share of a core)	36.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49993 from the client; client sent 49993, completed 49993
broker_confirms_deliveries: broker sent 49993; peer received 49993
no_loss: client saw 49993 completions; peer received 49993
offered_rate_held: client published 39997 of 40000 offered in the window
payloads_intact: 0 of 49993 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

158 µs

run 1 · valid

C source sent	4,996
broker received ($SYS)	4,996
broker sent ($SYS)	4,996
broker dropped ($SYS)	0
client received	4,996
in window: offered / received	3998 / 3998
CPU user / sys per msg	140 µs / 15.0 µs
CPU (share of a core)	7.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4996; peer wrote 4996
broker_confirms_deliveries: broker sent 4996; client received 4996
no_loss: broker acknowledged 4996 from the peer; client received 4996; broker dropped 0
offered_rate_held: peer wrote 3998 of 4000 offered in the window
client_kept_up: client received 3998 of 3998 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.07 cores busy outside the client, peer and broker

run 2 · valid

C source sent	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
broker dropped ($SYS)	0
client received	4,999
in window: offered / received	4000 / 4000
CPU user / sys per msg	138 µs / 20.0 µs
CPU (share of a core)	7.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4999; peer wrote 4999
broker_confirms_deliveries: broker sent 4999; client received 4999
no_loss: broker acknowledged 4999 from the peer; client received 4999; broker dropped 0
offered_rate_held: peer wrote 4000 of 4000 offered in the window
client_kept_up: client received 4000 of 4000 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.01 cores busy outside the client, peer and broker

run 3 · valid

C source sent	4,997
broker received ($SYS)	4,997
broker sent ($SYS)	4,997
broker dropped ($SYS)	0
client received	4,997
in window: offered / received	3998 / 3998
CPU user / sys per msg	138 µs / 22.5 µs
CPU (share of a core)	8.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4997; peer wrote 4997
broker_confirms_deliveries: broker sent 4997; client received 4997
no_loss: broker acknowledged 4997 from the peer; client received 4997; broker dropped 0
offered_rate_held: peer wrote 3998 of 4000 offered in the window
client_kept_up: client received 3998 of 3998 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.01 cores busy outside the client, peer and broker

99.4 µs

run 1 · attempt 2 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15996 / 15996
CPU user / sys per msg	43.1 µs / 56.9 µs
CPU (share of a core)	20.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.31 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15998 / 15998
CPU user / sys per msg	74.4 µs / 25.0 µs
CPU (share of a core)	19.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15997 / 15997
CPU user / sys per msg	83.1 µs / 14.4 µs
CPU (share of a core)	19.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

63.4 µs

run 1 · valid

C source sent	49,983
broker received ($SYS)	49,983
broker sent ($SYS)	49,983
broker dropped ($SYS)	0
client received	49,983
in window: offered / received	39988 / 39987
CPU user / sys per msg	55.0 µs / 8.0 µs
CPU (share of a core)	31.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49983; peer wrote 49983
broker_confirms_deliveries: broker sent 49983; client received 49983
no_loss: broker acknowledged 49983 from the peer; client received 49983; broker dropped 0
offered_rate_held: peer wrote 39988 of 40000 offered in the window
client_kept_up: client received 39987 of 39988 in the window
broker_headroom: broker used 0.28 of its core
host_quiet: 0.01 cores busy outside the client, peer and broker

run 2 · valid

C source sent	49,970
broker received ($SYS)	49,970
broker sent ($SYS)	49,970
broker dropped ($SYS)	0
client received	49,970
in window: offered / received	39983 / 39982
CPU user / sys per msg	52.3 µs / 11.3 µs
CPU (share of a core)	31.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49970; peer wrote 49970
broker_confirms_deliveries: broker sent 49970; client received 49970
no_loss: broker acknowledged 49970 from the peer; client received 49970; broker dropped 0
offered_rate_held: peer wrote 39983 of 40000 offered in the window
client_kept_up: client received 39982 of 39983 in the window
broker_headroom: broker used 0.27 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	49,991
broker received ($SYS)	49,991
broker sent ($SYS)	49,991
broker dropped ($SYS)	0
client received	49,991
in window: offered / received	39992 / 39992
CPU user / sys per msg	52.8 µs / 11.0 µs
CPU (share of a core)	31.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49991; peer wrote 49991
broker_confirms_deliveries: broker sent 49991; client received 49991
no_loss: broker acknowledged 49991 from the peer; client received 49991; broker dropped 0
offered_rate_held: peer wrote 39992 of 40000 offered in the window
client_kept_up: client received 39992 of 39992 in the window
broker_headroom: broker used 0.28 of its core
host_quiet: 0.02 cores busy outside the client, peer and broker

zmqtt 0.2.4 asyncio experimental

705 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	3999 / 4000
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 3,542 µs
due in window, never published	1
CPU user / sys per msg	653 µs / 55.0 µs
CPU (share of a core)	35.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 3999 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 2,640 µs
due in window, never published	1
CPU user / sys per msg	655 µs / 50.0 µs
CPU (share of a core)	35.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	737 µs / 1,343 µs / 2,053 µs
due in window, never published	1
CPU user / sys per msg	632 µs / 65.0 µs
CPU (share of a core)	34.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

307 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16001
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 2,428 µs
due in window, never published	3
CPU user / sys per msg	280 µs / 30.0 µs
CPU (share of a core)	62.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 3,204 µs
due in window, never published	1
CPU user / sys per msg	283 µs / 24.4 µs
CPU (share of a core)	61.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	868 µs / 1,868 µs / 2,209 µs
due in window, never published	4
CPU user / sys per msg	256 µs / 30.0 µs
CPU (share of a core)	57.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15999 of 16002 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

137 µs

run 1 · valid

client sent	49,997
client completed	49,997
broker received ($SYS)	49,997
broker sent ($SYS)	49,997
C sink received	49,997
in window: sent / delivered	40001 / 40000
schedule lag p50 / p99 / max	1,081 µs / 2,064 µs / 3,613 µs
due in window, never published	3
CPU user / sys per msg	115 µs / 19.0 µs
CPU (share of a core)	67.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49997 from the client; client sent 49997, completed 49997
broker_confirms_deliveries: broker sent 49997; peer received 49997
no_loss: client saw 49997 completions; peer received 49997
offered_rate_held: client published 40001 of 40000 offered in the window
payloads_intact: 0 of 49997 payloads had an unexpected length
broker_headroom: broker used 0.19 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	49,994
client completed	49,994
broker received ($SYS)	49,994
broker sent ($SYS)	49,994
C sink received	49,994
in window: sent / delivered	40001 / 40001
schedule lag p50 / p99 / max	1,081 µs / 2,064 µs / 3,738 µs
due in window, never published	6
CPU user / sys per msg	118 µs / 19.5 µs
CPU (share of a core)	68.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49994 from the client; client sent 49994, completed 49994
broker_confirms_deliveries: broker sent 49994; peer received 49994
no_loss: client saw 49994 completions; peer received 49994
offered_rate_held: client published 40001 of 40005 offered in the window
payloads_intact: 0 of 49994 payloads had an unexpected length
broker_headroom: broker used 0.19 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	49,995
client completed	49,995
broker received ($SYS)	49,995
broker sent ($SYS)	49,995
C sink received	49,995
in window: sent / delivered	40001 / 40001
schedule lag p50 / p99 / max	1,081 µs / 2,064 µs / 3,729 µs
due in window, never published	5
CPU user / sys per msg	118 µs / 19.2 µs
CPU (share of a core)	68.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49995 from the client; client sent 49995, completed 49995
broker_confirms_deliveries: broker sent 49995; peer received 49995
no_loss: client saw 49995 completions; peer received 49995
offered_rate_held: client published 40001 of 40006 offered in the window
payloads_intact: 0 of 49995 payloads had an unexpected length
broker_headroom: broker used 0.19 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

255 µs

run 1 · valid

C source sent	4,998
broker received ($SYS)	4,998
broker sent ($SYS)	4,998
broker dropped ($SYS)	0
client received	4,998
in window: offered / received	3999 / 3999
CPU user / sys per msg	213 µs / 42.5 µs
CPU (share of a core)	12.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4998; peer wrote 4998
broker_confirms_deliveries: broker sent 4998; client received 4998
no_loss: broker acknowledged 4998 from the peer; client received 4998; broker dropped 0
offered_rate_held: peer wrote 3999 of 4000 offered in the window
client_kept_up: client received 3999 of 3999 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.01 cores busy outside the client, peer and broker

run 2 · valid

C source sent	4,998
broker received ($SYS)	4,998
broker sent ($SYS)	4,998
broker dropped ($SYS)	0
client received	4,998
in window: offered / received	3999 / 3999
CPU user / sys per msg	220 µs / 35.0 µs
CPU (share of a core)	12.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4998; peer wrote 4998
broker_confirms_deliveries: broker sent 4998; client received 4998
no_loss: broker acknowledged 4998 from the peer; client received 4998; broker dropped 0
offered_rate_held: peer wrote 3999 of 4000 offered in the window
client_kept_up: client received 3999 of 3999 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	4,998
broker received ($SYS)	4,998
broker sent ($SYS)	4,998
broker dropped ($SYS)	0
client received	4,998
in window: offered / received	3999 / 3999
CPU user / sys per msg	220 µs / 35.0 µs
CPU (share of a core)	12.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4998; peer wrote 4998
broker_confirms_deliveries: broker sent 4998; client received 4998
no_loss: broker acknowledged 4998 from the peer; client received 4998; broker dropped 0
offered_rate_held: peer wrote 3999 of 4000 offered in the window
client_kept_up: client received 3999 of 3999 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

168 µs

run 1 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15997 / 15997
CPU user / sys per msg	166 µs / 19.4 µs
CPU (share of a core)	37.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,991
broker received ($SYS)	19,991
broker sent ($SYS)	19,991
broker dropped ($SYS)	0
client received	19,991
in window: offered / received	15994 / 15994
CPU user / sys per msg	151 µs / 13.8 µs
CPU (share of a core)	32.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19991; peer wrote 19991
broker_confirms_deliveries: broker sent 19991; client received 19991
no_loss: broker acknowledged 19991 from the peer; client received 19991; broker dropped 0
offered_rate_held: peer wrote 15994 of 16000 offered in the window
client_kept_up: client received 15994 of 15994 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,988
broker received ($SYS)	19,988
broker sent ($SYS)	19,988
broker dropped ($SYS)	0
client received	19,988
in window: offered / received	15991 / 15991
CPU user / sys per msg	108 µs / 59.4 µs
CPU (share of a core)	33.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19988; peer wrote 19988
broker_confirms_deliveries: broker sent 19988; client received 19988
no_loss: broker acknowledged 19988 from the peer; client received 19988; broker dropped 0
offered_rate_held: peer wrote 15991 of 16000 offered in the window
client_kept_up: client received 15991 of 15991 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.10 cores busy outside the client, peer and broker

145 µs

run 1 · valid

C source sent	49,987
broker received ($SYS)	49,987
broker sent ($SYS)	49,987
broker dropped ($SYS)	0
client received	49,987
in window: offered / received	39989 / 39989
CPU user / sys per msg	119 µs / 25.0 µs
CPU (share of a core)	72.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49987; peer wrote 49987
broker_confirms_deliveries: broker sent 49987; client received 49987
no_loss: broker acknowledged 49987 from the peer; client received 49987; broker dropped 0
offered_rate_held: peer wrote 39989 of 40000 offered in the window
client_kept_up: client received 39989 of 39989 in the window
broker_headroom: broker used 0.23 of its core
host_quiet: 0.31 cores busy outside the client, peer and broker

run 2 · valid

C source sent	49,968
broker received ($SYS)	49,968
broker sent ($SYS)	49,968
broker dropped ($SYS)	0
client received	49,968
in window: offered / received	39969 / 39969
CPU user / sys per msg	139 µs / 6.5 µs
CPU (share of a core)	72.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49968; peer wrote 49968
broker_confirms_deliveries: broker sent 49968; client received 49968
no_loss: broker acknowledged 49968 from the peer; client received 49968; broker dropped 0
offered_rate_held: peer wrote 39969 of 39999 offered in the window
client_kept_up: client received 39969 of 39969 in the window
broker_headroom: broker used 0.23 of its core
host_quiet: 0.28 cores busy outside the client, peer and broker

run 3 · valid

C source sent	49,959
broker received ($SYS)	49,959
broker sent ($SYS)	49,959
broker dropped ($SYS)	0
client received	49,959
in window: offered / received	39961 / 39960
CPU user / sys per msg	131 µs / 13.3 µs
CPU (share of a core)	72.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49959; peer wrote 49959
broker_confirms_deliveries: broker sent 49959; client received 49959
no_loss: broker acknowledged 49959 from the peer; client received 49959; broker dropped 0
offered_rate_held: peer wrote 39961 of 39999 offered in the window
client_kept_up: client received 39960 of 39961 in the window
broker_headroom: broker used 0.23 of its core
host_quiet: 0.08 cores busy outside the client, peer and broker

aiomqtt 2.5.1 asyncio

745 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 3,372 µs
due in window, never published	1
CPU user / sys per msg	700 µs / 40.0 µs
CPU (share of a core)	37.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	737 µs / 1,343 µs / 2,038 µs
due in window, never published	1
CPU user / sys per msg	712 µs / 32.5 µs
CPU (share of a core)	37.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.05 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 1,409 µs / 3,156 µs
due in window, never published	1
CPU user / sys per msg	712 µs / 35.0 µs
CPU (share of a core)	37.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

274 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16004
schedule lag p50 / p99 / max	1,147 µs / 2,294 µs / 4,376 µs
due in window, never published	2
CPU user / sys per msg	253 µs / 16.2 µs
CPU (share of a core)	53.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16003 / 15999
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,860 µs
due in window, never published	1
CPU user / sys per msg	257 µs / 17.5 µs
CPU (share of a core)	54.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16003 of 16001 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,329 µs
due in window, never published	2
CPU user / sys per msg	257 µs / 16.2 µs
CPU (share of a core)	54.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

200 µs

run 1 · valid

client sent	49,998
client completed	49,998
broker received ($SYS)	49,998
broker sent ($SYS)	49,998
C sink received	49,998
in window: sent / delivered	40002 / 40000
schedule lag p50 / p99 / max	868 µs / 1,868 µs / 4,506 µs
due in window, never published	2
CPU user / sys per msg	187 µs / 12.5 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49998 from the client; client sent 49998, completed 49998
broker_confirms_deliveries: broker sent 49998; peer received 49998
no_loss: client saw 49998 completions; peer received 49998
offered_rate_held: client published 40002 of 40002 offered in the window
payloads_intact: 0 of 49998 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.11 cores busy outside the client, peer and broker

run 2 · valid

client sent	49,988
client completed	49,988
broker received ($SYS)	49,988
broker sent ($SYS)	49,988
C sink received	49,988
in window: sent / delivered	39998 / 39999
schedule lag p50 / p99 / max	868 µs / 1,671 µs / 4,527 µs
due in window, never published	2
CPU user / sys per msg	187 µs / 12.8 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49988 from the client; client sent 49988, completed 49988
broker_confirms_deliveries: broker sent 49988; peer received 49988
no_loss: client saw 49988 completions; peer received 49988
offered_rate_held: client published 39998 of 39998 offered in the window
payloads_intact: 0 of 49988 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 3 · valid

client sent	49,996
client completed	49,996
broker received ($SYS)	49,996
broker sent ($SYS)	49,996
C sink received	49,996
in window: sent / delivered	39999 / 39999
schedule lag p50 / p99 / max	868 µs / 1,475 µs / 3,090 µs
due in window, never published	4
CPU user / sys per msg	187 µs / 13.5 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49996 from the client; client sent 49996, completed 49996
broker_confirms_deliveries: broker sent 49996; peer received 49996
no_loss: client saw 49996 completions; peer received 49996
offered_rate_held: client published 39999 of 40001 offered in the window
payloads_intact: 0 of 49996 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

258 µs

run 1 · valid

C source sent	4,997
broker received ($SYS)	4,997
broker sent ($SYS)	4,997
broker dropped ($SYS)	0
client received	4,997
in window: offered / received	3998 / 3998
CPU user / sys per msg	243 µs / 15.0 µs
CPU (share of a core)	12.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4997; peer wrote 4997
broker_confirms_deliveries: broker sent 4997; client received 4997
no_loss: broker acknowledged 4997 from the peer; client received 4997; broker dropped 0
offered_rate_held: peer wrote 3998 of 4000 offered in the window
client_kept_up: client received 3998 of 3998 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.45 cores busy outside the client, peer and broker

run 2 · valid

C source sent	4,997
broker received ($SYS)	4,997
broker sent ($SYS)	4,997
broker dropped ($SYS)	0
client received	4,997
in window: offered / received	3999 / 3999
CPU user / sys per msg	210 µs / 52.5 µs
CPU (share of a core)	13.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4997; peer wrote 4997
broker_confirms_deliveries: broker sent 4997; client received 4997
no_loss: broker acknowledged 4997 from the peer; client received 4997; broker dropped 0
offered_rate_held: peer wrote 3999 of 4000 offered in the window
client_kept_up: client received 3999 of 3999 in the window
broker_headroom: broker used 0.03 of its core
host_quiet: 0.41 cores busy outside the client, peer and broker

run 3 · valid

C source sent	4,997
broker received ($SYS)	4,997
broker sent ($SYS)	4,997
broker dropped ($SYS)	0
client received	4,997
in window: offered / received	3998 / 3998
CPU user / sys per msg	210 µs / 35.0 µs
CPU (share of a core)	12.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4997; peer wrote 4997
broker_confirms_deliveries: broker sent 4997; client received 4997
no_loss: broker acknowledged 4997 from the peer; client received 4997; broker dropped 0
offered_rate_held: peer wrote 3998 of 4000 offered in the window
client_kept_up: client received 3998 of 3998 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

179 µs

run 1 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15996 / 15996
CPU user / sys per msg	152 µs / 27.5 µs
CPU (share of a core)	35.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15997 / 15997
CPU user / sys per msg	128 µs / 53.1 µs
CPU (share of a core)	36.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

C source sent	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
broker dropped ($SYS)	0
client received	19,999
in window: offered / received	16000 / 16000
CPU user / sys per msg	90.0 µs / 89.4 µs
CPU (share of a core)	35.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19999; peer wrote 19999
broker_confirms_deliveries: broker sent 19999; client received 19999
no_loss: broker acknowledged 19999 from the peer; client received 19999; broker dropped 0
offered_rate_held: peer wrote 16000 of 16000 offered in the window
client_kept_up: client received 16000 of 16000 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.32 cores busy outside the client, peer and broker

148 µs

run 1 · valid

C source sent	49,982
broker received ($SYS)	49,982
broker sent ($SYS)	49,982
broker dropped ($SYS)	0
client received	49,982
in window: offered / received	39983 / 39984
CPU user / sys per msg	124 µs / 25.5 µs
CPU (share of a core)	74.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49982; peer wrote 49982
broker_confirms_deliveries: broker sent 49982; client received 49982
no_loss: broker acknowledged 49982 from the peer; client received 49982; broker dropped 0
offered_rate_held: peer wrote 39983 of 40000 offered in the window
client_kept_up: client received 39984 of 39983 in the window
broker_headroom: broker used 0.22 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

C source sent	49,982
broker received ($SYS)	49,982
broker sent ($SYS)	49,982
broker dropped ($SYS)	0
client received	49,982
in window: offered / received	39985 / 39985
CPU user / sys per msg	118 µs / 30.8 µs
CPU (share of a core)	74.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49982; peer wrote 49982
broker_confirms_deliveries: broker sent 49982; client received 49982
no_loss: broker acknowledged 49982 from the peer; client received 49982; broker dropped 0
offered_rate_held: peer wrote 39985 of 40000 offered in the window
client_kept_up: client received 39985 of 39985 in the window
broker_headroom: broker used 0.22 of its core
host_quiet: 0.05 cores busy outside the client, peer and broker

run 3 · valid

C source sent	49,974
broker received ($SYS)	49,974
broker sent ($SYS)	49,974
broker dropped ($SYS)	0
client received	49,974
in window: offered / received	39981 / 39980
CPU user / sys per msg	98.8 µs / 48.3 µs
CPU (share of a core)	73.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49974; peer wrote 49974
broker_confirms_deliveries: broker sent 49974; client received 49974
no_loss: broker acknowledged 49974 from the peer; client received 49974; broker dropped 0
offered_rate_held: peer wrote 39981 of 40000 offered in the window
client_kept_up: client received 39980 of 39981 in the window
broker_headroom: broker used 0.23 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

amqtt 0.12.1 asyncio

770 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	737 µs / 1,278 µs / 2,428 µs
due in window, never published	1
CPU user / sys per msg	705 µs / 65.0 µs
CPU (share of a core)	38.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	3999 / 4000
schedule lag p50 / p99 / max	737 µs / 1,343 µs / 1,649 µs
due in window, never published	1
CPU user / sys per msg	705 µs / 67.5 µs
CPU (share of a core)	38.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 3999 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 2,563 µs
due in window, never published	1
CPU user / sys per msg	712 µs / 57.5 µs
CPU (share of a core)	38.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

294 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15999
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,609 µs
due in window, never published	1
CPU user / sys per msg	269 µs / 25.0 µs
CPU (share of a core)	58.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 2,332 µs
due in window, never published	4
CPU user / sys per msg	269 µs / 26.9 µs
CPU (share of a core)	59.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,153 µs
due in window, never published	4
CPU user / sys per msg	272 µs / 22.5 µs
CPU (share of a core)	58.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

200 µs

run 1 · valid

client sent	49,951
client completed	49,951
broker received ($SYS)	49,951
broker sent ($SYS)	49,951
C sink received	49,951
in window: sent / delivered	39953 / 39955
schedule lag p50 / p99 / max	901 µs / 1,671 µs / 4,268 µs
due in window, never published	49
CPU user / sys per msg	181 µs / 19.0 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49951 from the client; client sent 49951, completed 49951
broker_confirms_deliveries: broker sent 49951; peer received 49951
no_loss: client saw 49951 completions; peer received 49951
offered_rate_held: client published 39953 of 40002 offered in the window
payloads_intact: 0 of 49951 payloads had an unexpected length
broker_headroom: broker used 0.19 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 2 · valid

client sent	49,938
client completed	49,938
broker received ($SYS)	49,938
broker sent ($SYS)	49,938
C sink received	49,938
in window: sent / delivered	39953 / 39954
schedule lag p50 / p99 / max	934 µs / 1,737 µs / 9,480 µs
due in window, never published	52
CPU user / sys per msg	184 µs / 16.0 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49938 from the client; client sent 49938, completed 49938
broker_confirms_deliveries: broker sent 49938; peer received 49938
no_loss: client saw 49938 completions; peer received 49938
offered_rate_held: client published 39953 of 40007 offered in the window
payloads_intact: 0 of 49938 payloads had an unexpected length
broker_headroom: broker used 0.19 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	49,880
client completed	49,880
broker received ($SYS)	49,880
broker sent ($SYS)	49,880
C sink received	49,880
in window: sent / delivered	39882 / 39884
schedule lag p50 / p99 / max	934 µs / 3,080 µs / 4,731 µs
due in window, never published	120
CPU user / sys per msg	182 µs / 18.3 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49880 from the client; client sent 49880, completed 49880
broker_confirms_deliveries: broker sent 49880; peer received 49880
no_loss: client saw 49880 completions; peer received 49880
offered_rate_held: client published 39882 of 40002 offered in the window
payloads_intact: 0 of 49880 payloads had an unexpected length
broker_headroom: broker used 0.19 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

302 µs

run 1 · valid

C source sent	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
broker dropped ($SYS)	0
client received	4,999
in window: offered / received	4000 / 4000
CPU user / sys per msg	172 µs / 130 µs
CPU (share of a core)	15.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4999; peer wrote 4999
broker_confirms_deliveries: broker sent 4999; client received 4999
no_loss: broker acknowledged 4999 from the peer; client received 4999; broker dropped 0
offered_rate_held: peer wrote 4000 of 4000 offered in the window
client_kept_up: client received 4000 of 4000 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.46 cores busy outside the client, peer and broker

run 2 · valid

C source sent	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
broker dropped ($SYS)	0
client received	4,999
in window: offered / received	4000 / 4000
CPU user / sys per msg	258 µs / 45.0 µs
CPU (share of a core)	15.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4999; peer wrote 4999
broker_confirms_deliveries: broker sent 4999; client received 4999
no_loss: broker acknowledged 4999 from the peer; client received 4999; broker dropped 0
offered_rate_held: peer wrote 4000 of 4000 offered in the window
client_kept_up: client received 4000 of 4000 in the window
broker_headroom: broker used 0.03 of its core
host_quiet: 0.45 cores busy outside the client, peer and broker

run 3 · valid

C source sent	4,996
broker received ($SYS)	4,996
broker sent ($SYS)	4,996
broker dropped ($SYS)	0
client received	4,996
in window: offered / received	3997 / 3997
CPU user / sys per msg	228 µs / 47.5 µs
CPU (share of a core)	13.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 4996; peer wrote 4996
broker_confirms_deliveries: broker sent 4996; client received 4996
no_loss: broker acknowledged 4996 from the peer; client received 4996; broker dropped 0
offered_rate_held: peer wrote 3997 of 4000 offered in the window
client_kept_up: client received 3997 of 3997 in the window
broker_headroom: broker used 0.04 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

213 µs

run 1 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15995 / 15995
CPU user / sys per msg	173 µs / 39.4 µs
CPU (share of a core)	42.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.03 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15996 / 15996
CPU user / sys per msg	133 µs / 75.6 µs
CPU (share of a core)	41.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

C source sent	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
broker dropped ($SYS)	0
client received	19,998
in window: offered / received	15999 / 15999
CPU user / sys per msg	203 µs / 10.0 µs
CPU (share of a core)	42.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19998; peer wrote 19998
broker_confirms_deliveries: broker sent 19998; client received 19998
no_loss: broker acknowledged 19998 from the peer; client received 19998; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

160 µs

run 1 · valid

C source sent	49,975
broker received ($SYS)	49,975
broker sent ($SYS)	49,975
broker dropped ($SYS)	0
client received	49,975
in window: offered / received	39978 / 39978
CPU user / sys per msg	151 µs / 11.0 µs
CPU (share of a core)	80.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49975; peer wrote 49975
broker_confirms_deliveries: broker sent 49975; client received 49975
no_loss: broker acknowledged 49975 from the peer; client received 49975; broker dropped 0
offered_rate_held: peer wrote 39978 of 40000 offered in the window
client_kept_up: client received 39978 of 39978 in the window
broker_headroom: broker used 0.21 of its core
host_quiet: 0.29 cores busy outside the client, peer and broker

run 2 · valid

C source sent	49,989
broker received ($SYS)	49,989
broker sent ($SYS)	49,989
broker dropped ($SYS)	0
client received	49,989
in window: offered / received	39990 / 39990
CPU user / sys per msg	138 µs / 21.5 µs
CPU (share of a core)	79.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49989; peer wrote 49989
broker_confirms_deliveries: broker sent 49989; client received 49989
no_loss: broker acknowledged 49989 from the peer; client received 49989; broker dropped 0
offered_rate_held: peer wrote 39990 of 40000 offered in the window
client_kept_up: client received 39990 of 39990 in the window
broker_headroom: broker used 0.21 of its core
host_quiet: 0.26 cores busy outside the client, peer and broker

run 3 · valid

C source sent	49,952
broker received ($SYS)	49,952
broker sent ($SYS)	49,952
broker dropped ($SYS)	0
client received	49,952
in window: offered / received	39961 / 39962
CPU user / sys per msg	128 µs / 32.3 µs
CPU (share of a core)	79.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49952; peer wrote 49952
broker_confirms_deliveries: broker sent 49952; client received 49952
no_loss: broker acknowledged 49952 from the peer; client received 49952; broker dropped 0
offered_rate_held: peer wrote 39961 of 40003 offered in the window
client_kept_up: client received 39962 of 39961 in the window
broker_headroom: broker used 0.21 of its core
host_quiet: 0.12 cores busy outside the client, peer and broker

aiomqtt3 3.0.0a1 asyncio experimental

unsupported

Does latency hold as the load grows?

Publish-to-delivery p99 at the same three offers.

client

publish 500/s
p99 ↓

publish 2k/s
p99 ↓

publish 5k/s
p99 ↓

receive 5k/s
p99 ↓

amqtt 0.12.1 asyncio

176 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	737 µs / 1,278 µs / 2,428 µs
due in window, never published	1
CPU user / sys per msg	705 µs / 65.0 µs
CPU (share of a core)	38.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	3999 / 4000
schedule lag p50 / p99 / max	737 µs / 1,343 µs / 1,649 µs
due in window, never published	1
CPU user / sys per msg	705 µs / 67.5 µs
CPU (share of a core)	38.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 3999 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 2,563 µs
due in window, never published	1
CPU user / sys per msg	712 µs / 57.5 µs
CPU (share of a core)	38.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

135 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15999
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,609 µs
due in window, never published	1
CPU user / sys per msg	269 µs / 25.0 µs
CPU (share of a core)	58.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 2,332 µs
due in window, never published	4
CPU user / sys per msg	269 µs / 26.9 µs
CPU (share of a core)	59.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,153 µs
due in window, never published	4
CPU user / sys per msg	272 µs / 22.5 µs
CPU (share of a core)	58.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

125 µs

run 1 · valid

client sent	49,951
client completed	49,951
broker received ($SYS)	49,951
broker sent ($SYS)	49,951
C sink received	49,951
in window: sent / delivered	39953 / 39955
schedule lag p50 / p99 / max	901 µs / 1,671 µs / 4,268 µs
due in window, never published	49
CPU user / sys per msg	181 µs / 19.0 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49951 from the client; client sent 49951, completed 49951
broker_confirms_deliveries: broker sent 49951; peer received 49951
no_loss: client saw 49951 completions; peer received 49951
offered_rate_held: client published 39953 of 40002 offered in the window
payloads_intact: 0 of 49951 payloads had an unexpected length
broker_headroom: broker used 0.19 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 2 · valid

client sent	49,938
client completed	49,938
broker received ($SYS)	49,938
broker sent ($SYS)	49,938
C sink received	49,938
in window: sent / delivered	39953 / 39954
schedule lag p50 / p99 / max	934 µs / 1,737 µs / 9,480 µs
due in window, never published	52
CPU user / sys per msg	184 µs / 16.0 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49938 from the client; client sent 49938, completed 49938
broker_confirms_deliveries: broker sent 49938; peer received 49938
no_loss: client saw 49938 completions; peer received 49938
offered_rate_held: client published 39953 of 40007 offered in the window
payloads_intact: 0 of 49938 payloads had an unexpected length
broker_headroom: broker used 0.19 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	49,880
client completed	49,880
broker received ($SYS)	49,880
broker sent ($SYS)	49,880
C sink received	49,880
in window: sent / delivered	39882 / 39884
schedule lag p50 / p99 / max	934 µs / 3,080 µs / 4,731 µs
due in window, never published	120
CPU user / sys per msg	182 µs / 18.3 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49880 from the client; client sent 49880, completed 49880
broker_confirms_deliveries: broker sent 49880; peer received 49880
no_loss: client saw 49880 completions; peer received 49880
offered_rate_held: client published 39882 of 40002 offered in the window
payloads_intact: 0 of 49880 payloads had an unexpected length
broker_headroom: broker used 0.19 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

803 µs

run 1 · valid

C source sent	49,975
broker received ($SYS)	49,975
broker sent ($SYS)	49,975
broker dropped ($SYS)	0
client received	49,975
in window: offered / received	39978 / 39978
CPU user / sys per msg	151 µs / 11.0 µs
CPU (share of a core)	80.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49975; peer wrote 49975
broker_confirms_deliveries: broker sent 49975; client received 49975
no_loss: broker acknowledged 49975 from the peer; client received 49975; broker dropped 0
offered_rate_held: peer wrote 39978 of 40000 offered in the window
client_kept_up: client received 39978 of 39978 in the window
broker_headroom: broker used 0.21 of its core
host_quiet: 0.29 cores busy outside the client, peer and broker

run 2 · valid

C source sent	49,989
broker received ($SYS)	49,989
broker sent ($SYS)	49,989
broker dropped ($SYS)	0
client received	49,989
in window: offered / received	39990 / 39990
CPU user / sys per msg	138 µs / 21.5 µs
CPU (share of a core)	79.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49989; peer wrote 49989
broker_confirms_deliveries: broker sent 49989; client received 49989
no_loss: broker acknowledged 49989 from the peer; client received 49989; broker dropped 0
offered_rate_held: peer wrote 39990 of 40000 offered in the window
client_kept_up: client received 39990 of 39990 in the window
broker_headroom: broker used 0.21 of its core
host_quiet: 0.26 cores busy outside the client, peer and broker

run 3 · valid

C source sent	49,952
broker received ($SYS)	49,952
broker sent ($SYS)	49,952
broker dropped ($SYS)	0
client received	49,952
in window: offered / received	39961 / 39962
CPU user / sys per msg	128 µs / 32.3 µs
CPU (share of a core)	79.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49952; peer wrote 49952
broker_confirms_deliveries: broker sent 49952; client received 49952
no_loss: broker acknowledged 49952 from the peer; client received 49952; broker dropped 0
offered_rate_held: peer wrote 39961 of 40003 offered in the window
client_kept_up: client received 39962 of 39961 in the window
broker_headroom: broker used 0.21 of its core
host_quiet: 0.12 cores busy outside the client, peer and broker

gmqtt 0.7.0 asyncio

176 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	541 µs / 1,147 µs / 2,289 µs
due in window, never published	1
CPU user / sys per msg	212 µs / 60.0 µs
CPU (share of a core)	13.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 1,081 µs / 2,270 µs
due in window, never published	1
CPU user / sys per msg	215 µs / 57.5 µs
CPU (share of a core)	13.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 1,081 µs / 2,860 µs
due in window, never published	1
CPU user / sys per msg	218 µs / 52.5 µs
CPU (share of a core)	13.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

160 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,955 µs
due in window, never published	2
CPU user / sys per msg	86.2 µs / 35.6 µs
CPU (share of a core)	24.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,554 µs
due in window, never published	3
CPU user / sys per msg	90.0 µs / 33.1 µs
CPU (share of a core)	24.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,623 µs
due in window, never published	2
CPU user / sys per msg	87.5 µs / 35.0 µs
CPU (share of a core)	24.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

135 µs

run 1 · valid

client sent	49,999
client completed	49,999
broker received ($SYS)	49,999
broker sent ($SYS)	49,999
C sink received	49,999
in window: sent / delivered	40003 / 40002
schedule lag p50 / p99 / max	803 µs / 1,540 µs / 3,638 µs
due in window, never published	1
CPU user / sys per msg	53.5 µs / 19.5 µs
CPU (share of a core)	36.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49999 from the client; client sent 49999, completed 49999
broker_confirms_deliveries: broker sent 49999; peer received 49999
no_loss: client saw 49999 completions; peer received 49999
offered_rate_held: client published 40003 of 40001 offered in the window
payloads_intact: 0 of 49999 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	49,996
client completed	49,996
broker received ($SYS)	49,996
broker sent ($SYS)	49,996
C sink received	49,996
in window: sent / delivered	40000 / 40003
schedule lag p50 / p99 / max	803 µs / 1,540 µs / 3,191 µs
due in window, never published	4
CPU user / sys per msg	54.5 µs / 17.8 µs
CPU (share of a core)	36.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49996 from the client; client sent 49996, completed 49996
broker_confirms_deliveries: broker sent 49996; peer received 49996
no_loss: client saw 49996 completions; peer received 49996
offered_rate_held: client published 40000 of 40000 offered in the window
payloads_intact: 0 of 49996 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

client sent	49,993
client completed	49,993
broker received ($SYS)	49,993
broker sent ($SYS)	49,993
C sink received	49,993
in window: sent / delivered	39997 / 39997
schedule lag p50 / p99 / max	803 µs / 1,540 µs / 3,529 µs
due in window, never published	7
CPU user / sys per msg	55.3 µs / 16.8 µs
CPU (share of a core)	36.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49993 from the client; client sent 49993, completed 49993
broker_confirms_deliveries: broker sent 49993; peer received 49993
no_loss: client saw 49993 completions; peer received 49993
offered_rate_held: client published 39997 of 40000 offered in the window
payloads_intact: 0 of 49993 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

201 µs

run 1 · valid

C source sent	49,983
broker received ($SYS)	49,983
broker sent ($SYS)	49,983
broker dropped ($SYS)	0
client received	49,983
in window: offered / received	39988 / 39987
CPU user / sys per msg	55.0 µs / 8.0 µs
CPU (share of a core)	31.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49983; peer wrote 49983
broker_confirms_deliveries: broker sent 49983; client received 49983
no_loss: broker acknowledged 49983 from the peer; client received 49983; broker dropped 0
offered_rate_held: peer wrote 39988 of 40000 offered in the window
client_kept_up: client received 39987 of 39988 in the window
broker_headroom: broker used 0.28 of its core
host_quiet: 0.01 cores busy outside the client, peer and broker

run 2 · valid

C source sent	49,970
broker received ($SYS)	49,970
broker sent ($SYS)	49,970
broker dropped ($SYS)	0
client received	49,970
in window: offered / received	39983 / 39982
CPU user / sys per msg	52.3 µs / 11.3 µs
CPU (share of a core)	31.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49970; peer wrote 49970
broker_confirms_deliveries: broker sent 49970; client received 49970
no_loss: broker acknowledged 49970 from the peer; client received 49970; broker dropped 0
offered_rate_held: peer wrote 39983 of 40000 offered in the window
client_kept_up: client received 39982 of 39983 in the window
broker_headroom: broker used 0.27 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	49,991
broker received ($SYS)	49,991
broker sent ($SYS)	49,991
broker dropped ($SYS)	0
client received	49,991
in window: offered / received	39992 / 39992
CPU user / sys per msg	52.8 µs / 11.0 µs
CPU (share of a core)	31.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49991; peer wrote 49991
broker_confirms_deliveries: broker sent 49991; client received 49991
no_loss: broker acknowledged 49991 from the peer; client received 49991; broker dropped 0
offered_rate_held: peer wrote 39992 of 40000 offered in the window
client_kept_up: client received 39992 of 39992 in the window
broker_headroom: broker used 0.28 of its core
host_quiet: 0.02 cores busy outside the client, peer and broker

zmqtt 0.2.4 asyncio experimental

176 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	3999 / 4000
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 3,542 µs
due in window, never published	1
CPU user / sys per msg	653 µs / 55.0 µs
CPU (share of a core)	35.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 3999 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 2,640 µs
due in window, never published	1
CPU user / sys per msg	655 µs / 50.0 µs
CPU (share of a core)	35.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	737 µs / 1,343 µs / 2,053 µs
due in window, never published	1
CPU user / sys per msg	632 µs / 65.0 µs
CPU (share of a core)	34.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

143 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16001
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 2,428 µs
due in window, never published	3
CPU user / sys per msg	280 µs / 30.0 µs
CPU (share of a core)	62.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 3,204 µs
due in window, never published	1
CPU user / sys per msg	283 µs / 24.4 µs
CPU (share of a core)	61.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	868 µs / 1,868 µs / 2,209 µs
due in window, never published	4
CPU user / sys per msg	256 µs / 30.0 µs
CPU (share of a core)	57.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15999 of 16002 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

125 µs

run 1 · valid

client sent	49,997
client completed	49,997
broker received ($SYS)	49,997
broker sent ($SYS)	49,997
C sink received	49,997
in window: sent / delivered	40001 / 40000
schedule lag p50 / p99 / max	1,081 µs / 2,064 µs / 3,613 µs
due in window, never published	3
CPU user / sys per msg	115 µs / 19.0 µs
CPU (share of a core)	67.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49997 from the client; client sent 49997, completed 49997
broker_confirms_deliveries: broker sent 49997; peer received 49997
no_loss: client saw 49997 completions; peer received 49997
offered_rate_held: client published 40001 of 40000 offered in the window
payloads_intact: 0 of 49997 payloads had an unexpected length
broker_headroom: broker used 0.19 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	49,994
client completed	49,994
broker received ($SYS)	49,994
broker sent ($SYS)	49,994
C sink received	49,994
in window: sent / delivered	40001 / 40001
schedule lag p50 / p99 / max	1,081 µs / 2,064 µs / 3,738 µs
due in window, never published	6
CPU user / sys per msg	118 µs / 19.5 µs
CPU (share of a core)	68.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49994 from the client; client sent 49994, completed 49994
broker_confirms_deliveries: broker sent 49994; peer received 49994
no_loss: client saw 49994 completions; peer received 49994
offered_rate_held: client published 40001 of 40005 offered in the window
payloads_intact: 0 of 49994 payloads had an unexpected length
broker_headroom: broker used 0.19 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	49,995
client completed	49,995
broker received ($SYS)	49,995
broker sent ($SYS)	49,995
C sink received	49,995
in window: sent / delivered	40001 / 40001
schedule lag p50 / p99 / max	1,081 µs / 2,064 µs / 3,729 µs
due in window, never published	5
CPU user / sys per msg	118 µs / 19.2 µs
CPU (share of a core)	68.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49995 from the client; client sent 49995, completed 49995
broker_confirms_deliveries: broker sent 49995; peer received 49995
no_loss: client saw 49995 completions; peer received 49995
offered_rate_held: client published 40001 of 40006 offered in the window
payloads_intact: 0 of 49995 payloads had an unexpected length
broker_headroom: broker used 0.19 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

672 µs

run 1 · valid

C source sent	49,987
broker received ($SYS)	49,987
broker sent ($SYS)	49,987
broker dropped ($SYS)	0
client received	49,987
in window: offered / received	39989 / 39989
CPU user / sys per msg	119 µs / 25.0 µs
CPU (share of a core)	72.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49987; peer wrote 49987
broker_confirms_deliveries: broker sent 49987; client received 49987
no_loss: broker acknowledged 49987 from the peer; client received 49987; broker dropped 0
offered_rate_held: peer wrote 39989 of 40000 offered in the window
client_kept_up: client received 39989 of 39989 in the window
broker_headroom: broker used 0.23 of its core
host_quiet: 0.31 cores busy outside the client, peer and broker

run 2 · valid

C source sent	49,968
broker received ($SYS)	49,968
broker sent ($SYS)	49,968
broker dropped ($SYS)	0
client received	49,968
in window: offered / received	39969 / 39969
CPU user / sys per msg	139 µs / 6.5 µs
CPU (share of a core)	72.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49968; peer wrote 49968
broker_confirms_deliveries: broker sent 49968; client received 49968
no_loss: broker acknowledged 49968 from the peer; client received 49968; broker dropped 0
offered_rate_held: peer wrote 39969 of 39999 offered in the window
client_kept_up: client received 39969 of 39969 in the window
broker_headroom: broker used 0.23 of its core
host_quiet: 0.28 cores busy outside the client, peer and broker

run 3 · valid

C source sent	49,959
broker received ($SYS)	49,959
broker sent ($SYS)	49,959
broker dropped ($SYS)	0
client received	49,959
in window: offered / received	39961 / 39960
CPU user / sys per msg	131 µs / 13.3 µs
CPU (share of a core)	72.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49959; peer wrote 49959
broker_confirms_deliveries: broker sent 49959; client received 49959
no_loss: broker acknowledged 49959 from the peer; client received 49959; broker dropped 0
offered_rate_held: peer wrote 39961 of 39999 offered in the window
client_kept_up: client received 39960 of 39961 in the window
broker_headroom: broker used 0.23 of its core
host_quiet: 0.08 cores busy outside the client, peer and broker

mqttium 1.1.0 asyncio

184 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	541 µs / 1,147 µs / 1,508 µs
due in window, never published	1
CPU user / sys per msg	232 µs / 32.5 µs
CPU (share of a core)	13.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	541 µs / 1,147 µs / 2,220 µs
due in window, never published	1
CPU user / sys per msg	232 µs / 32.5 µs
CPU (share of a core)	13.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.05 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	606 µs / 1,147 µs / 1,399 µs
due in window, never published	1
CPU user / sys per msg	232 µs / 30.0 µs
CPU (share of a core)	13.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

233 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15998 / 15998
schedule lag p50 / p99 / max	770 µs / 1,409 µs / 1,826 µs
due in window, never published	3
CPU user / sys per msg	128 µs / 20.0 µs
CPU (share of a core)	29.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,409 µs / 4,238 µs
due in window, never published	2
CPU user / sys per msg	127 µs / 20.0 µs
CPU (share of a core)	29.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15998
schedule lag p50 / p99 / max	672 µs / 1,409 µs / 3,013 µs
due in window, never published	1
CPU user / sys per msg	128 µs / 20.0 µs
CPU (share of a core)	29.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

401 µs

run 1 · valid

client sent	49,999
client completed	49,999
broker received ($SYS)	49,999
broker sent ($SYS)	49,999
C sink received	49,999
in window: sent / delivered	40000 / 39999
schedule lag p50 / p99 / max	672 µs / 1,540 µs / 2,005 µs
due in window, never published	1
CPU user / sys per msg	84.8 µs / 7.5 µs
CPU (share of a core)	46.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49999 from the client; client sent 49999, completed 49999
broker_confirms_deliveries: broker sent 49999; peer received 49999
no_loss: client saw 49999 completions; peer received 49999
offered_rate_held: client published 40000 of 40000 offered in the window
payloads_intact: 0 of 49999 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 2 · valid

client sent	49,993
client completed	49,993
broker received ($SYS)	49,993
broker sent ($SYS)	49,993
C sink received	49,993
in window: sent / delivered	39999 / 39999
schedule lag p50 / p99 / max	672 µs / 1,540 µs / 3,069 µs
due in window, never published	7
CPU user / sys per msg	85.5 µs / 7.3 µs
CPU (share of a core)	46.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49993 from the client; client sent 49993, completed 49993
broker_confirms_deliveries: broker sent 49993; peer received 49993
no_loss: client saw 49993 completions; peer received 49993
offered_rate_held: client published 39999 of 40000 offered in the window
payloads_intact: 0 of 49993 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	49,999
client completed	49,999
broker received ($SYS)	49,999
broker sent ($SYS)	49,999
C sink received	49,999
in window: sent / delivered	40001 / 39997
schedule lag p50 / p99 / max	672 µs / 1,540 µs / 1,974 µs
due in window, never published	1
CPU user / sys per msg	85.5 µs / 6.5 µs
CPU (share of a core)	46.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49999 from the client; client sent 49999, completed 49999
broker_confirms_deliveries: broker sent 49999; peer received 49999
no_loss: client saw 49999 completions; peer received 49999
offered_rate_held: client published 40001 of 40000 offered in the window
payloads_intact: 0 of 49999 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

225 µs

run 1 · valid

C source sent	49,966
broker received ($SYS)	49,966
broker sent ($SYS)	49,966
broker dropped ($SYS)	0
client received	49,966
in window: offered / received	39975 / 39975
CPU user / sys per msg	51.5 µs / 31.8 µs
CPU (share of a core)	41.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49966; peer wrote 49966
broker_confirms_deliveries: broker sent 49966; client received 49966
no_loss: broker acknowledged 49966 from the peer; client received 49966; broker dropped 0
offered_rate_held: peer wrote 39975 of 40000 offered in the window
client_kept_up: client received 39975 of 39975 in the window
broker_headroom: broker used 0.27 of its core
host_quiet: 0.32 cores busy outside the client, peer and broker

run 2 · valid

C source sent	49,972
broker received ($SYS)	49,972
broker sent ($SYS)	49,972
broker dropped ($SYS)	0
client received	49,972
in window: offered / received	39980 / 39980
CPU user / sys per msg	61.5 µs / 22.5 µs
CPU (share of a core)	42.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49972; peer wrote 49972
broker_confirms_deliveries: broker sent 49972; client received 49972
no_loss: broker acknowledged 49972 from the peer; client received 49972; broker dropped 0
offered_rate_held: peer wrote 39980 of 40000 offered in the window
client_kept_up: client received 39980 of 39980 in the window
broker_headroom: broker used 0.27 of its core
host_quiet: 0.45 cores busy outside the client, peer and broker

run 3 · valid

C source sent	49,961
broker received ($SYS)	49,961
broker sent ($SYS)	49,961
broker dropped ($SYS)	0
client received	49,961
in window: offered / received	39977 / 39977
CPU user / sys per msg	58.5 µs / 24.0 µs
CPU (share of a core)	41.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49961; peer wrote 49961
broker_confirms_deliveries: broker sent 49961; client received 49961
no_loss: broker acknowledged 49961 from the peer; client received 49961; broker dropped 0
offered_rate_held: peer wrote 39977 of 40000 offered in the window
client_kept_up: client received 39977 of 39977 in the window
broker_headroom: broker used 0.26 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

awscrt 0.37.0 crt_event_loop native

225 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	287 µs / 770 µs / 2,023 µs
due in window, never published	1
CPU user / sys per msg	92.5 µs / 90.0 µs
CPU (share of a core)	9.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.05 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	967 µs / 999 µs / 2,906 µs
due in window, never published	1
CPU user / sys per msg	97.5 µs / 82.5 µs
CPU (share of a core)	9.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.23 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	737 µs / 967 µs / 2,385 µs
due in window, never published	1
CPU user / sys per msg	72.5 µs / 110 µs
CPU (share of a core)	9.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.05 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

209 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	516 µs / 705 µs / 1,622 µs
due in window, never published	2
CPU user / sys per msg	85.0 µs / 19.4 µs
CPU (share of a core)	20.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	770 µs / 934 µs / 2,326 µs
due in window, never published	2
CPU user / sys per msg	50.6 µs / 53.1 µs
CPU (share of a core)	20.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.41 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	606 µs / 803 µs / 2,697 µs
due in window, never published	2
CPU user / sys per msg	88.1 µs / 15.6 µs
CPU (share of a core)	20.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

250 µs

run 1 · valid

client sent	49,996
client completed	49,996
broker received ($SYS)	49,996
broker sent ($SYS)	49,996
C sink received	49,996
in window: sent / delivered	39996 / 40001
schedule lag p50 / p99 / max	573 µs / 934 µs / 3,863 µs
due in window, never published	4
CPU user / sys per msg	70.3 µs / 7.8 µs
CPU (share of a core)	39.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49996 from the client; client sent 49996, completed 49996
broker_confirms_deliveries: broker sent 49996; peer received 49996
no_loss: client saw 49996 completions; peer received 49996
offered_rate_held: client published 39996 of 39999 offered in the window
payloads_intact: 0 of 49996 payloads had an unexpected length
broker_headroom: broker used 0.18 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	49,999
client completed	49,999
broker received ($SYS)	49,999
broker sent ($SYS)	49,999
C sink received	49,999
in window: sent / delivered	39999 / 39999
schedule lag p50 / p99 / max	573 µs / 999 µs / 2,545 µs
due in window, never published	1
CPU user / sys per msg	25.5 µs / 51.0 µs
CPU (share of a core)	38.2 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49999 from the client; client sent 49999, completed 49999
broker_confirms_deliveries: broker sent 49999; peer received 49999
no_loss: client saw 49999 completions; peer received 49999
offered_rate_held: client published 39999 of 40000 offered in the window
payloads_intact: 0 of 49999 payloads had an unexpected length
broker_headroom: broker used 0.18 of its core
host_quiet: 0.46 cores busy outside the client, peer and broker

run 3 · valid

client sent	49,998
client completed	49,998
broker received ($SYS)	49,998
broker sent ($SYS)	49,998
C sink received	49,998
in window: sent / delivered	39998 / 40002
schedule lag p50 / p99 / max	541 µs / 934 µs / 2,752 µs
due in window, never published	2
CPU user / sys per msg	33.0 µs / 45.3 µs
CPU (share of a core)	39.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49998 from the client; client sent 49998, completed 49998
broker_confirms_deliveries: broker sent 49998; peer received 49998
no_loss: client saw 49998 completions; peer received 49998
offered_rate_held: client published 39998 of 39999 offered in the window
payloads_intact: 0 of 49998 payloads had an unexpected length
broker_headroom: broker used 0.18 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

176 µs

run 1 · valid

C source sent	49,970
broker received ($SYS)	49,970
broker sent ($SYS)	49,970
broker dropped ($SYS)	0
client received	49,970
in window: offered / received	39975 / 39975
CPU user / sys per msg	13.0 µs / 26.3 µs
CPU (share of a core)	19.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49970; peer wrote 49970
broker_confirms_deliveries: broker sent 49970; client received 49970
no_loss: broker acknowledged 49970 from the peer; client received 49970; broker dropped 0
offered_rate_held: peer wrote 39975 of 40000 offered in the window
client_kept_up: client received 39975 of 39975 in the window
broker_headroom: broker used 0.26 of its core
host_quiet: 0.07 cores busy outside the client, peer and broker

run 2 · valid

C source sent	49,973
broker received ($SYS)	49,973
broker sent ($SYS)	49,973
broker dropped ($SYS)	0
client received	49,973
in window: offered / received	39988 / 39989
CPU user / sys per msg	18.0 µs / 22.8 µs
CPU (share of a core)	20.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49973; peer wrote 49973
broker_confirms_deliveries: broker sent 49973; client received 49973
no_loss: broker acknowledged 49973 from the peer; client received 49973; broker dropped 0
offered_rate_held: peer wrote 39988 of 40000 offered in the window
client_kept_up: client received 39989 of 39988 in the window
broker_headroom: broker used 0.26 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

run 3 · valid

C source sent	49,982
broker received ($SYS)	49,982
broker sent ($SYS)	49,982
broker dropped ($SYS)	0
client received	49,982
in window: offered / received	39986 / 39986
CPU user / sys per msg	13.0 µs / 27.0 µs
CPU (share of a core)	20.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49982; peer wrote 49982
broker_confirms_deliveries: broker sent 49982; client received 49982
no_loss: broker acknowledged 49982 from the peer; client received 49982; broker dropped 0
offered_rate_held: peer wrote 39986 of 40000 offered in the window
client_kept_up: client received 39986 of 39986 in the window
broker_headroom: broker used 0.26 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

paho 2.1.0 sync

233 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 803 µs / 2,717 µs
due in window, never published	1
CPU user / sys per msg	232 µs / 22.5 µs
CPU (share of a core)	12.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.39 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	75.8 µs / 737 µs / 2,008 µs
due in window, never published	1
CPU user / sys per msg	175 µs / 72.5 µs
CPU (share of a core)	12.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.05 of its core
host_quiet: 0.41 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 705 µs / 1,561 µs
due in window, never published	1
CPU user / sys per msg	222 µs / 22.5 µs
CPU (share of a core)	12.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.05 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

270 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	500 µs / 573 µs / 2,448 µs
due in window, never published	2
CPU user / sys per msg	134 µs / 25.6 µs
CPU (share of a core)	32.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	573 µs / 639 µs / 1,411 µs
due in window, never published	2
CPU user / sys per msg	143 µs / 18.8 µs
CPU (share of a core)	32.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	541 µs / 770 µs / 1,710 µs
due in window, never published	2
CPU user / sys per msg	90.6 µs / 70.6 µs
CPU (share of a core)	32.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.26 cores busy outside the client, peer and broker

319 µs

run 1 · valid

client sent	49,996
client completed	49,996
broker received ($SYS)	49,996
broker sent ($SYS)	49,996
C sink received	49,996
in window: sent / delivered	40001 / 40001
schedule lag p50 / p99 / max	606 µs / 934 µs / 2,654 µs
due in window, never published	4
CPU user / sys per msg	68.0 µs / 36.2 µs
CPU (share of a core)	52.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49996 from the client; client sent 49996, completed 49996
broker_confirms_deliveries: broker sent 49996; peer received 49996
no_loss: client saw 49996 completions; peer received 49996
offered_rate_held: client published 40001 of 40000 offered in the window
payloads_intact: 0 of 49996 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.34 cores busy outside the client, peer and broker

run 2 · valid

client sent	49,995
client completed	49,995
broker received ($SYS)	49,995
broker sent ($SYS)	49,995
C sink received	49,995
in window: sent / delivered	39995 / 40000
schedule lag p50 / p99 / max	483 µs / 868 µs / 1,419 µs
due in window, never published	5
CPU user / sys per msg	86.5 µs / 21.0 µs
CPU (share of a core)	53.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49995 from the client; client sent 49995, completed 49995
broker_confirms_deliveries: broker sent 49995; peer received 49995
no_loss: client saw 49995 completions; peer received 49995
offered_rate_held: client published 39995 of 39999 offered in the window
payloads_intact: 0 of 49995 payloads had an unexpected length
broker_headroom: broker used 0.16 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	49,998
client completed	49,998
broker received ($SYS)	49,998
broker sent ($SYS)	49,998
C sink received	49,998
in window: sent / delivered	40001 / 40001
schedule lag p50 / p99 / max	541 µs / 901 µs / 1,968 µs
due in window, never published	2
CPU user / sys per msg	55.2 µs / 56.2 µs
CPU (share of a core)	55.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49998 from the client; client sent 49998, completed 49998
broker_confirms_deliveries: broker sent 49998; peer received 49998
no_loss: client saw 49998 completions; peer received 49998
offered_rate_held: client published 40001 of 40000 offered in the window
payloads_intact: 0 of 49998 payloads had an unexpected length
broker_headroom: broker used 0.16 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

209 µs

run 1 · valid

C source sent	49,983
broker received ($SYS)	49,983
broker sent ($SYS)	49,983
broker dropped ($SYS)	0
client received	49,983
in window: offered / received	39985 / 39985
CPU user / sys per msg	31.8 µs / 54.0 µs
CPU (share of a core)	42.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49983; peer wrote 49983
broker_confirms_deliveries: broker sent 49983; client received 49983
no_loss: broker acknowledged 49983 from the peer; client received 49983; broker dropped 0
offered_rate_held: peer wrote 39985 of 40000 offered in the window
client_kept_up: client received 39985 of 39985 in the window
broker_headroom: broker used 0.25 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	49,969
broker received ($SYS)	49,969
broker sent ($SYS)	49,969
broker dropped ($SYS)	0
client received	49,969
in window: offered / received	39970 / 39970
CPU user / sys per msg	22.0 µs / 63.5 µs
CPU (share of a core)	42.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49969; peer wrote 49969
broker_confirms_deliveries: broker sent 49969; client received 49969
no_loss: broker acknowledged 49969 from the peer; client received 49969; broker dropped 0
offered_rate_held: peer wrote 39970 of 40000 offered in the window
client_kept_up: client received 39970 of 39970 in the window
broker_headroom: broker used 0.26 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

C source sent	49,976
broker received ($SYS)	49,976
broker sent ($SYS)	49,976
broker dropped ($SYS)	0
client received	49,976
in window: offered / received	39977 / 39977
CPU user / sys per msg	31.8 µs / 54.8 µs
CPU (share of a core)	43.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49976; peer wrote 49976
broker_confirms_deliveries: broker sent 49976; client received 49976
no_loss: broker acknowledged 49976 from the peer; client received 49976; broker dropped 0
offered_rate_held: peer wrote 39977 of 40000 offered in the window
client_kept_up: client received 39977 of 39977 in the window
broker_headroom: broker used 0.25 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

aiomqtt 2.5.1 asyncio

803 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 3,372 µs
due in window, never published	1
CPU user / sys per msg	700 µs / 40.0 µs
CPU (share of a core)	37.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	737 µs / 1,343 µs / 2,038 µs
due in window, never published	1
CPU user / sys per msg	712 µs / 32.5 µs
CPU (share of a core)	37.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.05 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 1,409 µs / 3,156 µs
due in window, never published	1
CPU user / sys per msg	712 µs / 35.0 µs
CPU (share of a core)	37.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.04 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

1,343 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16004
schedule lag p50 / p99 / max	1,147 µs / 2,294 µs / 4,376 µs
due in window, never published	2
CPU user / sys per msg	253 µs / 16.2 µs
CPU (share of a core)	53.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16003 / 15999
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,860 µs
due in window, never published	1
CPU user / sys per msg	257 µs / 17.5 µs
CPU (share of a core)	54.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16003 of 16001 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 3,329 µs
due in window, never published	2
CPU user / sys per msg	257 µs / 16.2 µs
CPU (share of a core)	54.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

1,671 µs

run 1 · valid

client sent	49,998
client completed	49,998
broker received ($SYS)	49,998
broker sent ($SYS)	49,998
C sink received	49,998
in window: sent / delivered	40002 / 40000
schedule lag p50 / p99 / max	868 µs / 1,868 µs / 4,506 µs
due in window, never published	2
CPU user / sys per msg	187 µs / 12.5 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49998 from the client; client sent 49998, completed 49998
broker_confirms_deliveries: broker sent 49998; peer received 49998
no_loss: client saw 49998 completions; peer received 49998
offered_rate_held: client published 40002 of 40002 offered in the window
payloads_intact: 0 of 49998 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.11 cores busy outside the client, peer and broker

run 2 · valid

client sent	49,988
client completed	49,988
broker received ($SYS)	49,988
broker sent ($SYS)	49,988
C sink received	49,988
in window: sent / delivered	39998 / 39999
schedule lag p50 / p99 / max	868 µs / 1,671 µs / 4,527 µs
due in window, never published	2
CPU user / sys per msg	187 µs / 12.8 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49988 from the client; client sent 49988, completed 49988
broker_confirms_deliveries: broker sent 49988; peer received 49988
no_loss: client saw 49988 completions; peer received 49988
offered_rate_held: client published 39998 of 39998 offered in the window
payloads_intact: 0 of 49988 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 3 · valid

client sent	49,996
client completed	49,996
broker received ($SYS)	49,996
broker sent ($SYS)	49,996
C sink received	49,996
in window: sent / delivered	39999 / 39999
schedule lag p50 / p99 / max	868 µs / 1,475 µs / 3,090 µs
due in window, never published	4
CPU user / sys per msg	187 µs / 13.5 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 49996 from the client; client sent 49996, completed 49996
broker_confirms_deliveries: broker sent 49996; peer received 49996
no_loss: client saw 49996 completions; peer received 49996
offered_rate_held: client published 39999 of 40001 offered in the window
payloads_intact: 0 of 49996 payloads had an unexpected length
broker_headroom: broker used 0.17 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

1,032 µs

run 1 · valid

C source sent	49,982
broker received ($SYS)	49,982
broker sent ($SYS)	49,982
broker dropped ($SYS)	0
client received	49,982
in window: offered / received	39983 / 39984
CPU user / sys per msg	124 µs / 25.5 µs
CPU (share of a core)	74.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49982; peer wrote 49982
broker_confirms_deliveries: broker sent 49982; client received 49982
no_loss: broker acknowledged 49982 from the peer; client received 49982; broker dropped 0
offered_rate_held: peer wrote 39983 of 40000 offered in the window
client_kept_up: client received 39984 of 39983 in the window
broker_headroom: broker used 0.22 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

C source sent	49,982
broker received ($SYS)	49,982
broker sent ($SYS)	49,982
broker dropped ($SYS)	0
client received	49,982
in window: offered / received	39985 / 39985
CPU user / sys per msg	118 µs / 30.8 µs
CPU (share of a core)	74.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49982; peer wrote 49982
broker_confirms_deliveries: broker sent 49982; client received 49982
no_loss: broker acknowledged 49982 from the peer; client received 49982; broker dropped 0
offered_rate_held: peer wrote 39985 of 40000 offered in the window
client_kept_up: client received 39985 of 39985 in the window
broker_headroom: broker used 0.22 of its core
host_quiet: 0.05 cores busy outside the client, peer and broker

run 3 · valid

C source sent	49,974
broker received ($SYS)	49,974
broker sent ($SYS)	49,974
broker dropped ($SYS)	0
client received	49,974
in window: offered / received	39981 / 39980
CPU user / sys per msg	98.8 µs / 48.3 µs
CPU (share of a core)	73.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 49974; peer wrote 49974
broker_confirms_deliveries: broker sent 49974; client received 49974
no_loss: broker acknowledged 49974 from the peer; client received 49974; broker dropped 0
offered_rate_held: peer wrote 39981 of 40000 offered in the window
client_kept_up: client received 39980 of 39981 in the window
broker_headroom: broker used 0.23 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

aiomqtt3 3.0.0a1 asyncio experimental

unsupported

What does exactly-once (QoS 2) cost?

Four packets per message instead of two. Capacity counts a message once its PUBCOMP is back, 64 in flight. Clients whose QoS 2 does not complete the exchange are refused.

client

publish capacity
msgs/s ↑

publish 2k/s CPU
CPU / msg ↓

publish 2k/s p99 ↓

receive 2k/s CPU
CPU / msg ↓

mqttium 1.1.0 asyncio

19,429

run 1 · valid

client sent	194,419
client completed	194,419
broker received ($SYS)	194,419
broker sent ($SYS)	194,419
C sink received	194,419
in window: sent / delivered	155448 / 155443
CPU user / sys per msg	48.1 µs / 3.3 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 194419 from the client; client sent 194419, completed 194419
broker_confirms_deliveries: broker sent 194419; peer received 194419
no_loss: client saw 194419 completions; peer received 194419
payloads_intact: 0 of 194419 payloads had an unexpected length
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

client sent	193,567
client completed	193,567
broker received ($SYS)	193,567
broker sent ($SYS)	193,567
C sink received	193,567
in window: sent / delivered	154856 / 154863
CPU user / sys per msg	47.8 µs / 3.9 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 193567 from the client; client sent 193567, completed 193567
broker_confirms_deliveries: broker sent 193567; peer received 193567
no_loss: client saw 193567 completions; peer received 193567
payloads_intact: 0 of 193567 payloads had an unexpected length
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	195,908
client completed	195,908
broker received ($SYS)	195,908
broker sent ($SYS)	195,908
C sink received	195,908
in window: sent / delivered	156752 / 156746
CPU user / sys per msg	47.3 µs / 3.7 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 195908 from the client; client sent 195908, completed 195908
broker_confirms_deliveries: broker sent 195908; peer received 195908
no_loss: client saw 195908 completions; peer received 195908
payloads_intact: 0 of 195908 payloads had an unexpected length
host_quiet: 0.19 cores busy outside the client, peer and broker

186 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 15997
schedule lag p50 / p99 / max	672 µs / 1,540 µs / 4,037 µs
due in window, never published	2
CPU user / sys per msg	158 µs / 31.9 µs
CPU (share of a core)	37.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 16000
schedule lag p50 / p99 / max	705 µs / 1,540 µs / 3,215 µs
due in window, never published	2
CPU user / sys per msg	155 µs / 31.3 µs
CPU (share of a core)	37.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16003
schedule lag p50 / p99 / max	705 µs / 1,540 µs / 2,855 µs
due in window, never published	1
CPU user / sys per msg	152 µs / 31.9 µs
CPU (share of a core)	36.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

467 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 15997
schedule lag p50 / p99 / max	672 µs / 1,540 µs / 4,037 µs
due in window, never published	2
CPU user / sys per msg	158 µs / 31.9 µs
CPU (share of a core)	37.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 16000
schedule lag p50 / p99 / max	705 µs / 1,540 µs / 3,215 µs
due in window, never published	2
CPU user / sys per msg	155 µs / 31.3 µs
CPU (share of a core)	37.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16003
schedule lag p50 / p99 / max	705 µs / 1,540 µs / 2,855 µs
due in window, never published	1
CPU user / sys per msg	152 µs / 31.9 µs
CPU (share of a core)	36.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

166 µs

run 1 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15993 / 15993
CPU user / sys per msg	147 µs / 19.4 µs
CPU (share of a core)	33.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15993 of 16000 offered in the window
client_kept_up: client received 15993 of 15993 in the window
broker_headroom: broker used 0.19 of its core
host_quiet: 0.28 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15998 / 15998
CPU user / sys per msg	128 µs / 38.1 µs
CPU (share of a core)	33.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
broker_headroom: broker used 0.18 of its core
host_quiet: 0.46 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15995 / 15995
CPU user / sys per msg	119 µs / 48.8 µs
CPU (share of a core)	33.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.18 of its core
host_quiet: 0.08 cores busy outside the client, peer and broker

zmqtt 0.2.4 asyncio experimental

11,347

run 1 · valid

client sent	113,686
client completed	113,686
broker received ($SYS)	113,686
broker sent ($SYS)	113,686
C sink received	113,686
in window: sent / delivered	90889 / 90892
CPU user / sys per msg	65.7 µs / 22.3 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 113686 from the client; client sent 113686, completed 113686
broker_confirms_deliveries: broker sent 113686; peer received 113686
no_loss: client saw 113686 completions; peer received 113686
payloads_intact: 0 of 113686 payloads had an unexpected length
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	113,011
client completed	113,011
broker received ($SYS)	113,011
broker sent ($SYS)	113,011
C sink received	113,011
in window: sent / delivered	90358 / 90319
CPU user / sys per msg	66.8 µs / 21.7 µs
CPU (share of a core)	100.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 113011 from the client; client sent 113011, completed 113011
broker_confirms_deliveries: broker sent 113011; peer received 113011
no_loss: client saw 113011 completions; peer received 113011
payloads_intact: 0 of 113011 payloads had an unexpected length
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	113,662
client completed	113,662
broker received ($SYS)	113,662
broker sent ($SYS)	113,662
C sink received	113,662
in window: sent / delivered	90814 / 90782
CPU user / sys per msg	67.2 µs / 20.8 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 113662 from the client; client sent 113662, completed 113662
broker_confirms_deliveries: broker sent 113662; peer received 113662
no_loss: client saw 113662 completions; peer received 113662
payloads_intact: 0 of 113662 payloads had an unexpected length
host_quiet: 0.17 cores busy outside the client, peer and broker

314 µs

run 1 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 16001
schedule lag p50 / p99 / max	1,032 µs / 2,163 µs / 2,397 µs
due in window, never published	4
CPU user / sys per msg	259 µs / 55.6 µs
CPU (share of a core)	62.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 15999 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	967 µs / 2,163 µs / 2,403 µs
due in window, never published	2
CPU user / sys per msg	271 µs / 45.6 µs
CPU (share of a core)	63.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16002 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16001
schedule lag p50 / p99 / max	999 µs / 2,163 µs / 2,447 µs
due in window, never published	3
CPU user / sys per msg	271 µs / 43.1 µs
CPU (share of a core)	62.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

967 µs

run 1 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15998 / 16001
schedule lag p50 / p99 / max	1,032 µs / 2,163 µs / 2,397 µs
due in window, never published	4
CPU user / sys per msg	259 µs / 55.6 µs
CPU (share of a core)	62.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15998 of 15999 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	967 µs / 2,163 µs / 2,403 µs
due in window, never published	2
CPU user / sys per msg	271 µs / 45.6 µs
CPU (share of a core)	63.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16002 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16001
schedule lag p50 / p99 / max	999 µs / 2,163 µs / 2,447 µs
due in window, never published	3
CPU user / sys per msg	271 µs / 43.1 µs
CPU (share of a core)	62.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

286 µs

run 1 · valid

C source sent	19,985
broker received ($SYS)	19,985
broker sent ($SYS)	19,985
broker dropped ($SYS)	0
client received	19,985
in window: offered / received	15988 / 15988
CPU user / sys per msg	207 µs / 78.8 µs
CPU (share of a core)	57.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19985; peer wrote 19985
broker_confirms_deliveries: broker sent 19985; client received 19985
no_loss: broker acknowledged 19985 from the peer; client received 19985; broker dropped 0
offered_rate_held: peer wrote 15988 of 16000 offered in the window
client_kept_up: client received 15988 of 15988 in the window
broker_headroom: broker used 0.19 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,989
broker received ($SYS)	19,989
broker sent ($SYS)	19,989
broker dropped ($SYS)	0
client received	19,989
in window: offered / received	15993 / 15992
CPU user / sys per msg	236 µs / 50.0 µs
CPU (share of a core)	57.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19989; peer wrote 19989
broker_confirms_deliveries: broker sent 19989; client received 19989
no_loss: broker acknowledged 19989 from the peer; client received 19989; broker dropped 0
offered_rate_held: peer wrote 15993 of 16000 offered in the window
client_kept_up: client received 15992 of 15993 in the window
broker_headroom: broker used 0.19 of its core
host_quiet: 0.26 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,988
broker received ($SYS)	19,988
broker sent ($SYS)	19,988
broker dropped ($SYS)	0
client received	19,988
in window: offered / received	15990 / 15990
CPU user / sys per msg	254 µs / 32.5 µs
CPU (share of a core)	57.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19988; peer wrote 19988
broker_confirms_deliveries: broker sent 19988; client received 19988
no_loss: broker acknowledged 19988 from the peer; client received 19988; broker dropped 0
offered_rate_held: peer wrote 15990 of 16000 offered in the window
client_kept_up: client received 15990 of 15990 in the window
broker_headroom: broker used 0.19 of its core
host_quiet: 0.03 cores busy outside the client, peer and broker

aiomqtt 2.5.1 asyncio

8,451

run 1 · valid

client sent	84,958
client completed	84,958
broker received ($SYS)	84,958
broker sent ($SYS)	84,958
C sink received	84,958
in window: sent / delivered	67614 / 67614
CPU user / sys per msg	99.8 µs / 18.3 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 84958 from the client; client sent 84958, completed 84958
broker_confirms_deliveries: broker sent 84958; peer received 84958
no_loss: client saw 84958 completions; peer received 84958
payloads_intact: 0 of 84958 payloads had an unexpected length
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

client sent	84,658
client completed	84,658
broker received ($SYS)	84,658
broker sent ($SYS)	84,658
C sink received	84,658
in window: sent / delivered	67314 / 67319
CPU user / sys per msg	100.0 µs / 18.7 µs
CPU (share of a core)	99.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 84658 from the client; client sent 84658, completed 84658
broker_confirms_deliveries: broker sent 84658; peer received 84658
no_loss: client saw 84658 completions; peer received 84658
payloads_intact: 0 of 84658 payloads had an unexpected length
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	86,272
client completed	86,272
broker received ($SYS)	86,272
broker sent ($SYS)	86,272
C sink received	86,272
in window: sent / delivered	68800 / 68800
CPU user / sys per msg	97.1 µs / 19.2 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 86272 from the client; client sent 86272, completed 86272
broker_confirms_deliveries: broker sent 86272; peer received 86272
no_loss: client saw 86272 completions; peer received 86272
payloads_intact: 0 of 86272 payloads had an unexpected length
host_quiet: 0.22 cores busy outside the client, peer and broker

388 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	803 µs / 2,163 µs / 2,285 µs
due in window, never published	1
CPU user / sys per msg	348 µs / 40.6 µs
CPU (share of a core)	77.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15997 / 15999
schedule lag p50 / p99 / max	803 µs / 2,163 µs / 4,112 µs
due in window, never published	4
CPU user / sys per msg	349 µs / 40.6 µs
CPU (share of a core)	77.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15997 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.23 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	803 µs / 2,163 µs / 2,597 µs
due in window, never published	2
CPU user / sys per msg	346 µs / 41.3 µs
CPU (share of a core)	77.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16001 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

1,475 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	803 µs / 2,163 µs / 2,285 µs
due in window, never published	1
CPU user / sys per msg	348 µs / 40.6 µs
CPU (share of a core)	77.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	15997 / 15999
schedule lag p50 / p99 / max	803 µs / 2,163 µs / 4,112 µs
due in window, never published	4
CPU user / sys per msg	349 µs / 40.6 µs
CPU (share of a core)	77.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 15997 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.23 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	803 µs / 2,163 µs / 2,597 µs
due in window, never published	2
CPU user / sys per msg	346 µs / 41.3 µs
CPU (share of a core)	77.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16001 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.15 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

269 µs

run 1 · valid

C source sent	19,991
broker received ($SYS)	19,991
broker sent ($SYS)	19,991
broker dropped ($SYS)	0
client received	19,991
in window: offered / received	15994 / 15994
CPU user / sys per msg	237 µs / 32.5 µs
CPU (share of a core)	53.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19991; peer wrote 19991
broker_confirms_deliveries: broker sent 19991; client received 19991
no_loss: broker acknowledged 19991 from the peer; client received 19991; broker dropped 0
offered_rate_held: peer wrote 15994 of 16000 offered in the window
client_kept_up: client received 15994 of 15994 in the window
broker_headroom: broker used 0.20 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
broker dropped ($SYS)	0
client received	19,998
in window: offered / received	15999 / 15999
CPU user / sys per msg	204 µs / 65.6 µs
CPU (share of a core)	54.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19998; peer wrote 19998
broker_confirms_deliveries: broker sent 19998; client received 19998
no_loss: broker acknowledged 19998 from the peer; client received 19998; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.20 of its core
host_quiet: 0.12 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,987
broker received ($SYS)	19,987
broker sent ($SYS)	19,987
broker dropped ($SYS)	0
client received	19,987
in window: offered / received	15990 / 15990
CPU user / sys per msg	243 µs / 25.6 µs
CPU (share of a core)	53.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19987; peer wrote 19987
broker_confirms_deliveries: broker sent 19987; client received 19987
no_loss: broker acknowledged 19987 from the peer; client received 19987; broker dropped 0
offered_rate_held: peer wrote 15990 of 16000 offered in the window
client_kept_up: client received 15990 of 15990 in the window
broker_headroom: broker used 0.20 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

paho 2.1.0 sync

8,277

run 1 · valid

client sent	83,977
client completed	83,977
broker received ($SYS)	83,977
broker sent ($SYS)	83,977
C sink received	83,977
in window: sent / delivered	66209 / 66220
CPU user / sys per msg	100.0 µs / 44.9 µs
CPU (share of a core)	119.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 83977 from the client; client sent 83977, completed 83977
broker_confirms_deliveries: broker sent 83977; peer received 83977
no_loss: client saw 83977 completions; peer received 83977
payloads_intact: 0 of 83977 payloads had an unexpected length
host_quiet: 0.12 cores busy outside the client, peer and broker

run 2 · valid

client sent	80,032
client completed	80,032
broker received ($SYS)	80,032
broker sent ($SYS)	80,032
C sink received	80,032
in window: sent / delivered	63888 / 63908
CPU user / sys per msg	105 µs / 43.5 µs
CPU (share of a core)	118.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 80032 from the client; client sent 80032, completed 80032
broker_confirms_deliveries: broker sent 80032; peer received 80032
no_loss: client saw 80032 completions; peer received 80032
payloads_intact: 0 of 80032 payloads had an unexpected length
host_quiet: 0.11 cores busy outside the client, peer and broker

run 3 · valid

client sent	84,174
client completed	84,174
broker received ($SYS)	84,174
broker sent ($SYS)	84,174
C sink received	84,174
in window: sent / delivered	66444 / 66412
CPU user / sys per msg	98.9 µs / 43.8 µs
CPU (share of a core)	118.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 84174 from the client; client sent 84174, completed 84174
broker_confirms_deliveries: broker sent 84174; peer received 84174
no_loss: client saw 84174 completions; peer received 84174
payloads_intact: 0 of 84174 payloads had an unexpected length
host_quiet: 0.13 cores busy outside the client, peer and broker

219 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	541 µs / 934 µs / 2,865 µs
due in window, never published	2
CPU user / sys per msg	166 µs / 53.1 µs
CPU (share of a core)	43.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.16 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · attempt 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	541 µs / 999 µs / 2,454 µs
due in window, never published	1
CPU user / sys per msg	132 µs / 76.9 µs
CPU (share of a core)	41.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.16 of its core
host_quiet: 0.35 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16002
schedule lag p50 / p99 / max	516 µs / 999 µs / 3,448 µs
due in window, never published	1
CPU user / sys per msg	166 µs / 53.1 µs
CPU (share of a core)	43.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.16 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

401 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	541 µs / 934 µs / 2,865 µs
due in window, never published	2
CPU user / sys per msg	166 µs / 53.1 µs
CPU (share of a core)	43.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.16 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · attempt 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	541 µs / 999 µs / 2,454 µs
due in window, never published	1
CPU user / sys per msg	132 µs / 76.9 µs
CPU (share of a core)	41.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.16 of its core
host_quiet: 0.35 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16002
schedule lag p50 / p99 / max	516 µs / 999 µs / 3,448 µs
due in window, never published	1
CPU user / sys per msg	166 µs / 53.1 µs
CPU (share of a core)	43.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.16 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

162 µs 2/3 valid

run 1 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15998 / 15998
CPU user / sys per msg	113 µs / 48.8 µs
CPU (share of a core)	32.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
broker_headroom: broker used 0.19 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15995 / 15995
CPU user / sys per msg	81.3 µs / 80.0 µs
CPU (share of a core)	32.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.19 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · invalid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	16000 / 16000
CPU user / sys per msg	92.5 µs / 71.2 µs
CPU (share of a core)	32.8 %
threads	2

host_quiet: 0.61 cores busy outside the client, peer and broker
worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 16000 of 16000 offered in the window
client_kept_up: client received 16000 of 16000 in the window
broker_headroom: broker used 0.19 of its core

amqtt 0.12.1 asyncio

4,824

run 1 · valid

client sent	48,320
client completed	48,320
broker received ($SYS)	48,320
broker sent ($SYS)	48,320
C sink received	48,320
in window: sent / delivered	38604 / 38604
CPU user / sys per msg	184 µs / 23.3 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 48320 from the client; client sent 48320, completed 48320
broker_confirms_deliveries: broker sent 48320; peer received 48320
no_loss: client saw 48320 completions; peer received 48320
payloads_intact: 0 of 48320 payloads had an unexpected length
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	48,187
client completed	48,187
broker received ($SYS)	48,187
broker sent ($SYS)	48,187
C sink received	48,187
in window: sent / delivered	38523 / 38500
CPU user / sys per msg	185 µs / 23.1 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 48187 from the client; client sent 48187, completed 48187
broker_confirms_deliveries: broker sent 48187; peer received 48187
no_loss: client saw 48187 completions; peer received 48187
payloads_intact: 0 of 48187 payloads had an unexpected length
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

client sent	48,190
client completed	48,190
broker received ($SYS)	48,190
broker sent ($SYS)	48,190
C sink received	48,190
in window: sent / delivered	38642 / 38592
CPU user / sys per msg	184 µs / 23.5 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 48190 from the client; client sent 48190, completed 48190
broker_confirms_deliveries: broker sent 48190; peer received 48190
no_loss: client saw 48190 completions; peer received 48190
payloads_intact: 0 of 48190 payloads had an unexpected length
host_quiet: 0.19 cores busy outside the client, peer and broker

477 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15999
schedule lag p50 / p99 / max	705 µs / 2,064 µs / 3,963 µs
due in window, never published	1
CPU user / sys per msg	416 µs / 61.9 µs
CPU (share of a core)	95.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.14 of its core
host_quiet: 0.30 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 2,064 µs / 2,155 µs
due in window, never published	1
CPU user / sys per msg	439 µs / 38.8 µs
CPU (share of a core)	95.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.14 of its core
host_quiet: 0.11 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 2,064 µs / 2,257 µs
due in window, never published	1
CPU user / sys per msg	412 µs / 61.9 µs
CPU (share of a core)	94.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.14 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

1,802 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15999
schedule lag p50 / p99 / max	705 µs / 2,064 µs / 3,963 µs
due in window, never published	1
CPU user / sys per msg	416 µs / 61.9 µs
CPU (share of a core)	95.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.14 of its core
host_quiet: 0.30 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 2,064 µs / 2,155 µs
due in window, never published	1
CPU user / sys per msg	439 µs / 38.8 µs
CPU (share of a core)	95.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.14 of its core
host_quiet: 0.11 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 2,064 µs / 2,257 µs
due in window, never published	1
CPU user / sys per msg	412 µs / 61.9 µs
CPU (share of a core)	94.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.14 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

359 µs

run 1 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15996 / 15995
CPU user / sys per msg	298 µs / 56.9 µs
CPU (share of a core)	70.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15995 of 15996 in the window
broker_headroom: broker used 0.19 of its core
host_quiet: 0.36 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15995 / 15995
CPU user / sys per msg	290 µs / 68.8 µs
CPU (share of a core)	71.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.18 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,988
broker received ($SYS)	19,988
broker sent ($SYS)	19,988
broker dropped ($SYS)	0
client received	19,988
in window: offered / received	15992 / 15992
CPU user / sys per msg	271 µs / 90.7 µs
CPU (share of a core)	72.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19988; peer wrote 19988
broker_confirms_deliveries: broker sent 19988; client received 19988
no_loss: broker acknowledged 19988 from the peer; client received 19988; broker dropped 0
offered_rate_held: peer wrote 15992 of 16000 offered in the window
client_kept_up: client received 15992 of 15992 in the window
broker_headroom: broker used 0.19 of its core
host_quiet: 0.23 cores busy outside the client, peer and broker

aiomqtt3 3.0.0a1 asyncio experimental

unsupported

awscrt 0.37.0 crt_event_loop native

unsupported

gmqtt 0.7.0 asyncio

unsupported

What do many topics cost?

2,000 QoS 1 msgs/s spread over 1,000 topics: published round-robin, received through one wildcard, or dispatched to 100 per-filter callbacks (only libraries that match filters natively).

client

publish, 1,000 topics
CPU / msg ↓

receive, wildcard
CPU / msg ↓

receive, 100 callbacks
CPU / msg ↓

callbacks p99 ↓

awscrt 0.37.0 crt_event_loop native

103 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	573 µs / 836 µs / 2,637 µs
due in window, never published	2
CPU user / sys per msg	56.9 µs / 46.3 µs
CPU (share of a core)	20.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.06 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	541 µs / 836 µs / 2,744 µs
due in window, never published	2
CPU user / sys per msg	93.8 µs / 6.9 µs
CPU (share of a core)	20.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	15999 / 16001
schedule lag p50 / p99 / max	500 µs / 770 µs / 2,452 µs
due in window, never published	1
CPU user / sys per msg	56.9 µs / 50.6 µs
CPU (share of a core)	21.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.49 cores busy outside the client, peer and broker

45.6 µs

run 1 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15997 / 15997
CPU user / sys per msg	9.4 µs / 36.3 µs
CPU (share of a core)	9.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.43 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,986
broker received ($SYS)	19,986
broker sent ($SYS)	19,986
broker dropped ($SYS)	0
client received	19,986
in window: offered / received	15994 / 15994
CPU user / sys per msg	34.4 µs / 10.6 µs
CPU (share of a core)	9.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19986; peer wrote 19986
broker_confirms_deliveries: broker sent 19986; client received 19986
no_loss: broker acknowledged 19986 from the peer; client received 19986; broker dropped 0
offered_rate_held: peer wrote 15994 of 16000 offered in the window
client_kept_up: client received 15994 of 15994 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.28 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15995 / 15995
CPU user / sys per msg	23.8 µs / 22.5 µs
CPU (share of a core)	9.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.47 cores busy outside the client, peer and broker

unsupported

gmqtt 0.7.0 asyncio

123 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 15998
schedule lag p50 / p99 / max	705 µs / 1,409 µs / 3,172 µs
due in window, never published	1
CPU user / sys per msg	85.0 µs / 39.4 µs
CPU (share of a core)	24.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15999
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 2,773 µs
due in window, never published	1
CPU user / sys per msg	86.9 µs / 35.0 µs
CPU (share of a core)	24.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	672 µs / 1,343 µs / 2,834 µs
due in window, never published	1
CPU user / sys per msg	88.1 µs / 35.0 µs
CPU (share of a core)	24.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

99.4 µs

run 1 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15998 / 15998
CPU user / sys per msg	56.3 µs / 43.1 µs
CPU (share of a core)	19.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.25 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15999 / 15999
CPU user / sys per msg	88.8 µs / 10.0 µs
CPU (share of a core)	19.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15995 / 15995
CPU user / sys per msg	43.8 µs / 59.4 µs
CPU (share of a core)	20.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.37 cores busy outside the client, peer and broker

unsupported

mqttium 1.1.0 asyncio

148 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 16002
schedule lag p50 / p99 / max	770 µs / 1,409 µs / 3,771 µs
due in window, never published	1
CPU user / sys per msg	126 µs / 21.9 µs
CPU (share of a core)	29.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	737 µs / 1,409 µs / 3,149 µs
due in window, never published	3
CPU user / sys per msg	126 µs / 22.5 µs
CPU (share of a core)	29.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.12 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	672 µs / 1,409 µs / 2,360 µs
due in window, never published	2
CPU user / sys per msg	126 µs / 21.3 µs
CPU (share of a core)	29.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.10 cores busy outside the client, peer and broker

95.0 µs

run 1 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15995 / 15995
CPU user / sys per msg	79.4 µs / 14.4 µs
CPU (share of a core)	18.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15997 / 15997
CPU user / sys per msg	94.4 µs / 1.9 µs
CPU (share of a core)	19.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15998 / 15998
CPU user / sys per msg	78.1 µs / 16.9 µs
CPU (share of a core)	19.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.35 cores busy outside the client, peer and broker

159 µs

run 1 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15994 / 15994
CPU user / sys per msg	133 µs / 28.1 µs
CPU (share of a core)	32.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15994 of 16000 offered in the window
client_kept_up: client received 15994 of 15994 in the window
callbacks_matched: 19992 messages reached a filter callback, 0 the catch-all
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,988
broker received ($SYS)	19,988
broker sent ($SYS)	19,988
broker dropped ($SYS)	0
client received	19,988
in window: offered / received	15997 / 15997
CPU user / sys per msg	116 µs / 42.5 µs
CPU (share of a core)	31.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19988; peer wrote 19988
broker_confirms_deliveries: broker sent 19988; client received 19988
no_loss: broker acknowledged 19988 from the peer; client received 19988; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
callbacks_matched: 19988 messages reached a filter callback, 0 the catch-all
broker_headroom: broker used 0.12 of its core
host_quiet: 0.28 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15996 / 15996
CPU user / sys per msg	137 µs / 20.0 µs
CPU (share of a core)	31.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
callbacks_matched: 19995 messages reached a filter callback, 0 the catch-all
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

303 µs

run 1 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15994 / 15994
CPU user / sys per msg	133 µs / 28.1 µs
CPU (share of a core)	32.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15994 of 16000 offered in the window
client_kept_up: client received 15994 of 15994 in the window
callbacks_matched: 19992 messages reached a filter callback, 0 the catch-all
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,988
broker received ($SYS)	19,988
broker sent ($SYS)	19,988
broker dropped ($SYS)	0
client received	19,988
in window: offered / received	15997 / 15997
CPU user / sys per msg	116 µs / 42.5 µs
CPU (share of a core)	31.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19988; peer wrote 19988
broker_confirms_deliveries: broker sent 19988; client received 19988
no_loss: broker acknowledged 19988 from the peer; client received 19988; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
callbacks_matched: 19988 messages reached a filter callback, 0 the catch-all
broker_headroom: broker used 0.12 of its core
host_quiet: 0.28 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15996 / 15996
CPU user / sys per msg	137 µs / 20.0 µs
CPU (share of a core)	31.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
callbacks_matched: 19995 messages reached a filter callback, 0 the catch-all
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

paho 2.1.0 sync

162 µs 2/3 valid

run 1 · attempt 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 15999
schedule lag p50 / p99 / max	573 µs / 934 µs / 2,731 µs
due in window, never published	1
CPU user / sys per msg	128 µs / 33.7 µs
CPU (share of a core)	32.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 15999
schedule lag p50 / p99 / max	573 µs / 999 µs / 2,921 µs
due in window, never published	1
CPU user / sys per msg	98.1 µs / 63.1 µs
CPU (share of a core)	32.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.02 cores busy outside the client, peer and broker

run 3 · attempt 2 · invalid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 16000
schedule lag p50 / p99 / max	573 µs / 999 µs / 2,925 µs
due in window, never published	1
CPU user / sys per msg	53.7 µs / 106 µs
CPU (share of a core)	31.9 %
threads	2

host_quiet: 0.53 cores busy outside the client, peer and broker
worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core

95.7 µs

run 1 · valid

C source sent	19,980
broker received ($SYS)	19,980
broker sent ($SYS)	19,980
broker dropped ($SYS)	0
client received	19,980
in window: offered / received	15985 / 15985
CPU user / sys per msg	68.8 µs / 26.9 µs
CPU (share of a core)	19.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19980; peer wrote 19980
broker_confirms_deliveries: broker sent 19980; client received 19980
no_loss: broker acknowledged 19980 from the peer; client received 19980; broker dropped 0
offered_rate_held: peer wrote 15985 of 16000 offered in the window
client_kept_up: client received 15985 of 15985 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,984
broker received ($SYS)	19,984
broker sent ($SYS)	19,984
broker dropped ($SYS)	0
client received	19,984
in window: offered / received	15989 / 15989
CPU user / sys per msg	58.8 µs / 36.9 µs
CPU (share of a core)	19.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19984; peer wrote 19984
broker_confirms_deliveries: broker sent 19984; client received 19984
no_loss: broker acknowledged 19984 from the peer; client received 19984; broker dropped 0
offered_rate_held: peer wrote 15989 of 16000 offered in the window
client_kept_up: client received 15989 of 15989 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

C source sent	19,990
broker received ($SYS)	19,990
broker sent ($SYS)	19,990
broker dropped ($SYS)	0
client received	19,990
in window: offered / received	15993 / 15993
CPU user / sys per msg	35.0 µs / 59.4 µs
CPU (share of a core)	18.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19990; peer wrote 19990
broker_confirms_deliveries: broker sent 19990; client received 19990
no_loss: broker acknowledged 19990 from the peer; client received 19990; broker dropped 0
offered_rate_held: peer wrote 15993 of 16000 offered in the window
client_kept_up: client received 15993 of 15993 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

98.5 µs

run 1 · valid

C source sent	19,988
broker received ($SYS)	19,988
broker sent ($SYS)	19,988
broker dropped ($SYS)	0
client received	19,988
in window: offered / received	15994 / 15994
CPU user / sys per msg	81.9 µs / 14.4 µs
CPU (share of a core)	19.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19988; peer wrote 19988
broker_confirms_deliveries: broker sent 19988; client received 19988
no_loss: broker acknowledged 19988 from the peer; client received 19988; broker dropped 0
offered_rate_held: peer wrote 15994 of 16000 offered in the window
client_kept_up: client received 15994 of 15994 in the window
callbacks_matched: 19988 messages reached a filter callback, 0 the catch-all
broker_headroom: broker used 0.12 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
broker dropped ($SYS)	0
client received	19,997
in window: offered / received	15998 / 15998
CPU user / sys per msg	43.1 µs / 55.0 µs
CPU (share of a core)	19.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19997; peer wrote 19997
broker_confirms_deliveries: broker sent 19997; client received 19997
no_loss: broker acknowledged 19997 from the peer; client received 19997; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
callbacks_matched: 19997 messages reached a filter callback, 0 the catch-all
broker_headroom: broker used 0.11 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15995 / 15995
CPU user / sys per msg	61.3 µs / 37.5 µs
CPU (share of a core)	19.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
callbacks_matched: 19993 messages reached a filter callback, 0 the catch-all
broker_headroom: broker used 0.11 of its core
host_quiet: 0.50 cores busy outside the client, peer and broker

225 µs

run 1 · valid

C source sent	19,988
broker received ($SYS)	19,988
broker sent ($SYS)	19,988
broker dropped ($SYS)	0
client received	19,988
in window: offered / received	15994 / 15994
CPU user / sys per msg	81.9 µs / 14.4 µs
CPU (share of a core)	19.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19988; peer wrote 19988
broker_confirms_deliveries: broker sent 19988; client received 19988
no_loss: broker acknowledged 19988 from the peer; client received 19988; broker dropped 0
offered_rate_held: peer wrote 15994 of 16000 offered in the window
client_kept_up: client received 15994 of 15994 in the window
callbacks_matched: 19988 messages reached a filter callback, 0 the catch-all
broker_headroom: broker used 0.12 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
broker dropped ($SYS)	0
client received	19,997
in window: offered / received	15998 / 15998
CPU user / sys per msg	43.1 µs / 55.0 µs
CPU (share of a core)	19.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19997; peer wrote 19997
broker_confirms_deliveries: broker sent 19997; client received 19997
no_loss: broker acknowledged 19997 from the peer; client received 19997; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
callbacks_matched: 19997 messages reached a filter callback, 0 the catch-all
broker_headroom: broker used 0.11 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15995 / 15995
CPU user / sys per msg	61.3 µs / 37.5 µs
CPU (share of a core)	19.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
callbacks_matched: 19993 messages reached a filter callback, 0 the catch-all
broker_headroom: broker used 0.11 of its core
host_quiet: 0.50 cores busy outside the client, peer and broker

aiomqtt 2.5.1 asyncio

271 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15997 / 16002
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 2,348 µs
due in window, never published	3
CPU user / sys per msg	251 µs / 20.0 µs
CPU (share of a core)	54.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15997 of 15999 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16002 / 16000
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 4,636 µs
due in window, never published	1
CPU user / sys per msg	246 µs / 24.4 µs
CPU (share of a core)	54.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16002 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16001 / 15997
schedule lag p50 / p99 / max	1,081 µs / 2,294 µs / 2,632 µs
due in window, never published	2
CPU user / sys per msg	255 µs / 19.4 µs
CPU (share of a core)	54.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

178 µs

run 1 · attempt 2 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15995 / 15995
CPU user / sys per msg	158 µs / 19.4 µs
CPU (share of a core)	35.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.37 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15996 / 15996
CPU user / sys per msg	108 µs / 70.6 µs
CPU (share of a core)	35.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.09 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15995 / 15995
CPU user / sys per msg	144 µs / 32.5 µs
CPU (share of a core)	35.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.03 cores busy outside the client, peer and broker

unsupported

zmqtt 0.2.4 asyncio experimental

295 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 15998
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 2,361 µs
due in window, never published	1
CPU user / sys per msg	262 µs / 33.1 µs
CPU (share of a core)	59.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16001 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 16000
schedule lag p50 / p99 / max	803 µs / 1,868 µs / 3,860 µs
due in window, never published	2
CPU user / sys per msg	262 µs / 32.5 µs
CPU (share of a core)	58.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16002 / 16001
schedule lag p50 / p99 / max	868 µs / 1,868 µs / 2,225 µs
due in window, never published	1
CPU user / sys per msg	265 µs / 24.4 µs
CPU (share of a core)	58.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16002 of 16001 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

199 µs

run 1 · valid

C source sent	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
broker dropped ($SYS)	0
client received	19,998
in window: offered / received	15999 / 15999
CPU user / sys per msg	124 µs / 75.6 µs
CPU (share of a core)	39.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19998; peer wrote 19998
broker_confirms_deliveries: broker sent 19998; client received 19998
no_loss: broker acknowledged 19998 from the peer; client received 19998; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.30 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15996 / 15996
CPU user / sys per msg	181 µs / 18.1 µs
CPU (share of a core)	39.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.42 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15997 / 15997
CPU user / sys per msg	179 µs / 16.9 µs
CPU (share of a core)	39.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

unsupported

amqtt 0.12.1 asyncio

299 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 3,849 µs
due in window, never published	2
CPU user / sys per msg	268 µs / 28.1 µs
CPU (share of a core)	59.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15999
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 2,329 µs
due in window, never published	1
CPU user / sys per msg	276 µs / 22.5 µs
CPU (share of a core)	59.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16002 / 16002
schedule lag p50 / p99 / max	1,081 µs / 2,163 µs / 2,384 µs
due in window, never published	2
CPU user / sys per msg	274 µs / 26.9 µs
CPU (share of a core)	60.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16002 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

212 µs

run 1 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15996 / 15996
CPU user / sys per msg	157 µs / 55.0 µs
CPU (share of a core)	42.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.24 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15998 / 15998
CPU user / sys per msg	188 µs / 27.5 µs
CPU (share of a core)	43.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.39 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,988
broker received ($SYS)	19,988
broker sent ($SYS)	19,988
broker dropped ($SYS)	0
client received	19,988
in window: offered / received	15989 / 15989
CPU user / sys per msg	105 µs / 106 µs
CPU (share of a core)	42.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19988; peer wrote 19988
broker_confirms_deliveries: broker sent 19988; client received 19988
no_loss: broker acknowledged 19988 from the peer; client received 19988; broker dropped 0
offered_rate_held: peer wrote 15989 of 16000 offered in the window
client_kept_up: client received 15989 of 15989 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

unsupported

aiomqtt3 3.0.0a1 asyncio experimental

unsupported

Can one client publish and receive at once?

The client publishes 1,000 QoS 1 msgs/s to a C sink while a C source sends it 1,000 msgs/s. CPU is per message handled in either direction.

client

CPU / msg ↓

publish p99 ↓

receive p99 ↓

awscrt 0.37.0 crt_event_loop native

87.5 µs

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	52.2 µs / 999 µs / 1,978 µs
due in window, never published	1
CPU user / sys per msg	76.3 µs / 11.3 µs
CPU (share of a core)	17.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7999 of 8000 offered in the window
client_kept_up: client received 7999 of 7999 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,999
client received	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
schedule lag p50 / p99 / max	836 µs / 836 µs / 2,638 µs
due in window, never published	1
CPU user / sys per msg	71.2 µs / 16.9 µs
CPU (share of a core)	17.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9999 from the source; client received 9999; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	135 µs / 168 µs / 3,001 µs
due in window, never published	1
CPU user / sys per msg	75.0 µs / 11.9 µs
CPU (share of a core)	17.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

1,081 µs

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	52.2 µs / 999 µs / 1,978 µs
due in window, never published	1
CPU user / sys per msg	76.3 µs / 11.3 µs
CPU (share of a core)	17.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7999 of 8000 offered in the window
client_kept_up: client received 7999 of 7999 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,999
client received	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
schedule lag p50 / p99 / max	836 µs / 836 µs / 2,638 µs
due in window, never published	1
CPU user / sys per msg	71.2 µs / 16.9 µs
CPU (share of a core)	17.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9999 from the source; client received 9999; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	135 µs / 168 µs / 3,001 µs
due in window, never published	1
CPU user / sys per msg	75.0 µs / 11.9 µs
CPU (share of a core)	17.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

184 µs

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	52.2 µs / 999 µs / 1,978 µs
due in window, never published	1
CPU user / sys per msg	76.3 µs / 11.3 µs
CPU (share of a core)	17.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7999 of 8000 offered in the window
client_kept_up: client received 7999 of 7999 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,999
client received	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
schedule lag p50 / p99 / max	836 µs / 836 µs / 2,638 µs
due in window, never published	1
CPU user / sys per msg	71.2 µs / 16.9 µs
CPU (share of a core)	17.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9999 from the source; client received 9999; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	135 µs / 168 µs / 3,001 µs
due in window, never published	1
CPU user / sys per msg	75.0 µs / 11.9 µs
CPU (share of a core)	17.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

mqttium 1.1.0 asyncio

119 µs

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	319 µs / 516 µs / 1,724 µs
due in window, never published	1
CPU user / sys per msg	114 µs / 16.2 µs
CPU (share of a core)	26.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · attempt 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	336 µs / 1,343 µs / 3,254 µs
due in window, never published	1
CPU user / sys per msg	99.4 µs / 20.0 µs
CPU (share of a core)	23.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	418 µs / 1,409 µs / 3,270 µs
due in window, never published	1
CPU user / sys per msg	102 µs / 13.8 µs
CPU (share of a core)	23.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

135 µs

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	319 µs / 516 µs / 1,724 µs
due in window, never published	1
CPU user / sys per msg	114 µs / 16.2 µs
CPU (share of a core)	26.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · attempt 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	336 µs / 1,343 µs / 3,254 µs
due in window, never published	1
CPU user / sys per msg	99.4 µs / 20.0 µs
CPU (share of a core)	23.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	418 µs / 1,409 µs / 3,270 µs
due in window, never published	1
CPU user / sys per msg	102 µs / 13.8 µs
CPU (share of a core)	23.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

258 µs

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	319 µs / 516 µs / 1,724 µs
due in window, never published	1
CPU user / sys per msg	114 µs / 16.2 µs
CPU (share of a core)	26.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · attempt 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	336 µs / 1,343 µs / 3,254 µs
due in window, never published	1
CPU user / sys per msg	99.4 µs / 20.0 µs
CPU (share of a core)	23.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	418 µs / 1,409 µs / 3,270 µs
due in window, never published	1
CPU user / sys per msg	102 µs / 13.8 µs
CPU (share of a core)	23.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

gmqtt 0.7.0 asyncio

132 µs 2/3 valid

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,999
client received	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
schedule lag p50 / p99 / max	385 µs / 1,409 µs / 3,551 µs
due in window, never published	1
CPU user / sys per msg	45.0 µs / 85.6 µs
CPU (share of a core)	26.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9999 from the source; client received 9999; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.27 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	369 µs / 1,409 µs / 1,851 µs
due in window, never published	1
CPU user / sys per msg	59.4 µs / 74.4 µs
CPU (share of a core)	26.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8001 of 8000 offered in the window
source_rate_held: source wrote 7999 of 8000 offered in the window
client_kept_up: client received 7999 of 7999 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · attempt 2 · invalid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,996
client received	9,996
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
schedule lag p50 / p99 / max	336 µs / 1,409 µs / 2,156 µs
due in window, never published	1
CPU user / sys per msg	91.3 µs / 44.4 µs
CPU (share of a core)	27.1 %
threads	2

host_quiet: 0.69 cores busy outside the client, peer and broker
worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19995; client received 9996, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9996 from the source; client received 9996; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7999 of 8000 offered in the window
client_kept_up: client received 7999 of 7999 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core

113 µs 2/3 valid

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,999
client received	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
schedule lag p50 / p99 / max	385 µs / 1,409 µs / 3,551 µs
due in window, never published	1
CPU user / sys per msg	45.0 µs / 85.6 µs
CPU (share of a core)	26.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9999 from the source; client received 9999; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.27 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	369 µs / 1,409 µs / 1,851 µs
due in window, never published	1
CPU user / sys per msg	59.4 µs / 74.4 µs
CPU (share of a core)	26.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8001 of 8000 offered in the window
source_rate_held: source wrote 7999 of 8000 offered in the window
client_kept_up: client received 7999 of 7999 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · attempt 2 · invalid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,996
client received	9,996
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
schedule lag p50 / p99 / max	336 µs / 1,409 µs / 2,156 µs
due in window, never published	1
CPU user / sys per msg	91.3 µs / 44.4 µs
CPU (share of a core)	27.1 %
threads	2

host_quiet: 0.69 cores busy outside the client, peer and broker
worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19995; client received 9996, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9996 from the source; client received 9996; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7999 of 8000 offered in the window
client_kept_up: client received 7999 of 7999 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core

250 µs 2/3 valid

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,999
client received	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
schedule lag p50 / p99 / max	385 µs / 1,409 µs / 3,551 µs
due in window, never published	1
CPU user / sys per msg	45.0 µs / 85.6 µs
CPU (share of a core)	26.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9999 from the source; client received 9999; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.27 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	369 µs / 1,409 µs / 1,851 µs
due in window, never published	1
CPU user / sys per msg	59.4 µs / 74.4 µs
CPU (share of a core)	26.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8001 of 8000 offered in the window
source_rate_held: source wrote 7999 of 8000 offered in the window
client_kept_up: client received 7999 of 7999 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · attempt 2 · invalid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,996
client received	9,996
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
schedule lag p50 / p99 / max	336 µs / 1,409 µs / 2,156 µs
due in window, never published	1
CPU user / sys per msg	91.3 µs / 44.4 µs
CPU (share of a core)	27.1 %
threads	2

host_quiet: 0.69 cores busy outside the client, peer and broker
worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19995; client received 9996, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9996 from the source; client received 9996; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7999 of 8000 offered in the window
client_kept_up: client received 7999 of 7999 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core

paho 2.1.0 sync

149 µs

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,999
client received	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
schedule lag p50 / p99 / max	201 µs / 225 µs / 2,128 µs
due in window, never published	1
CPU user / sys per msg	119 µs / 24.4 µs
CPU (share of a core)	28.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9999 from the source; client received 9999; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,997
client received	9,997
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
schedule lag p50 / p99 / max	541 µs / 573 µs / 3,051 µs
due in window, never published	1
CPU user / sys per msg	127 µs / 21.9 µs
CPU (share of a core)	29.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19996; client received 9997, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9997 from the source; client received 9997; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,996
client received	9,996
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
schedule lag p50 / p99 / max	287 µs / 1,032 µs / 2,370 µs
due in window, never published	1
CPU user / sys per msg	121 µs / 28.8 µs
CPU (share of a core)	29.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19995; client received 9996, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9996 from the source; client received 9996; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

250 µs

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,999
client received	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
schedule lag p50 / p99 / max	201 µs / 225 µs / 2,128 µs
due in window, never published	1
CPU user / sys per msg	119 µs / 24.4 µs
CPU (share of a core)	28.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9999 from the source; client received 9999; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,997
client received	9,997
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
schedule lag p50 / p99 / max	541 µs / 573 µs / 3,051 µs
due in window, never published	1
CPU user / sys per msg	127 µs / 21.9 µs
CPU (share of a core)	29.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19996; client received 9997, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9997 from the source; client received 9997; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,996
client received	9,996
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
schedule lag p50 / p99 / max	287 µs / 1,032 µs / 2,370 µs
due in window, never published	1
CPU user / sys per msg	121 µs / 28.8 µs
CPU (share of a core)	29.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19995; client received 9996, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9996 from the source; client received 9996; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

225 µs

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,999
client received	9,999
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
schedule lag p50 / p99 / max	201 µs / 225 µs / 2,128 µs
due in window, never published	1
CPU user / sys per msg	119 µs / 24.4 µs
CPU (share of a core)	28.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19998; client received 9999, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9999 from the source; client received 9999; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 8000 of 8000 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,997
client received	9,997
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
schedule lag p50 / p99 / max	541 µs / 573 µs / 3,051 µs
due in window, never published	1
CPU user / sys per msg	127 µs / 21.9 µs
CPU (share of a core)	29.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19996; client received 9997, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9997 from the source; client received 9997; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,996
client received	9,996
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
schedule lag p50 / p99 / max	287 µs / 1,032 µs / 2,370 µs
due in window, never published	1
CPU user / sys per msg	121 µs / 28.8 µs
CPU (share of a core)	29.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19995; client received 9996, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9996 from the source; client received 9996; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

aiomqtt 2.5.1 asyncio

368 µs

run 1 · valid

client sent	9,998
client completed	9,998
C sink received	9,998
C source sent	9,997
client received	9,997
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
schedule lag p50 / p99 / max	541 µs / 1,606 µs / 5,071 µs
due in window, never published	2
CPU user / sys per msg	349 µs / 18.8 µs
CPU (share of a core)	73.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19995; client received 9997, sink received 9998
no_loss: client saw 9998 completions; peer received 9998
no_loss_inbound: broker acknowledged 9997 from the source; client received 9997; broker dropped 0
offered_rate_held: client published 7999 of 8000 offered in the window
source_rate_held: source wrote 7999 of 8000 offered in the window
client_kept_up: client received 7999 of 7999 in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.32 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,997
client completed	9,997
C sink received	9,997
C source sent	9,998
client received	9,998
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
schedule lag p50 / p99 / max	516 µs / 1,540 µs / 4,848 µs
due in window, never published	3
CPU user / sys per msg	284 µs / 84.4 µs
CPU (share of a core)	73.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9997 from the client; client sent 9997, completed 9997
broker_confirms_deliveries: broker sent 19995; client received 9998, sink received 9997
no_loss: client saw 9997 completions; peer received 9997
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 7998 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 7999 of 8000 in the window
payloads_intact: 0 of 9997 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,996
client completed	9,996
C sink received	9,996
C source sent	9,997
client received	9,997
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
schedule lag p50 / p99 / max	672 µs / 1,671 µs / 5,032 µs
due in window, never published	4
CPU user / sys per msg	288 µs / 12.5 µs
CPU (share of a core)	60.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9996 from the client; client sent 9996, completed 9996
broker_confirms_deliveries: broker sent 19993; client received 9997, sink received 9996
no_loss: client saw 9996 completions; peer received 9996
no_loss_inbound: broker acknowledged 9997 from the source; client received 9997; broker dropped 0
offered_rate_held: client published 7997 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.08 cores busy outside the client, peer and broker

999 µs

run 1 · valid

client sent	9,998
client completed	9,998
C sink received	9,998
C source sent	9,997
client received	9,997
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
schedule lag p50 / p99 / max	541 µs / 1,606 µs / 5,071 µs
due in window, never published	2
CPU user / sys per msg	349 µs / 18.8 µs
CPU (share of a core)	73.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19995; client received 9997, sink received 9998
no_loss: client saw 9998 completions; peer received 9998
no_loss_inbound: broker acknowledged 9997 from the source; client received 9997; broker dropped 0
offered_rate_held: client published 7999 of 8000 offered in the window
source_rate_held: source wrote 7999 of 8000 offered in the window
client_kept_up: client received 7999 of 7999 in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.32 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,997
client completed	9,997
C sink received	9,997
C source sent	9,998
client received	9,998
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
schedule lag p50 / p99 / max	516 µs / 1,540 µs / 4,848 µs
due in window, never published	3
CPU user / sys per msg	284 µs / 84.4 µs
CPU (share of a core)	73.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9997 from the client; client sent 9997, completed 9997
broker_confirms_deliveries: broker sent 19995; client received 9998, sink received 9997
no_loss: client saw 9997 completions; peer received 9997
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 7998 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 7999 of 8000 in the window
payloads_intact: 0 of 9997 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,996
client completed	9,996
C sink received	9,996
C source sent	9,997
client received	9,997
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
schedule lag p50 / p99 / max	672 µs / 1,671 µs / 5,032 µs
due in window, never published	4
CPU user / sys per msg	288 µs / 12.5 µs
CPU (share of a core)	60.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9996 from the client; client sent 9996, completed 9996
broker_confirms_deliveries: broker sent 19993; client received 9997, sink received 9996
no_loss: client saw 9996 completions; peer received 9996
no_loss_inbound: broker acknowledged 9997 from the source; client received 9997; broker dropped 0
offered_rate_held: client published 7997 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.08 cores busy outside the client, peer and broker

1,999 µs

run 1 · valid

client sent	9,998
client completed	9,998
C sink received	9,998
C source sent	9,997
client received	9,997
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
schedule lag p50 / p99 / max	541 µs / 1,606 µs / 5,071 µs
due in window, never published	2
CPU user / sys per msg	349 µs / 18.8 µs
CPU (share of a core)	73.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19995; client received 9997, sink received 9998
no_loss: client saw 9998 completions; peer received 9998
no_loss_inbound: broker acknowledged 9997 from the source; client received 9997; broker dropped 0
offered_rate_held: client published 7999 of 8000 offered in the window
source_rate_held: source wrote 7999 of 8000 offered in the window
client_kept_up: client received 7999 of 7999 in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.32 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,997
client completed	9,997
C sink received	9,997
C source sent	9,998
client received	9,998
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
schedule lag p50 / p99 / max	516 µs / 1,540 µs / 4,848 µs
due in window, never published	3
CPU user / sys per msg	284 µs / 84.4 µs
CPU (share of a core)	73.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9997 from the client; client sent 9997, completed 9997
broker_confirms_deliveries: broker sent 19995; client received 9998, sink received 9997
no_loss: client saw 9997 completions; peer received 9997
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 7998 of 8000 offered in the window
source_rate_held: source wrote 8000 of 8000 offered in the window
client_kept_up: client received 7999 of 8000 in the window
payloads_intact: 0 of 9997 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,996
client completed	9,996
C sink received	9,996
C source sent	9,997
client received	9,997
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
schedule lag p50 / p99 / max	672 µs / 1,671 µs / 5,032 µs
due in window, never published	4
CPU user / sys per msg	288 µs / 12.5 µs
CPU (share of a core)	60.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9996 from the client; client sent 9996, completed 9996
broker_confirms_deliveries: broker sent 19993; client received 9997, sink received 9996
no_loss: client saw 9996 completions; peer received 9996
no_loss_inbound: broker acknowledged 9997 from the source; client received 9997; broker dropped 0
offered_rate_held: client published 7997 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9996 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.08 cores busy outside the client, peer and broker

zmqtt 0.2.4 asyncio experimental

370 µs

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,997
client received	9,997
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
schedule lag p50 / p99 / max	606 µs / 1,540 µs / 1,581 µs
due in window, never published	1
CPU user / sys per msg	318 µs / 57.5 µs
CPU (share of a core)	75.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19996; client received 9997, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9997 from the source; client received 9997; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.43 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,997
client received	9,997
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
schedule lag p50 / p99 / max	606 µs / 1,540 µs / 2,773 µs
due in window, never published	1
CPU user / sys per msg	296 µs / 35.0 µs
CPU (share of a core)	66.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19996; client received 9997, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9997 from the source; client received 9997; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	541 µs / 1,671 µs / 3,480 µs
due in window, never published	1
CPU user / sys per msg	159 µs / 211 µs
CPU (share of a core)	74.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7999 of 8000 offered in the window
client_kept_up: client received 7999 of 7999 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.08 cores busy outside the client, peer and broker

129 µs

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,997
client received	9,997
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
schedule lag p50 / p99 / max	606 µs / 1,540 µs / 1,581 µs
due in window, never published	1
CPU user / sys per msg	318 µs / 57.5 µs
CPU (share of a core)	75.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19996; client received 9997, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9997 from the source; client received 9997; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.43 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,997
client received	9,997
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
schedule lag p50 / p99 / max	606 µs / 1,540 µs / 2,773 µs
due in window, never published	1
CPU user / sys per msg	296 µs / 35.0 µs
CPU (share of a core)	66.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19996; client received 9997, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9997 from the source; client received 9997; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	541 µs / 1,671 µs / 3,480 µs
due in window, never published	1
CPU user / sys per msg	159 µs / 211 µs
CPU (share of a core)	74.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7999 of 8000 offered in the window
client_kept_up: client received 7999 of 7999 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.08 cores busy outside the client, peer and broker

3,736 µs

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,997
client received	9,997
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
schedule lag p50 / p99 / max	606 µs / 1,540 µs / 1,581 µs
due in window, never published	1
CPU user / sys per msg	318 µs / 57.5 µs
CPU (share of a core)	75.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19996; client received 9997, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9997 from the source; client received 9997; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.43 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,997
client received	9,997
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
schedule lag p50 / p99 / max	606 µs / 1,540 µs / 2,773 µs
due in window, never published	1
CPU user / sys per msg	296 µs / 35.0 µs
CPU (share of a core)	66.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19996; client received 9997, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9997 from the source; client received 9997; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,998
client received	9,998
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
schedule lag p50 / p99 / max	541 µs / 1,671 µs / 3,480 µs
due in window, never published	1
CPU user / sys per msg	159 µs / 211 µs
CPU (share of a core)	74.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19997; client received 9998, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9998 from the source; client received 9998; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7999 of 8000 offered in the window
client_kept_up: client received 7999 of 7999 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.08 cores busy outside the client, peer and broker

amqtt 0.12.1 asyncio

389 µs

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,995
client received	9,995
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
schedule lag p50 / p99 / max	541 µs / 1,540 µs / 2,496 µs
due in window, never published	1
CPU user / sys per msg	357 µs / 41.9 µs
CPU (share of a core)	79.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19994; client received 9995, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9995 from the source; client received 9995; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7996 of 8000 offered in the window
client_kept_up: client received 7996 of 7996 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,998
client completed	9,998
C sink received	9,998
C source sent	9,996
client received	9,996
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
schedule lag p50 / p99 / max	573 µs / 1,671 µs / 2,883 µs
due in window, never published	2
CPU user / sys per msg	337 µs / 43.1 µs
CPU (share of a core)	76.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19994; client received 9996, sink received 9998
no_loss: client saw 9998 completions; peer received 9998
no_loss_inbound: broker acknowledged 9996 from the source; client received 9996; broker dropped 0
offered_rate_held: client published 7999 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.30 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,996
client received	9,996
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
schedule lag p50 / p99 / max	573 µs / 1,606 µs / 1,906 µs
due in window, never published	1
CPU user / sys per msg	356 µs / 33.1 µs
CPU (share of a core)	77.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19995; client received 9996, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9996 from the source; client received 9996; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7997 of 8000 offered in the window
client_kept_up: client received 7997 of 7997 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.34 cores busy outside the client, peer and broker

135 µs

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,995
client received	9,995
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
schedule lag p50 / p99 / max	541 µs / 1,540 µs / 2,496 µs
due in window, never published	1
CPU user / sys per msg	357 µs / 41.9 µs
CPU (share of a core)	79.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19994; client received 9995, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9995 from the source; client received 9995; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7996 of 8000 offered in the window
client_kept_up: client received 7996 of 7996 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,998
client completed	9,998
C sink received	9,998
C source sent	9,996
client received	9,996
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
schedule lag p50 / p99 / max	573 µs / 1,671 µs / 2,883 µs
due in window, never published	2
CPU user / sys per msg	337 µs / 43.1 µs
CPU (share of a core)	76.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19994; client received 9996, sink received 9998
no_loss: client saw 9998 completions; peer received 9998
no_loss_inbound: broker acknowledged 9996 from the source; client received 9996; broker dropped 0
offered_rate_held: client published 7999 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.30 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,996
client received	9,996
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
schedule lag p50 / p99 / max	573 µs / 1,606 µs / 1,906 µs
due in window, never published	1
CPU user / sys per msg	356 µs / 33.1 µs
CPU (share of a core)	77.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19995; client received 9996, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9996 from the source; client received 9996; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7997 of 8000 offered in the window
client_kept_up: client received 7997 of 7997 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.34 cores busy outside the client, peer and broker

1,540 µs

run 1 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,995
client received	9,995
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
schedule lag p50 / p99 / max	541 µs / 1,540 µs / 2,496 µs
due in window, never published	1
CPU user / sys per msg	357 µs / 41.9 µs
CPU (share of a core)	79.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19994; client received 9995, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9995 from the source; client received 9995; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7996 of 8000 offered in the window
client_kept_up: client received 7996 of 7996 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	9,998
client completed	9,998
C sink received	9,998
C source sent	9,996
client received	9,996
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
schedule lag p50 / p99 / max	573 µs / 1,671 µs / 2,883 µs
due in window, never published	2
CPU user / sys per msg	337 µs / 43.1 µs
CPU (share of a core)	76.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9998 from the client; client sent 9998, completed 9998
broker_confirms_deliveries: broker sent 19994; client received 9996, sink received 9998
no_loss: client saw 9998 completions; peer received 9998
no_loss_inbound: broker acknowledged 9996 from the source; client received 9996; broker dropped 0
offered_rate_held: client published 7999 of 8000 offered in the window
source_rate_held: source wrote 7998 of 8000 offered in the window
client_kept_up: client received 7998 of 7998 in the window
payloads_intact: 0 of 9998 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.30 cores busy outside the client, peer and broker

run 3 · valid

client sent	9,999
client completed	9,999
C sink received	9,999
C source sent	9,996
client received	9,996
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
schedule lag p50 / p99 / max	573 µs / 1,606 µs / 1,906 µs
due in window, never published	1
CPU user / sys per msg	356 µs / 33.1 µs
CPU (share of a core)	77.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
source_completed: source reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 9999 from the client; client sent 9999, completed 9999
broker_confirms_deliveries: broker sent 19995; client received 9996, sink received 9999
no_loss: client saw 9999 completions; peer received 9999
no_loss_inbound: broker acknowledged 9996 from the source; client received 9996; broker dropped 0
offered_rate_held: client published 8000 of 8000 offered in the window
source_rate_held: source wrote 7997 of 8000 offered in the window
client_kept_up: client received 7997 of 7997 in the window
payloads_intact: 0 of 9999 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.34 cores busy outside the client, peer and broker

aiomqtt3 3.0.0a1 asyncio experimental

unsupported

What does TLS cost?

The same 2,000 QoS 1 msgs/s over a TLS listener (the C peer stays on plain TCP), and the connect including the handshake.

client

publish CPU / msg ↓

receive CPU / msg ↓

publish p99 ↓

connect ↓

awscrt 0.37.0 crt_event_loop native

108 µs

run 1 · attempt 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 16000
schedule lag p50 / p99 / max	541 µs / 967 µs / 1,915 µs
due in window, never published	2
CPU user / sys per msg	71.3 µs / 36.9 µs
CPU (share of a core)	21.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	541 µs / 770 µs / 3,202 µs
due in window, never published	2
CPU user / sys per msg	90.0 µs / 16.9 µs
CPU (share of a core)	21.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	15999 / 16000
schedule lag p50 / p99 / max	500 µs / 836 µs / 2,250 µs
due in window, never published	1
CPU user / sys per msg	55.6 µs / 56.9 µs
CPU (share of a core)	22.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.13 of its core
host_quiet: 0.43 cores busy outside the client, peer and broker

52.5 µs

run 1 · attempt 2 · valid

C source sent	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
broker dropped ($SYS)	0
client received	19,997
in window: offered / received	15999 / 15999
CPU user / sys per msg	45.0 µs / 8.1 µs
CPU (share of a core)	10.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19997; peer wrote 19997
broker_confirms_deliveries: broker sent 19997; client received 19997
no_loss: broker acknowledged 19997 from the peer; client received 19997; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.14 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15997 / 15997
CPU user / sys per msg	32.5 µs / 20.0 µs
CPU (share of a core)	10.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.14 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,984
broker received ($SYS)	19,984
broker sent ($SYS)	19,984
broker dropped ($SYS)	0
client received	19,984
in window: offered / received	15986 / 15986
CPU user / sys per msg	45.7 µs / 6.9 µs
CPU (share of a core)	10.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19984; peer wrote 19984
broker_confirms_deliveries: broker sent 19984; client received 19984
no_loss: broker acknowledged 19984 from the peer; client received 19984; broker dropped 0
offered_rate_held: peer wrote 15986 of 16000 offered in the window
client_kept_up: client received 15986 of 15986 in the window
broker_headroom: broker used 0.14 of its core
host_quiet: 0.08 cores busy outside the client, peer and broker

233 µs

run 1 · attempt 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 16000
schedule lag p50 / p99 / max	541 µs / 967 µs / 1,915 µs
due in window, never published	2
CPU user / sys per msg	71.3 µs / 36.9 µs
CPU (share of a core)	21.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	541 µs / 770 µs / 3,202 µs
due in window, never published	2
CPU user / sys per msg	90.0 µs / 16.9 µs
CPU (share of a core)	21.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	15999 / 16000
schedule lag p50 / p99 / max	500 µs / 836 µs / 2,250 µs
due in window, never published	1
CPU user / sys per msg	55.6 µs / 56.9 µs
CPU (share of a core)	22.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.13 of its core
host_quiet: 0.43 cores busy outside the client, peer and broker

105.4 ms

run 1 · valid

connect	111.0 ms
CPU (share of a core)	0.0 %
threads	4

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

connect	105.4 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

connect	105.0 ms
CPU (share of a core)	0.0 %
threads	4

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

gmqtt 0.7.0 asyncio

145 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16002 / 16000
schedule lag p50 / p99 / max	737 µs / 1,475 µs / 2,421 µs
due in window, never published	1
CPU user / sys per msg	126 µs / 22.5 µs
CPU (share of a core)	29.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16002 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	672 µs / 1,409 µs / 2,706 µs
due in window, never published	3
CPU user / sys per msg	117 µs / 21.9 µs
CPU (share of a core)	27.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.13 of its core
host_quiet: 0.23 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	705 µs / 1,475 µs / 2,697 µs
due in window, never published	2
CPU user / sys per msg	120 µs / 25.0 µs
CPU (share of a core)	29.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.13 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

100 µs

run 1 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15996 / 15996
CPU user / sys per msg	85.0 µs / 15.0 µs
CPU (share of a core)	20.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.15 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 2 · attempt 2 · valid

C source sent	19,990
broker received ($SYS)	19,990
broker sent ($SYS)	19,990
broker dropped ($SYS)	0
client received	19,990
in window: offered / received	15992 / 15992
CPU user / sys per msg	85.0 µs / 15.0 µs
CPU (share of a core)	20.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19990; peer wrote 19990
broker_confirms_deliveries: broker sent 19990; client received 19990
no_loss: broker acknowledged 19990 from the peer; client received 19990; broker dropped 0
offered_rate_held: peer wrote 15992 of 16000 offered in the window
client_kept_up: client received 15992 of 15992 in the window
broker_headroom: broker used 0.14 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15998 / 15998
CPU user / sys per msg	46.3 µs / 55.6 µs
CPU (share of a core)	20.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
broker_headroom: broker used 0.14 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

201 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16002 / 16000
schedule lag p50 / p99 / max	737 µs / 1,475 µs / 2,421 µs
due in window, never published	1
CPU user / sys per msg	126 µs / 22.5 µs
CPU (share of a core)	29.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16002 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	672 µs / 1,409 µs / 2,706 µs
due in window, never published	3
CPU user / sys per msg	117 µs / 21.9 µs
CPU (share of a core)	27.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.13 of its core
host_quiet: 0.23 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	705 µs / 1,475 µs / 2,697 µs
due in window, never published	2
CPU user / sys per msg	120 µs / 25.0 µs
CPU (share of a core)	29.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.13 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

5.3 ms

run 1 · valid

connect	5.5 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

connect	4.9 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

connect	5.3 ms
CPU (share of a core)	0.1 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

mqttium 1.1.0 asyncio

173 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15998 / 16002
schedule lag p50 / p99 / max	770 µs / 1,540 µs / 3,264 µs
due in window, never published	2
CPU user / sys per msg	154 µs / 19.4 µs
CPU (share of a core)	34.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	737 µs / 1,540 µs / 3,984 µs
due in window, never published	2
CPU user / sys per msg	148 µs / 21.3 µs
CPU (share of a core)	33.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	737 µs / 1,540 µs / 1,962 µs
due in window, never published	2
CPU user / sys per msg	155 µs / 18.8 µs
CPU (share of a core)	34.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

126 µs

run 1 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15996 / 15996
CPU user / sys per msg	76.9 µs / 52.5 µs
CPU (share of a core)	25.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.15 of its core
host_quiet: 0.45 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,982
broker received ($SYS)	19,982
broker sent ($SYS)	19,982
broker dropped ($SYS)	0
client received	19,982
in window: offered / received	15987 / 15987
CPU user / sys per msg	101 µs / 23.1 µs
CPU (share of a core)	24.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19982; peer wrote 19982
broker_confirms_deliveries: broker sent 19982; client received 19982
no_loss: broker acknowledged 19982 from the peer; client received 19982; broker dropped 0
offered_rate_held: peer wrote 15987 of 16000 offered in the window
client_kept_up: client received 15987 of 15987 in the window
broker_headroom: broker used 0.15 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15993 / 15993
CPU user / sys per msg	121 µs / 5.0 µs
CPU (share of a core)	25.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15993 of 16000 offered in the window
client_kept_up: client received 15993 of 15993 in the window
broker_headroom: broker used 0.15 of its core
host_quiet: 0.41 cores busy outside the client, peer and broker

287 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15998 / 16002
schedule lag p50 / p99 / max	770 µs / 1,540 µs / 3,264 µs
due in window, never published	2
CPU user / sys per msg	154 µs / 19.4 µs
CPU (share of a core)	34.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	737 µs / 1,540 µs / 3,984 µs
due in window, never published	2
CPU user / sys per msg	148 µs / 21.3 µs
CPU (share of a core)	33.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	737 µs / 1,540 µs / 1,962 µs
due in window, never published	2
CPU user / sys per msg	155 µs / 18.8 µs
CPU (share of a core)	34.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

7.3 ms

run 1 · valid

connect	7.3 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

connect	9.7 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

connect	7.3 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

paho 2.1.0 sync

177 µs

run 1 · attempt 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 15999
schedule lag p50 / p99 / max	573 µs / 934 µs / 2,801 µs
due in window, never published	1
CPU user / sys per msg	152 µs / 25.0 µs
CPU (share of a core)	35.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 15999
schedule lag p50 / p99 / max	573 µs / 836 µs / 2,117 µs
due in window, never published	1
CPU user / sys per msg	0.0 µs / 177 µs
CPU (share of a core)	35.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	541 µs / 606 µs / 2,020 µs
due in window, never published	1
CPU user / sys per msg	147 µs / 30.0 µs
CPU (share of a core)	35.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

111 µs

run 1 · valid

C source sent	19,982
broker received ($SYS)	19,982
broker sent ($SYS)	19,982
broker dropped ($SYS)	0
client received	19,982
in window: offered / received	15989 / 15989
CPU user / sys per msg	46.3 µs / 65.0 µs
CPU (share of a core)	22.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19982; peer wrote 19982
broker_confirms_deliveries: broker sent 19982; client received 19982
no_loss: broker acknowledged 19982 from the peer; client received 19982; broker dropped 0
offered_rate_held: peer wrote 15989 of 16000 offered in the window
client_kept_up: client received 15989 of 15989 in the window
broker_headroom: broker used 0.15 of its core
host_quiet: 0.03 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,977
broker received ($SYS)	19,977
broker sent ($SYS)	19,977
broker dropped ($SYS)	0
client received	19,977
in window: offered / received	15981 / 15981
CPU user / sys per msg	78.8 µs / 30.0 µs
CPU (share of a core)	21.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19977; peer wrote 19977
broker_confirms_deliveries: broker sent 19977; client received 19977
no_loss: broker acknowledged 19977 from the peer; client received 19977; broker dropped 0
offered_rate_held: peer wrote 15981 of 16000 offered in the window
client_kept_up: client received 15981 of 15981 in the window
broker_headroom: broker used 0.14 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15998 / 15998
CPU user / sys per msg	85.0 µs / 25.6 µs
CPU (share of a core)	22.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
broker_headroom: broker used 0.14 of its core
host_quiet: 0.24 cores busy outside the client, peer and broker

270 µs

run 1 · attempt 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 15999
schedule lag p50 / p99 / max	573 µs / 934 µs / 2,801 µs
due in window, never published	1
CPU user / sys per msg	152 µs / 25.0 µs
CPU (share of a core)	35.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 15999
schedule lag p50 / p99 / max	573 µs / 836 µs / 2,117 µs
due in window, never published	1
CPU user / sys per msg	0.0 µs / 177 µs
CPU (share of a core)	35.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	541 µs / 606 µs / 2,020 µs
due in window, never published	1
CPU user / sys per msg	147 µs / 30.0 µs
CPU (share of a core)	35.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

4.6 ms

run 1 · valid

connect	4.5 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

connect	4.6 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

connect	5.1 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

zmqtt 0.2.4 asyncio experimental

280 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15999
schedule lag p50 / p99 / max	868 µs / 1,933 µs / 2,344 µs
due in window, never published	1
CPU user / sys per msg	262 µs / 20.6 µs
CPU (share of a core)	56.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	901 µs / 1,868 µs / 3,038 µs
due in window, never published	1
CPU user / sys per msg	262 µs / 13.7 µs
CPU (share of a core)	55.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	868 µs / 1,868 µs / 2,163 µs
due in window, never published	2
CPU user / sys per msg	252 µs / 27.5 µs
CPU (share of a core)	56.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.24 cores busy outside the client, peer and broker

199 µs

run 1 · valid

C source sent	19,991
broker received ($SYS)	19,991
broker sent ($SYS)	19,991
broker dropped ($SYS)	0
client received	19,991
in window: offered / received	15995 / 15995
CPU user / sys per msg	182 µs / 16.9 µs
CPU (share of a core)	39.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19991; peer wrote 19991
broker_confirms_deliveries: broker sent 19991; client received 19991
no_loss: broker acknowledged 19991 from the peer; client received 19991; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.14 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,986
broker received ($SYS)	19,986
broker sent ($SYS)	19,986
broker dropped ($SYS)	0
client received	19,986
in window: offered / received	15990 / 15990
CPU user / sys per msg	176 µs / 23.8 µs
CPU (share of a core)	39.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19986; peer wrote 19986
broker_confirms_deliveries: broker sent 19986; client received 19986
no_loss: broker acknowledged 19986 from the peer; client received 19986; broker dropped 0
offered_rate_held: peer wrote 15990 of 16000 offered in the window
client_kept_up: client received 15990 of 15990 in the window
broker_headroom: broker used 0.14 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,986
broker received ($SYS)	19,986
broker sent ($SYS)	19,986
broker dropped ($SYS)	0
client received	19,986
in window: offered / received	15992 / 15992
CPU user / sys per msg	170 µs / 31.3 µs
CPU (share of a core)	40.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19986; peer wrote 19986
broker_confirms_deliveries: broker sent 19986; client received 19986
no_loss: broker acknowledged 19986 from the peer; client received 19986; broker dropped 0
offered_rate_held: peer wrote 15992 of 16000 offered in the window
client_kept_up: client received 15992 of 15992 in the window
broker_headroom: broker used 0.15 of its core
host_quiet: 0.45 cores busy outside the client, peer and broker

168 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15999
schedule lag p50 / p99 / max	868 µs / 1,933 µs / 2,344 µs
due in window, never published	1
CPU user / sys per msg	262 µs / 20.6 µs
CPU (share of a core)	56.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	901 µs / 1,868 µs / 3,038 µs
due in window, never published	1
CPU user / sys per msg	262 µs / 13.7 µs
CPU (share of a core)	55.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	868 µs / 1,868 µs / 2,163 µs
due in window, never published	2
CPU user / sys per msg	252 µs / 27.5 µs
CPU (share of a core)	56.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.24 cores busy outside the client, peer and broker

7.6 ms

run 1 · valid

connect	7.5 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

connect	7.7 ms
CPU (share of a core)	0.1 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

connect	7.6 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

amqtt 0.12.1 asyncio

317 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16001 / 16002
schedule lag p50 / p99 / max	1,032 µs / 2,163 µs / 2,281 µs
due in window, never published	2
CPU user / sys per msg	296 µs / 20.0 µs
CPU (share of a core)	63.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16001
schedule lag p50 / p99 / max	1,032 µs / 2,163 µs / 2,465 µs
due in window, never published	3
CPU user / sys per msg	301 µs / 18.1 µs
CPU (share of a core)	63.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	1,032 µs / 2,163 µs / 2,527 µs
due in window, never published	2
CPU user / sys per msg	299 µs / 18.1 µs
CPU (share of a core)	63.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16002 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

214 µs

run 1 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15998 / 15998
CPU user / sys per msg	177 µs / 35.6 µs
CPU (share of a core)	42.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
broker_headroom: broker used 0.14 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,991
broker received ($SYS)	19,991
broker sent ($SYS)	19,991
broker dropped ($SYS)	0
client received	19,991
in window: offered / received	15995 / 15995
CPU user / sys per msg	169 µs / 46.9 µs
CPU (share of a core)	43.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19991; peer wrote 19991
broker_confirms_deliveries: broker sent 19991; client received 19991
no_loss: broker acknowledged 19991 from the peer; client received 19991; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.14 of its core
host_quiet: 0.26 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,988
broker received ($SYS)	19,988
broker sent ($SYS)	19,988
broker dropped ($SYS)	0
client received	19,988
in window: offered / received	15992 / 15992
CPU user / sys per msg	131 µs / 83.8 µs
CPU (share of a core)	42.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19988; peer wrote 19988
broker_confirms_deliveries: broker sent 19988; client received 19988
no_loss: broker acknowledged 19988 from the peer; client received 19988; broker dropped 0
offered_rate_held: peer wrote 15992 of 16000 offered in the window
client_kept_up: client received 15992 of 15992 in the window
broker_headroom: broker used 0.14 of its core
host_quiet: 0.31 cores busy outside the client, peer and broker

168 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16001 / 16002
schedule lag p50 / p99 / max	1,032 µs / 2,163 µs / 2,281 µs
due in window, never published	2
CPU user / sys per msg	296 µs / 20.0 µs
CPU (share of a core)	63.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16001
schedule lag p50 / p99 / max	1,032 µs / 2,163 µs / 2,465 µs
due in window, never published	3
CPU user / sys per msg	301 µs / 18.1 µs
CPU (share of a core)	63.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	1,032 µs / 2,163 µs / 2,527 µs
due in window, never published	2
CPU user / sys per msg	299 µs / 18.1 µs
CPU (share of a core)	63.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16002 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

7.4 ms

run 1 · valid

connect	7.4 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

connect	7.4 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

connect	7.3 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

aiomqtt 2.5.1 asyncio

321 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 15999
schedule lag p50 / p99 / max	967 µs / 2,163 µs / 2,302 µs
due in window, never published	1
CPU user / sys per msg	293 µs / 29.4 µs
CPU (share of a core)	64.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	15999 / 16002
schedule lag p50 / p99 / max	934 µs / 2,163 µs / 2,273 µs
due in window, never published	1
CPU user / sys per msg	296 µs / 24.4 µs
CPU (share of a core)	64.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 15999 of 15999 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	967 µs / 2,163 µs / 3,643 µs
due in window, never published	3
CPU user / sys per msg	294 µs / 24.4 µs
CPU (share of a core)	63.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

196 µs

run 1 · valid

C source sent	19,990
broker received ($SYS)	19,990
broker sent ($SYS)	19,990
broker dropped ($SYS)	0
client received	19,990
in window: offered / received	15997 / 15997
CPU user / sys per msg	156 µs / 40.6 µs
CPU (share of a core)	39.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19990; peer wrote 19990
broker_confirms_deliveries: broker sent 19990; client received 19990
no_loss: broker acknowledged 19990 from the peer; client received 19990; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.15 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,986
broker received ($SYS)	19,986
broker sent ($SYS)	19,986
broker dropped ($SYS)	0
client received	19,986
in window: offered / received	15991 / 15991
CPU user / sys per msg	169 µs / 26.9 µs
CPU (share of a core)	39.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19986; peer wrote 19986
broker_confirms_deliveries: broker sent 19986; client received 19986
no_loss: broker acknowledged 19986 from the peer; client received 19986; broker dropped 0
offered_rate_held: peer wrote 15991 of 16000 offered in the window
client_kept_up: client received 15991 of 15991 in the window
broker_headroom: broker used 0.14 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15995 / 15995
CPU user / sys per msg	144 µs / 54.4 µs
CPU (share of a core)	39.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.14 of its core
host_quiet: 0.32 cores busy outside the client, peer and broker

1,343 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 15999
schedule lag p50 / p99 / max	967 µs / 2,163 µs / 2,302 µs
due in window, never published	1
CPU user / sys per msg	293 µs / 29.4 µs
CPU (share of a core)	64.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	15999 / 16002
schedule lag p50 / p99 / max	934 µs / 2,163 µs / 2,273 µs
due in window, never published	1
CPU user / sys per msg	296 µs / 24.4 µs
CPU (share of a core)	64.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 15999 of 15999 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	967 µs / 2,163 µs / 3,643 µs
due in window, never published	3
CPU user / sys per msg	294 µs / 24.4 µs
CPU (share of a core)	63.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

8.2 ms

run 1 · valid

connect	7.9 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

connect	8.2 ms
CPU (share of a core)	0.0 %
threads	2

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

connect	8.5 ms
CPU (share of a core)	0.0 %
threads	3

worker_completed: worker reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_headroom: broker used 0.00 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

aiomqtt3 3.0.0a1 asyncio experimental

unsupported

What do MQTT 5 features cost?

Four PUBLISH properties on every message, a 200-byte topic replaced by a topic alias (broker byte counters confirm it), and receive capacity when the client allows only 16 unacknowledged deliveries.

client

publish, properties
CPU / msg ↓

receive, properties
CPU / msg ↓

publish, alias
CPU / msg ↓

receive capacity
msgs/s ↑

receive, Receive Maximum 16
msgs/s ↑

awscrt 0.37.0 crt_event_loop native

118 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16002
schedule lag p50 / p99 / max	541 µs / 967 µs / 2,038 µs
due in window, never published	1
CPU user / sys per msg	106 µs / 11.9 µs
CPU (share of a core)	23.5 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
properties_delivered: 19999 of 19999 messages carried user properties
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	15999 / 16001
schedule lag p50 / p99 / max	541 µs / 639 µs / 2,064 µs
due in window, never published	1
CPU user / sys per msg	73.8 µs / 45.0 µs
CPU (share of a core)	23.8 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
properties_delivered: 19999 of 19999 messages carried user properties
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	573 µs / 737 µs / 2,629 µs
due in window, never published	2
CPU user / sys per msg	82.5 µs / 35.0 µs
CPU (share of a core)	23.5 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
properties_delivered: 19998 of 19998 messages carried user properties
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

68.8 µs

run 1 · valid

C source sent	19,989
broker received ($SYS)	19,989
broker sent ($SYS)	19,989
broker dropped ($SYS)	0
client received	19,989
in window: offered / received	15992 / 15992
CPU user / sys per msg	21.3 µs / 46.9 µs
CPU (share of a core)	13.6 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19989; peer wrote 19989
broker_confirms_deliveries: broker sent 19989; client received 19989
no_loss: broker acknowledged 19989 from the peer; client received 19989; broker dropped 0
offered_rate_held: peer wrote 15992 of 16000 offered in the window
client_kept_up: client received 15992 of 15992 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,990
broker received ($SYS)	19,990
broker sent ($SYS)	19,990
broker dropped ($SYS)	0
client received	19,990
in window: offered / received	15992 / 15992
CPU user / sys per msg	15.0 µs / 53.8 µs
CPU (share of a core)	13.8 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19990; peer wrote 19990
broker_confirms_deliveries: broker sent 19990; client received 19990
no_loss: broker acknowledged 19990 from the peer; client received 19990; broker dropped 0
offered_rate_held: peer wrote 15992 of 16000 offered in the window
client_kept_up: client received 15992 of 15992 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,989
broker received ($SYS)	19,989
broker sent ($SYS)	19,989
broker dropped ($SYS)	0
client received	19,989
in window: offered / received	15994 / 15994
CPU user / sys per msg	28.1 µs / 40.6 µs
CPU (share of a core)	13.7 %
threads	6

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19989; peer wrote 19989
broker_confirms_deliveries: broker sent 19989; client received 19989
no_loss: broker acknowledged 19989 from the peer; client received 19989; broker dropped 0
offered_rate_held: peer wrote 15994 of 16000 offered in the window
client_kept_up: client received 15994 of 15994 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.38 cores busy outside the client, peer and broker

unsupported

≥ 37,070broker boundbroker queue overflow

run 1 · valid broker queue overflowbroker bound

C source sent	532,293
broker received ($SYS)	532,293
broker sent ($SYS)	386,291
broker dropped ($SYS)	146,002
client received	386,291
in window: offered / received	425591 / 296612
CPU user / sys per msg	17.5 µs / 9.2 µs
CPU (share of a core)	99.0 %
threads	7

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 532293; peer wrote 532293
broker_confirms_deliveries: broker sent 386291; client received 386291 by t_stop
host_quiet: 0.14 cores busy outside the client, peer and broker

run 2 · valid broker queue overflowbroker bound

C source sent	540,979
broker received ($SYS)	540,979
broker sent ($SYS)	385,433
broker dropped ($SYS)	155,546
client received	385,433
in window: offered / received	434556 / 296000
CPU user / sys per msg	17.1 µs / 9.7 µs
CPU (share of a core)	99.1 %
threads	7

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 540979; peer wrote 540979
broker_confirms_deliveries: broker sent 385433; client received 385433 by t_stop
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid broker queue overflowbroker bound

C source sent	533,794
broker received ($SYS)	533,794
broker sent ($SYS)	393,894
broker dropped ($SYS)	139,900
client received	393,894
in window: offered / received	427318 / 303000
CPU user / sys per msg	16.9 µs / 9.2 µs
CPU (share of a core)	99.1 %
threads	7

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 533794; peer wrote 533794
broker_confirms_deliveries: broker sent 393894; client received 393894 by t_stop
host_quiet: 0.14 cores busy outside the client, peer and broker

unsupported

gmqtt 0.7.0 asyncio

136 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	672 µs / 1,409 µs / 4,239 µs
due in window, never published	2
CPU user / sys per msg	105 µs / 33.1 µs
CPU (share of a core)	27.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
properties_delivered: 19998 of 19998 messages carried user properties
broker_headroom: broker used 0.10 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	705 µs / 1,409 µs / 3,990 µs
due in window, never published	2
CPU user / sys per msg	95.6 µs / 37.5 µs
CPU (share of a core)	26.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
properties_delivered: 19998 of 19998 messages carried user properties
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	672 µs / 1,409 µs / 2,713 µs
due in window, never published	1
CPU user / sys per msg	99.4 µs / 36.9 µs
CPU (share of a core)	27.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
properties_delivered: 19999 of 19999 messages carried user properties
broker_headroom: broker used 0.10 of its core
host_quiet: 0.11 cores busy outside the client, peer and broker

111 µs

run 1 · valid

C source sent	19,982
broker received ($SYS)	19,982
broker sent ($SYS)	19,982
broker dropped ($SYS)	0
client received	19,982
in window: offered / received	15989 / 15989
CPU user / sys per msg	58.2 µs / 53.2 µs
CPU (share of a core)	22.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19982; peer wrote 19982
broker_confirms_deliveries: broker sent 19982; client received 19982
no_loss: broker acknowledged 19982 from the peer; client received 19982; broker dropped 0
offered_rate_held: peer wrote 15989 of 16000 offered in the window
client_kept_up: client received 15989 of 15989 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
broker dropped ($SYS)	0
client received	19,997
in window: offered / received	15998 / 15998
CPU user / sys per msg	93.8 µs / 18.1 µs
CPU (share of a core)	22.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19997; peer wrote 19997
broker_confirms_deliveries: broker sent 19997; client received 19997
no_loss: broker acknowledged 19997 from the peer; client received 19997; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,995
broker received ($SYS)	19,995
broker sent ($SYS)	19,995
broker dropped ($SYS)	0
client received	19,995
in window: offered / received	15996 / 15996
CPU user / sys per msg	73.8 µs / 37.5 µs
CPU (share of a core)	22.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19995; peer wrote 19995
broker_confirms_deliveries: broker sent 19995; client received 19995
no_loss: broker acknowledged 19995 from the peer; client received 19995; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.13 of its core
host_quiet: 0.23 cores busy outside the client, peer and broker

126 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	672 µs / 1,343 µs / 3,709 µs
due in window, never published	3
CPU user / sys per msg	88.8 µs / 37.5 µs
CPU (share of a core)	25.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
topic_alias_used: broker received 267 bytes per client publish; the full topic would exceed 356
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 16001
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 3,759 µs
due in window, never published	2
CPU user / sys per msg	89.4 µs / 35.0 µs
CPU (share of a core)	24.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
topic_alias_used: broker received 267 bytes per client publish; the full topic would exceed 356
broker_headroom: broker used 0.10 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	705 µs / 1,343 µs / 3,287 µs
due in window, never published	3
CPU user / sys per msg	94.4 µs / 33.1 µs
CPU (share of a core)	25.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
topic_alias_used: broker received 267 bytes per client publish; the full topic would exceed 356
broker_headroom: broker used 0.10 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

≥ 38,038broker boundbroker queue overflow

run 1 · valid broker queue overflowbroker bound

C source sent	510,765
broker received ($SYS)	510,765
broker sent ($SYS)	396,057
broker dropped ($SYS)	114,708
client received	396,057
in window: offered / received	405980 / 302488
CPU user / sys per msg	17.5 µs / 8.9 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 510765; peer wrote 510765
broker_confirms_deliveries: broker sent 396057; client received 396057 by t_stop
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid broker queue overflowbroker bound

C source sent	500,679
broker received ($SYS)	500,679
broker sent ($SYS)	402,473
broker dropped ($SYS)	98,206
client received	402,473
in window: offered / received	396290 / 307482
CPU user / sys per msg	17.0 µs / 9.0 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 500679; peer wrote 500679
broker_confirms_deliveries: broker sent 402473; client received 402473 by t_stop
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid broker queue overflowbroker bound

C source sent	501,677
broker received ($SYS)	501,677
broker sent ($SYS)	396,220
broker dropped ($SYS)	105,457
client received	396,220
in window: offered / received	398196 / 304305
CPU user / sys per msg	17.6 µs / 8.7 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 501677; peer wrote 501677
broker_confirms_deliveries: broker sent 396220; client received 396220 by t_stop
host_quiet: 0.13 cores busy outside the client, peer and broker

≥ 30,237broker boundbroker queue overflow

run 1 · valid broker queue overflowbroker bound

C source sent	556,922
broker received ($SYS)	556,922
broker sent ($SYS)	315,497
broker dropped ($SYS)	241,425
client received	315,497
in window: offered / received	438655 / 242338
CPU user / sys per msg	21.2 µs / 11.8 µs
CPU (share of a core)	100.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 556922; peer wrote 556922
broker_confirms_deliveries: broker sent 315497; client received 315497 by t_stop
host_quiet: 0.11 cores busy outside the client, peer and broker

run 2 · valid broker queue overflowbroker bound

C source sent	579,794
broker received ($SYS)	579,794
broker sent ($SYS)	316,613
broker dropped ($SYS)	263,181
client received	316,613
in window: offered / received	458007 / 241899
CPU user / sys per msg	21.4 µs / 11.7 µs
CPU (share of a core)	100.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 579794; peer wrote 579794
broker_confirms_deliveries: broker sent 316613; client received 316613 by t_stop
host_quiet: 0.14 cores busy outside the client, peer and broker

run 3 · valid broker queue overflowbroker bound

C source sent	579,493
broker received ($SYS)	579,493
broker sent ($SYS)	314,215
broker dropped ($SYS)	265,278
client received	314,215
in window: offered / received	456886 / 240916
CPU user / sys per msg	21.6 µs / 11.6 µs
CPU (share of a core)	100.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 579493; peer wrote 579493
broker_confirms_deliveries: broker sent 314215; client received 314215 by t_stop
host_quiet: 0.10 cores busy outside the client, peer and broker

mqttium 1.1.0 asyncio

152 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 16000
schedule lag p50 / p99 / max	803 µs / 1,475 µs / 3,312 µs
due in window, never published	1
CPU user / sys per msg	132 µs / 21.2 µs
CPU (share of a core)	30.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
properties_delivered: 19999 of 19999 messages carried user properties
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	770 µs / 1,475 µs / 2,748 µs
due in window, never published	3
CPU user / sys per msg	127 µs / 23.8 µs
CPU (share of a core)	30.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
properties_delivered: 19997 of 19997 messages carried user properties
broker_headroom: broker used 0.10 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 16002
schedule lag p50 / p99 / max	836 µs / 1,475 µs / 2,223 µs
due in window, never published	2
CPU user / sys per msg	135 µs / 16.9 µs
CPU (share of a core)	30.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
properties_delivered: 19998 of 19998 messages carried user properties
broker_headroom: broker used 0.10 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

116 µs 2/3 valid

run 1 · attempt 2 · valid

C source sent	19,990
broker received ($SYS)	19,990
broker sent ($SYS)	19,990
broker dropped ($SYS)	0
client received	19,990
in window: offered / received	15992 / 15992
CPU user / sys per msg	86.9 µs / 28.8 µs
CPU (share of a core)	23.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19990; peer wrote 19990
broker_confirms_deliveries: broker sent 19990; client received 19990
no_loss: broker acknowledged 19990 from the peer; client received 19990; broker dropped 0
offered_rate_held: peer wrote 15992 of 16000 offered in the window
client_kept_up: client received 15992 of 15992 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · attempt 2 · invalid

C source sent	19,992
broker received ($SYS)	19,992
broker sent ($SYS)	19,992
broker dropped ($SYS)	0
client received	19,992
in window: offered / received	15995 / 15995
CPU user / sys per msg	98.8 µs / 22.5 µs
CPU (share of a core)	24.2 %
threads	2

host_quiet: 0.57 cores busy outside the client, peer and broker
worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19992; peer wrote 19992
broker_confirms_deliveries: broker sent 19992; client received 19992
no_loss: broker acknowledged 19992 from the peer; client received 19992; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.12 of its core

run 3 · valid

C source sent	19,988
broker received ($SYS)	19,988
broker sent ($SYS)	19,988
broker dropped ($SYS)	0
client received	19,988
in window: offered / received	15989 / 15989
CPU user / sys per msg	106 µs / 11.3 µs
CPU (share of a core)	23.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19988; peer wrote 19988
broker_confirms_deliveries: broker sent 19988; client received 19988
no_loss: broker acknowledged 19988 from the peer; client received 19988; broker dropped 0
offered_rate_held: peer wrote 15989 of 16000 offered in the window
client_kept_up: client received 15989 of 15989 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

153 µs

run 1 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	803 µs / 1,475 µs / 4,243 µs
due in window, never published	3
CPU user / sys per msg	132 µs / 20.6 µs
CPU (share of a core)	30.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15998 of 16000 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
topic_alias_used: broker received 267 bytes per client publish; the full topic would exceed 356
broker_headroom: broker used 0.10 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16001
schedule lag p50 / p99 / max	803 µs / 1,475 µs / 2,787 µs
due in window, never published	2
CPU user / sys per msg	132 µs / 20.6 µs
CPU (share of a core)	30.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
topic_alias_used: broker received 267 bytes per client publish; the full topic would exceed 356
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 15998
schedule lag p50 / p99 / max	803 µs / 1,475 µs / 3,477 µs
due in window, never published	2
CPU user / sys per msg	131 µs / 22.5 µs
CPU (share of a core)	30.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
topic_alias_used: broker received 267 bytes per client publish; the full topic would exceed 356
broker_headroom: broker used 0.10 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

≥ 48,179broker boundoffer bound

run 1 · valid broker boundoffer bound

C source sent	495,349
broker received ($SYS)	495,349
broker sent ($SYS)	495,349
broker dropped ($SYS)	0
client received	495,349
in window: offered / received	390495 / 390490
CPU user / sys per msg	18.2 µs / 2.3 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 495349; peer wrote 495349
broker_confirms_deliveries: broker sent 495349; client received 495349 by t_stop
host_quiet: 0.13 cores busy outside the client, peer and broker

run 2 · valid broker boundoffer bound

C source sent	488,254
broker received ($SYS)	488,254
broker sent ($SYS)	488,254
broker dropped ($SYS)	0
client received	488,254
in window: offered / received	385113 / 385035
CPU user / sys per msg	18.6 µs / 2.2 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 488254; peer wrote 488254
broker_confirms_deliveries: broker sent 488254; client received 488254 by t_stop
host_quiet: 0.14 cores busy outside the client, peer and broker

run 3 · valid broker boundoffer bound

C source sent	488,902
broker received ($SYS)	488,902
broker sent ($SYS)	488,902
broker dropped ($SYS)	0
client received	488,902
in window: offered / received	385466 / 385438
CPU user / sys per msg	18.4 µs / 2.4 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 488902; peer wrote 488902
broker_confirms_deliveries: broker sent 488902; client received 488902 by t_stop
host_quiet: 0.16 cores busy outside the client, peer and broker

≥ 31,609broker boundbroker queue overflow

run 1 · valid broker queue overflowbroker bound

C source sent	596,442
broker received ($SYS)	596,442
broker sent ($SYS)	330,507
broker dropped ($SYS)	265,935
client received	330,507
in window: offered / received	471994 / 253476
CPU user / sys per msg	25.6 µs / 4.6 µs
CPU (share of a core)	95.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 596442; peer wrote 596442
broker_confirms_deliveries: broker sent 330507; client received 330507 by t_stop
host_quiet: 0.14 cores busy outside the client, peer and broker

run 2 · valid broker queue overflowbroker bound

C source sent	591,719
broker received ($SYS)	591,719
broker sent ($SYS)	322,069
broker dropped ($SYS)	269,650
client received	322,069
in window: offered / received	468228 / 246225
CPU user / sys per msg	25.9 µs / 4.9 µs
CPU (share of a core)	94.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 591719; peer wrote 591719
broker_confirms_deliveries: broker sent 322069; client received 322069 by t_stop
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid broker queue overflowbroker bound

C source sent	590,086
broker received ($SYS)	590,086
broker sent ($SYS)	330,533
broker dropped ($SYS)	259,553
client received	330,533
in window: offered / received	465147 / 252876
CPU user / sys per msg	25.6 µs / 4.6 µs
CPU (share of a core)	95.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 590086; peer wrote 590086
broker_confirms_deliveries: broker sent 330533; client received 330533 by t_stop
host_quiet: 0.14 cores busy outside the client, peer and broker

paho 2.1.0 sync

198 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 16001
schedule lag p50 / p99 / max	516 µs / 573 µs / 1,999 µs
due in window, never published	1
CPU user / sys per msg	118 µs / 83.7 µs
CPU (share of a core)	40.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
properties_delivered: 19999 of 19999 messages carried user properties
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	516 µs / 606 µs / 1,320 µs
due in window, never published	2
CPU user / sys per msg	181 µs / 16.9 µs
CPU (share of a core)	39.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
properties_delivered: 19998 of 19998 messages carried user properties
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	573 µs / 901 µs / 1,833 µs
due in window, never published	2
CPU user / sys per msg	108 µs / 90.0 µs
CPU (share of a core)	39.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
properties_delivered: 19998 of 19998 messages carried user properties
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

187 µs 2/3 valid

run 1 · valid

C source sent	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
broker dropped ($SYS)	0
client received	19,997
in window: offered / received	15998 / 15998
CPU user / sys per msg	143 µs / 46.3 µs
CPU (share of a core)	37.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19997; peer wrote 19997
broker_confirms_deliveries: broker sent 19997; client received 19997
no_loss: broker acknowledged 19997 from the peer; client received 19997; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
broker_headroom: broker used 0.13 of its core
host_quiet: 0.40 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,988
broker received ($SYS)	19,988
broker sent ($SYS)	19,988
broker dropped ($SYS)	0
client received	19,988
in window: offered / received	15991 / 15991
CPU user / sys per msg	63.8 µs / 122 µs
CPU (share of a core)	37.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19988; peer wrote 19988
broker_confirms_deliveries: broker sent 19988; client received 19988
no_loss: broker acknowledged 19988 from the peer; client received 19988; broker dropped 0
offered_rate_held: peer wrote 15991 of 16002 offered in the window
client_kept_up: client received 15991 of 15991 in the window
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · attempt 2 · invalid

C source sent	19,993
broker received ($SYS)	19,993
broker sent ($SYS)	19,993
broker dropped ($SYS)	0
client received	19,993
in window: offered / received	15994 / 15994
CPU user / sys per msg	157 µs / 31.3 µs
CPU (share of a core)	37.6 %
threads	2

host_quiet: 0.62 cores busy outside the client, peer and broker
worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19993; peer wrote 19993
broker_confirms_deliveries: broker sent 19993; client received 19993
no_loss: broker acknowledged 19993 from the peer; client received 19993; broker dropped 0
offered_rate_held: peer wrote 15994 of 16000 offered in the window
client_kept_up: client received 15994 of 15994 in the window
broker_headroom: broker used 0.13 of its core

183 µs

run 1 · attempt 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	541 µs / 573 µs / 749 µs
due in window, never published	2
CPU user / sys per msg	152 µs / 23.1 µs
CPU (share of a core)	35.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
topic_alias_used: broker received 267 bytes per client publish; the full topic would exceed 356
broker_headroom: broker used 0.10 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	516 µs / 606 µs / 1,433 µs
due in window, never published	2
CPU user / sys per msg	162 µs / 21.2 µs
CPU (share of a core)	36.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
topic_alias_used: broker received 267 bytes per client publish; the full topic would exceed 356
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16001 / 15999
schedule lag p50 / p99 / max	541 µs / 934 µs / 2,372 µs
due in window, never published	1
CPU user / sys per msg	177 µs / 8.1 µs
CPU (share of a core)	37.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16001 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
topic_alias_used: broker received 267 bytes per client publish; the full topic would exceed 356
broker_headroom: broker used 0.12 of its core
host_quiet: 0.48 cores busy outside the client, peer and broker

≥ 11,817broker boundbroker queue overflow

run 1 · valid broker queue overflowbroker bound

C source sent	708,366
broker received ($SYS)	708,366
broker sent ($SYS)	129,603
broker dropped ($SYS)	578,763
client received	129,603
in window: offered / received	566932 / 94326
CPU user / sys per msg	57.9 µs / 26.8 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708366; peer wrote 708366
broker_confirms_deliveries: broker sent 129603; client received 129603 by t_stop
host_quiet: 0.12 cores busy outside the client, peer and broker

run 2 · valid broker queue overflowbroker bound

C source sent	707,779
broker received ($SYS)	707,779
broker sent ($SYS)	130,155
broker dropped ($SYS)	577,624
client received	130,155
in window: offered / received	566507 / 94539
CPU user / sys per msg	57.9 µs / 26.8 µs
CPU (share of a core)	100.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707779; peer wrote 707779
broker_confirms_deliveries: broker sent 130155; client received 130155 by t_stop
host_quiet: 0.10 cores busy outside the client, peer and broker

run 3 · valid broker queue overflowbroker bound

C source sent	707,876
broker received ($SYS)	707,876
broker sent ($SYS)	130,279
broker dropped ($SYS)	577,597
client received	130,279
in window: offered / received	566249 / 94637
CPU user / sys per msg	57.9 µs / 26.6 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707876; peer wrote 707876
broker_confirms_deliveries: broker sent 130279; client received 130279 by t_stop
host_quiet: 0.14 cores busy outside the client, peer and broker

≥ 11,745broker boundbroker queue overflow

run 1 · valid broker queue overflowbroker bound

C source sent	707,740
broker received ($SYS)	707,740
broker sent ($SYS)	127,628
broker dropped ($SYS)	580,112
client received	127,628
in window: offered / received	566134 / 93956
CPU user / sys per msg	60.7 µs / 24.6 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707740; peer wrote 707740
broker_confirms_deliveries: broker sent 127628; client received 127628 by t_stop
host_quiet: 0.14 cores busy outside the client, peer and broker

run 2 · valid broker queue overflowbroker bound

C source sent	707,569
broker received ($SYS)	707,569
broker sent ($SYS)	127,552
broker dropped ($SYS)	580,017
client received	127,552
in window: offered / received	565848 / 94451
CPU user / sys per msg	60.7 µs / 24.0 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707569; peer wrote 707569
broker_confirms_deliveries: broker sent 127552; client received 127552 by t_stop
host_quiet: 0.11 cores busy outside the client, peer and broker

run 3 · valid broker queue overflowbroker bound

C source sent	707,279
broker received ($SYS)	707,279
broker sent ($SYS)	126,695
broker dropped ($SYS)	580,584
client received	126,695
in window: offered / received	565586 / 93165
CPU user / sys per msg	58.0 µs / 27.9 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707279; peer wrote 707279
broker_confirms_deliveries: broker sent 126695; client received 126695 by t_stop
host_quiet: 0.23 cores busy outside the client, peer and broker

zmqtt 0.2.4 asyncio experimental

273 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16002 / 16001
schedule lag p50 / p99 / max	934 µs / 1,933 µs / 2,245 µs
due in window, never published	1
CPU user / sys per msg	247 µs / 25.6 µs
CPU (share of a core)	54.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16002 of 16003 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
properties_delivered: 19999 of 19999 messages carried user properties
broker_headroom: broker used 0.10 of its core
host_quiet: 0.12 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16002 / 16001
schedule lag p50 / p99 / max	901 µs / 1,868 µs / 2,164 µs
due in window, never published	1
CPU user / sys per msg	239 µs / 34.4 µs
CPU (share of a core)	54.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16002 of 16003 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
properties_delivered: 19999 of 19999 messages carried user properties
broker_headroom: broker used 0.10 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	999 µs / 1,933 µs / 3,824 µs
due in window, never published	1
CPU user / sys per msg	236 µs / 30.6 µs
CPU (share of a core)	53.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
properties_delivered: 19999 of 19999 messages carried user properties
broker_headroom: broker used 0.10 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

201 µs

run 1 · valid

C source sent	19,991
broker received ($SYS)	19,991
broker sent ($SYS)	19,991
broker dropped ($SYS)	0
client received	19,991
in window: offered / received	15997 / 15997
CPU user / sys per msg	178 µs / 33.8 µs
CPU (share of a core)	42.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19991; peer wrote 19991
broker_confirms_deliveries: broker sent 19991; client received 19991
no_loss: broker acknowledged 19991 from the peer; client received 19991; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.13 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,991
broker received ($SYS)	19,991
broker sent ($SYS)	19,991
broker dropped ($SYS)	0
client received	19,991
in window: offered / received	15996 / 15996
CPU user / sys per msg	158 µs / 43.1 µs
CPU (share of a core)	40.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19991; peer wrote 19991
broker_confirms_deliveries: broker sent 19991; client received 19991
no_loss: broker acknowledged 19991 from the peer; client received 19991; broker dropped 0
offered_rate_held: peer wrote 15996 of 16000 offered in the window
client_kept_up: client received 15996 of 15996 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.31 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15997 / 15997
CPU user / sys per msg	150 µs / 51.3 µs
CPU (share of a core)	40.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.13 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

unsupported

≥ 8,866broker boundbroker queue overflow

run 1 · valid broker queue overflowbroker bound

C source sent	707,920
broker received ($SYS)	707,920
broker sent ($SYS)	101,279
broker dropped ($SYS)	606,641
client received	101,279
in window: offered / received	566298 / 71013
CPU user / sys per msg	100 µs / 12.4 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707920; peer wrote 707920
broker_confirms_deliveries: broker sent 101279; client received 101279 by t_stop
host_quiet: 0.22 cores busy outside the client, peer and broker

run 2 · valid broker queue overflowbroker bound

C source sent	707,761
broker received ($SYS)	707,761
broker sent ($SYS)	100,646
broker dropped ($SYS)	607,115
client received	100,646
in window: offered / received	566175 / 70474
CPU user / sys per msg	100 µs / 13.1 µs
CPU (share of a core)	100.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707761; peer wrote 707761
broker_confirms_deliveries: broker sent 100646; client received 100646 by t_stop
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid broker queue overflowbroker bound

C source sent	707,429
broker received ($SYS)	707,429
broker sent ($SYS)	100,821
broker dropped ($SYS)	606,608
client received	100,821
in window: offered / received	566031 / 70932
CPU user / sys per msg	99.1 µs / 13.7 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707429; peer wrote 707429
broker_confirms_deliveries: broker sent 100821; client received 100821 by t_stop
host_quiet: 0.18 cores busy outside the client, peer and broker

≥ 6,835broker boundbroker queue overflow

run 1 · valid broker queue overflowbroker bound

C source sent	707,705
broker received ($SYS)	707,705
broker sent ($SYS)	77,802
broker dropped ($SYS)	629,903
client received	77,802
in window: offered / received	566197 / 53558
CPU user / sys per msg	117 µs / 32.5 µs
CPU (share of a core)	100.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707705; peer wrote 707705
broker_confirms_deliveries: broker sent 77802; client received 77802 by t_stop
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid broker queue overflowbroker bound

C source sent	707,356
broker received ($SYS)	707,356
broker sent ($SYS)	78,823
broker dropped ($SYS)	628,533
client received	78,823
in window: offered / received	566084 / 54682
CPU user / sys per msg	114 µs / 32.2 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707356; peer wrote 707356
broker_confirms_deliveries: broker sent 78823; client received 78823 by t_stop
host_quiet: 0.11 cores busy outside the client, peer and broker

run 3 · valid broker queue overflowbroker bound

C source sent	707,977
broker received ($SYS)	707,977
broker sent ($SYS)	79,267
broker dropped ($SYS)	628,710
client received	79,267
in window: offered / received	566643 / 54889
CPU user / sys per msg	114 µs / 31.9 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707977; peer wrote 707977
broker_confirms_deliveries: broker sent 79267; client received 79267 by t_stop
host_quiet: 0.10 cores busy outside the client, peer and broker

aiomqtt 2.5.1 asyncio

375 µs

run 1 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	868 µs / 2,064 µs / 2,495 µs
due in window, never published	1
CPU user / sys per msg	346 µs / 24.4 µs
CPU (share of a core)	74.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
properties_delivered: 19999 of 19999 messages carried user properties
broker_headroom: broker used 0.10 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 16001
schedule lag p50 / p99 / max	836 µs / 2,163 µs / 3,743 µs
due in window, never published	2
CPU user / sys per msg	359 µs / 20.0 µs
CPU (share of a core)	75.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 15999 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
properties_delivered: 19998 of 19998 messages carried user properties
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,999
client completed	19,999
broker received ($SYS)	19,999
broker sent ($SYS)	19,999
C sink received	19,999
in window: sent / delivered	16000 / 15998
schedule lag p50 / p99 / max	868 µs / 2,064 µs / 2,592 µs
due in window, never published	1
CPU user / sys per msg	349 µs / 26.2 µs
CPU (share of a core)	75.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19999 from the client; client sent 19999, completed 19999
broker_confirms_deliveries: broker sent 19999; peer received 19999
no_loss: client saw 19999 completions; peer received 19999
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19999 payloads had an unexpected length
properties_delivered: 19999 of 19999 messages carried user properties
broker_headroom: broker used 0.10 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

279 µs

run 1 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15995 / 15995
CPU user / sys per msg	268 µs / 11.3 µs
CPU (share of a core)	55.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.01 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15997 / 15997
CPU user / sys per msg	267 µs / 11.9 µs
CPU (share of a core)	55.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.39 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,991
broker received ($SYS)	19,991
broker sent ($SYS)	19,991
broker dropped ($SYS)	0
client received	19,991
in window: offered / received	15995 / 15995
CPU user / sys per msg	265 µs / 13.8 µs
CPU (share of a core)	55.7 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19991; peer wrote 19991
broker_confirms_deliveries: broker sent 19991; client received 19991
no_loss: broker acknowledged 19991 from the peer; client received 19991; broker dropped 0
offered_rate_held: peer wrote 15995 of 16000 offered in the window
client_kept_up: client received 15995 of 15995 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.50 cores busy outside the client, peer and broker

326 µs

run 1 · valid

client sent	19,998
client completed	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
C sink received	19,998
in window: sent / delivered	15999 / 15999
schedule lag p50 / p99 / max	967 µs / 2,163 µs / 3,461 µs
due in window, never published	2
CPU user / sys per msg	304 µs / 23.8 µs
CPU (share of a core)	65.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19998 from the client; client sent 19998, completed 19998
broker_confirms_deliveries: broker sent 19998; peer received 19998
no_loss: client saw 19998 completions; peer received 19998
offered_rate_held: client published 15999 of 16000 offered in the window
payloads_intact: 0 of 19998 payloads had an unexpected length
topic_alias_used: broker received 267 bytes per client publish; the full topic would exceed 356
broker_headroom: broker used 0.10 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

client sent	19,996
client completed	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
C sink received	19,996
in window: sent / delivered	16000 / 16000
schedule lag p50 / p99 / max	967 µs / 2,163 µs / 2,283 µs
due in window, never published	4
CPU user / sys per msg	302 µs / 23.1 µs
CPU (share of a core)	65.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19996 from the client; client sent 19996, completed 19996
broker_confirms_deliveries: broker sent 19996; peer received 19996
no_loss: client saw 19996 completions; peer received 19996
offered_rate_held: client published 16000 of 16000 offered in the window
payloads_intact: 0 of 19996 payloads had an unexpected length
topic_alias_used: broker received 267 bytes per client publish; the full topic would exceed 356
broker_headroom: broker used 0.10 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	19,997
client completed	19,997
broker received ($SYS)	19,997
broker sent ($SYS)	19,997
C sink received	19,997
in window: sent / delivered	15998 / 16000
schedule lag p50 / p99 / max	967 µs / 2,163 µs / 2,466 µs
due in window, never published	3
CPU user / sys per msg	303 µs / 21.3 µs
CPU (share of a core)	64.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 19997 from the client; client sent 19997, completed 19997
broker_confirms_deliveries: broker sent 19997; peer received 19997
no_loss: client saw 19997 completions; peer received 19997
offered_rate_held: client published 15998 of 15999 offered in the window
payloads_intact: 0 of 19997 payloads had an unexpected length
topic_alias_used: broker received 267 bytes per client publish; the full topic would exceed 356
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

≥ 2,046broker boundbroker queue overflow

run 1 · valid broker queue overflowbroker bound

C source sent	707,277
broker received ($SYS)	707,277
broker sent ($SYS)	74,469
broker dropped ($SYS)	632,808
client received	29,426
in window: offered / received	565772 / 16238
CPU user / sys per msg	435 µs / 56.7 µs
CPU (share of a core)	100.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707277; peer wrote 707277
broker_confirms_deliveries: broker sent 74469; client received 29426 by t_stop
host_quiet: 0.04 cores busy outside the client, peer and broker

run 2 · valid broker queue overflowbroker bound

C source sent	707,867
broker received ($SYS)	707,867
broker sent ($SYS)	76,170
broker dropped ($SYS)	631,697
client received	30,285
in window: offered / received	566305 / 16806
CPU user / sys per msg	425 µs / 51.2 µs
CPU (share of a core)	100.2 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707867; peer wrote 707867
broker_confirms_deliveries: broker sent 76170; client received 30285 by t_stop
host_quiet: 0.06 cores busy outside the client, peer and broker

run 3 · valid broker queue overflowbroker bound

C source sent	707,691
broker received ($SYS)	707,691
broker sent ($SYS)	74,526
broker dropped ($SYS)	633,165
client received	29,959
in window: offered / received	566027 / 16258
CPU user / sys per msg	436 µs / 56.0 µs
CPU (share of a core)	100.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707691; peer wrote 707691
broker_confirms_deliveries: broker sent 74526; client received 29959 by t_stop
host_quiet: 0.20 cores busy outside the client, peer and broker

≥ 2,016broker boundbroker queue overflow

run 1 · valid broker queue overflowbroker bound

C source sent	707,788
broker received ($SYS)	707,788
broker sent ($SYS)	71,706
broker dropped ($SYS)	636,082
client received	35,014
in window: offered / received	566310 / 15947
CPU user / sys per msg	443 µs / 58.9 µs
CPU (share of a core)	101.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 707788; peer wrote 707788
broker_confirms_deliveries: broker sent 71706; client received 35014 by t_stop
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid broker queue overflowbroker bound

C source sent	708,010
broker received ($SYS)	708,010
broker sent ($SYS)	70,308
broker dropped ($SYS)	637,702
client received	34,549
in window: offered / received	566300 / 15567
CPU user / sys per msg	455 µs / 58.5 µs
CPU (share of a core)	100.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708010; peer wrote 708010
broker_confirms_deliveries: broker sent 70308; client received 34549 by t_stop
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid broker queue overflowbroker bound

C source sent	708,441
broker received ($SYS)	708,441
broker sent ($SYS)	71,949
broker dropped ($SYS)	636,492
client received	34,834
in window: offered / received	566701 / 16056
CPU user / sys per msg	440 µs / 57.9 µs
CPU (share of a core)	100.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 708441; peer wrote 708441
broker_confirms_deliveries: broker sent 71949; client received 34834 by t_stop
host_quiet: 0.10 cores busy outside the client, peer and broker

aiomqtt3 3.0.0a1 asyncio experimental

unsupported

123 µs

run 1 · valid

C source sent	19,998
broker received ($SYS)	19,998
broker sent ($SYS)	19,998
broker dropped ($SYS)	0
client received	19,998
in window: offered / received	15999 / 15999
CPU user / sys per msg	68.8 µs / 55.0 µs
CPU (share of a core)	24.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19998; peer wrote 19998
broker_confirms_deliveries: broker sent 19998; client received 19998
no_loss: broker acknowledged 19998 from the peer; client received 19998; broker dropped 0
offered_rate_held: peer wrote 15999 of 16000 offered in the window
client_kept_up: client received 15999 of 15999 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 2 · valid

C source sent	19,994
broker received ($SYS)	19,994
broker sent ($SYS)	19,994
broker dropped ($SYS)	0
client received	19,994
in window: offered / received	15998 / 15998
CPU user / sys per msg	101 µs / 22.5 µs
CPU (share of a core)	24.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19994; peer wrote 19994
broker_confirms_deliveries: broker sent 19994; client received 19994
no_loss: broker acknowledged 19994 from the peer; client received 19994; broker dropped 0
offered_rate_held: peer wrote 15998 of 16000 offered in the window
client_kept_up: client received 15998 of 15998 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

C source sent	19,996
broker received ($SYS)	19,996
broker sent ($SYS)	19,996
broker dropped ($SYS)	0
client received	19,996
in window: offered / received	15997 / 15997
CPU user / sys per msg	88.8 µs / 34.4 µs
CPU (share of a core)	24.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 19996; peer wrote 19996
broker_confirms_deliveries: broker sent 19996; client received 19996
no_loss: broker acknowledged 19996 from the peer; client received 19996; broker dropped 0
offered_rate_held: peer wrote 15997 of 16000 offered in the window
client_kept_up: client received 15997 of 15997 in the window
broker_headroom: broker used 0.12 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

unsupported

≥ 46,828broker boundoffer bound

run 1 · valid broker boundoffer bound

C source sent	478,283
broker received ($SYS)	478,283
broker sent ($SYS)	478,283
broker dropped ($SYS)	0
client received	478,283
in window: offered / received	376573 / 376474
CPU user / sys per msg	12.4 µs / 8.9 µs
CPU (share of a core)	100.0 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 478283; peer wrote 478283
broker_confirms_deliveries: broker sent 478283; client received 478283 by t_stop
host_quiet: 0.14 cores busy outside the client, peer and broker

run 2 · valid broker boundoffer bound

C source sent	475,457
broker received ($SYS)	475,457
broker sent ($SYS)	475,457
broker dropped ($SYS)	0
client received	475,457
in window: offered / received	375049 / 374280
CPU user / sys per msg	12.4 µs / 9.0 µs
CPU (share of a core)	100.0 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 475457; peer wrote 475457
broker_confirms_deliveries: broker sent 475457; client received 475457 by t_stop
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid broker boundoffer bound

C source sent	477,191
broker received ($SYS)	477,191
broker sent ($SYS)	477,191
broker dropped ($SYS)	0
client received	477,191
in window: offered / received	375077 / 374625
CPU user / sys per msg	12.5 µs / 8.8 µs
CPU (share of a core)	100.0 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 477191; peer wrote 477191
broker_confirms_deliveries: broker sent 477191; client received 477191 by t_stop
host_quiet: 0.14 cores busy outside the client, peer and broker

≥ 32,215broker boundbroker queue overflow

run 1 · valid broker queue overflowbroker bound

C source sent	564,241
broker received ($SYS)	564,241
broker sent ($SYS)	340,987
broker dropped ($SYS)	223,254
client received	340,987
in window: offered / received	447058 / 260853
CPU user / sys per msg	19.2 µs / 11.3 µs
CPU (share of a core)	99.8 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 564241; peer wrote 564241
broker_confirms_deliveries: broker sent 340987; client received 340987 by t_stop
host_quiet: 0.14 cores busy outside the client, peer and broker

run 2 · valid broker queue overflowbroker bound

C source sent	567,272
broker received ($SYS)	567,272
broker sent ($SYS)	331,539
broker dropped ($SYS)	235,733
client received	331,539
in window: offered / received	446913 / 252976
CPU user / sys per msg	19.4 µs / 12.2 µs
CPU (share of a core)	99.7 %
threads	4

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 567272; peer wrote 567272
broker_confirms_deliveries: broker sent 331539; client received 331539 by t_stop
host_quiet: 0.13 cores busy outside the client, peer and broker

run 3 · valid broker queue overflowbroker bound

C source sent	563,323
broker received ($SYS)	563,323
broker sent ($SYS)	336,240
broker dropped ($SYS)	227,083
client received	336,240
in window: offered / received	447568 / 257724
CPU user / sys per msg	19.2 µs / 11.8 µs
CPU (share of a core)	99.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_peer_publishes: broker received 563323; peer wrote 563323
broker_confirms_deliveries: broker sent 336240; client received 336240 by t_stop
host_quiet: 0.11 cores busy outside the client, peer and broker

amqtt 0.12.1 asyncio

unsupported

How do large payloads behave?

QoS 1 at 500 msgs/s of 64 KiB and 50 msgs/s of 1 MiB, and packets on both sides of each remaining-length step up to 2 MiB, every length checked by the C sink.

client

64 KiB CPU / msg ↓

64 KiB p99 ↓

1 MiB CPU / msg ↓

1 MiB p99 ↓

RL boundaries p99 ↓

awscrt 0.37.0 crt_event_loop native

192 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	606 µs / 836 µs / 3,515 µs
due in window, never published	1
CPU user / sys per msg	20.0 µs / 172 µs
CPU (share of a core)	9.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.07 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4001
schedule lag p50 / p99 / max	541 µs / 770 µs / 2,716 µs
due in window, never published	1
CPU user / sys per msg	165 µs / 27.5 µs
CPU (share of a core)	9.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	3999 / 4001
schedule lag p50 / p99 / max	483 µs / 934 µs / 2,354 µs
due in window, never published	1
CPU user / sys per msg	123 µs / 70.0 µs
CPU (share of a core)	9.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 3999 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

2,294 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	606 µs / 836 µs / 3,515 µs
due in window, never published	1
CPU user / sys per msg	20.0 µs / 172 µs
CPU (share of a core)	9.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.07 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4001
schedule lag p50 / p99 / max	541 µs / 770 µs / 2,716 µs
due in window, never published	1
CPU user / sys per msg	165 µs / 27.5 µs
CPU (share of a core)	9.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.00 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	3999 / 4001
schedule lag p50 / p99 / max	483 µs / 934 µs / 2,354 µs
due in window, never published	1
CPU user / sys per msg	123 µs / 70.0 µs
CPU (share of a core)	9.6 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 3999 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

2,481 µs

run 1 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	399 / 401
schedule lag p50 / p99 / max	121 µs / 434 µs / 458 µs
due in window, never published	1
CPU user / sys per msg	1,178 µs / 1,303 µs
CPU (share of a core)	12.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 399 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 2 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	399 / 400
schedule lag p50 / p99 / max	401 µs / 999 µs / 1,942 µs
due in window, never published	1
CPU user / sys per msg	1,328 µs / 1,178 µs
CPU (share of a core)	12.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 399 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 3 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 401
schedule lag p50 / p99 / max	737 µs / 803 µs / 823 µs
due in window, never published	1
CPU user / sys per msg	1,300 µs / 1,125 µs
CPU (share of a core)	12.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

22.5 ms

run 1 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	399 / 401
schedule lag p50 / p99 / max	121 µs / 434 µs / 458 µs
due in window, never published	1
CPU user / sys per msg	1,178 µs / 1,303 µs
CPU (share of a core)	12.4 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 399 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 2 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	399 / 400
schedule lag p50 / p99 / max	401 µs / 999 µs / 1,942 µs
due in window, never published	1
CPU user / sys per msg	1,328 µs / 1,178 µs
CPU (share of a core)	12.5 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 399 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

run 3 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 401
schedule lag p50 / p99 / max	737 µs / 803 µs / 823 µs
due in window, never published	1
CPU user / sys per msg	1,300 µs / 1,125 µs
CPU (share of a core)	12.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.13 cores busy outside the client, peer and broker

47.2 ms

run 1 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	479 / 480
schedule lag p50 / p99 / max	516 µs / 999 µs / 1,000 µs
due in window, never published	1
CPU user / sys per msg	960 µs / 898 µs
CPU (share of a core)	11.1 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 479 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 479
schedule lag p50 / p99 / max	500 µs / 999 µs / 1,014 µs
due in window, never published	1
CPU user / sys per msg	875 µs / 958 µs
CPU (share of a core)	11.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 480
schedule lag p50 / p99 / max	541 µs / 999 µs / 1,002 µs
due in window, never published	1
CPU user / sys per msg	833 µs / 979 µs
CPU (share of a core)	10.9 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

paho 2.1.0 sync

272 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	160 µs / 319 µs / 1,249 µs
due in window, never published	1
CPU user / sys per msg	238 µs / 45.0 µs
CPU (share of a core)	14.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.24 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	500 µs / 836 µs / 2,415 µs
due in window, never published	1
CPU user / sys per msg	178 µs / 95.0 µs
CPU (share of a core)	13.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.32 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	336 µs / 573 µs / 1,305 µs
due in window, never published	1
CPU user / sys per msg	72.5 µs / 198 µs
CPU (share of a core)	13.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.26 cores busy outside the client, peer and broker

434 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	160 µs / 319 µs / 1,249 µs
due in window, never published	1
CPU user / sys per msg	238 µs / 45.0 µs
CPU (share of a core)	14.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.11 of its core
host_quiet: 0.24 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	500 µs / 836 µs / 2,415 µs
due in window, never published	1
CPU user / sys per msg	178 µs / 95.0 µs
CPU (share of a core)	13.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.32 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	336 µs / 573 µs / 1,305 µs
due in window, never published	1
CPU user / sys per msg	72.5 µs / 198 µs
CPU (share of a core)	13.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.26 cores busy outside the client, peer and broker

2,475 µs

run 1 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	184 µs / 836 µs / 841 µs
due in window, never published	1
CPU user / sys per msg	1,125 µs / 1,350 µs
CPU (share of a core)	12.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 2 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	770 µs / 803 µs / 803 µs
due in window, never published	1
CPU user / sys per msg	825 µs / 1,650 µs
CPU (share of a core)	12.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	573 µs / 605 µs / 605 µs
due in window, never published	1
CPU user / sys per msg	1,750 µs / 825 µs
CPU (share of a core)	12.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.38 cores busy outside the client, peer and broker

4,325 µs

run 1 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	184 µs / 836 µs / 841 µs
due in window, never published	1
CPU user / sys per msg	1,125 µs / 1,350 µs
CPU (share of a core)	12.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.14 cores busy outside the client, peer and broker

run 2 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	770 µs / 803 µs / 803 µs
due in window, never published	1
CPU user / sys per msg	825 µs / 1,650 µs
CPU (share of a core)	12.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	573 µs / 605 µs / 605 µs
due in window, never published	1
CPU user / sys per msg	1,750 µs / 825 µs
CPU (share of a core)	12.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.38 cores busy outside the client, peer and broker

7,733 µs

run 1 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 480
schedule lag p50 / p99 / max	516 µs / 999 µs / 1,264 µs
due in window, never published	1
CPU user / sys per msg	896 µs / 979 µs
CPU (share of a core)	11.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 480
schedule lag p50 / p99 / max	516 µs / 999 µs / 1,015 µs
due in window, never published	1
CPU user / sys per msg	1,062 µs / 833 µs
CPU (share of a core)	11.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 480
schedule lag p50 / p99 / max	541 µs / 999 µs / 1,002 µs
due in window, never published	1
CPU user / sys per msg	979 µs / 833 µs
CPU (share of a core)	10.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

gmqtt 0.7.0 asyncio

277 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,778 µs
due in window, never published	1
CPU user / sys per msg	215 µs / 60.0 µs
CPU (share of a core)	13.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 2,109 µs
due in window, never published	1
CPU user / sys per msg	195 µs / 82.5 µs
CPU (share of a core)	13.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,639 µs
due in window, never published	1
CPU user / sys per msg	215 µs / 62.5 µs
CPU (share of a core)	13.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

352 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,778 µs
due in window, never published	1
CPU user / sys per msg	215 µs / 60.0 µs
CPU (share of a core)	13.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 2,109 µs
due in window, never published	1
CPU user / sys per msg	195 µs / 82.5 µs
CPU (share of a core)	13.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,639 µs
due in window, never published	1
CPU user / sys per msg	215 µs / 62.5 µs
CPU (share of a core)	13.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

2,825 µs

run 1 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,156 µs
due in window, never published	1
CPU user / sys per msg	1,700 µs / 1,150 µs
CPU (share of a core)	14.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,149 µs
due in window, never published	1
CPU user / sys per msg	1,600 µs / 1,225 µs
CPU (share of a core)	14.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	399 / 400
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,156 µs
due in window, never published	1
CPU user / sys per msg	1,679 µs / 1,128 µs
CPU (share of a core)	14.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 399 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

4,325 µs

run 1 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,156 µs
due in window, never published	1
CPU user / sys per msg	1,700 µs / 1,150 µs
CPU (share of a core)	14.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,149 µs
due in window, never published	1
CPU user / sys per msg	1,600 µs / 1,225 µs
CPU (share of a core)	14.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	399 / 400
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,156 µs
due in window, never published	1
CPU user / sys per msg	1,679 µs / 1,128 µs
CPU (share of a core)	14.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 399 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

6,685 µs

run 1 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 480
schedule lag p50 / p99 / max	541 µs / 1,147 µs / 1,152 µs
due in window, never published	1
CPU user / sys per msg	1,479 µs / 875 µs
CPU (share of a core)	14.1 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 480
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,152 µs
due in window, never published	1
CPU user / sys per msg	1,458 µs / 917 µs
CPU (share of a core)	14.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 480
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,166 µs
due in window, never published	1
CPU user / sys per msg	1,417 µs / 854 µs
CPU (share of a core)	13.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

mqttium 1.1.0 asyncio

290 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,776 µs
due in window, never published	1
CPU user / sys per msg	232 µs / 57.5 µs
CPU (share of a core)	14.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.13 of its core
host_quiet: 0.24 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,299 µs
due in window, never published	1
CPU user / sys per msg	228 µs / 65.0 µs
CPU (share of a core)	14.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.13 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 2,879 µs
due in window, never published	1
CPU user / sys per msg	228 µs / 62.5 µs
CPU (share of a core)	14.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.13 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

418 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,776 µs
due in window, never published	1
CPU user / sys per msg	232 µs / 57.5 µs
CPU (share of a core)	14.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.13 of its core
host_quiet: 0.24 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,299 µs
due in window, never published	1
CPU user / sys per msg	228 µs / 65.0 µs
CPU (share of a core)	14.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.13 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 2,879 µs
due in window, never published	1
CPU user / sys per msg	228 µs / 62.5 µs
CPU (share of a core)	14.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.13 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

1,980 µs

run 1 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,162 µs
due in window, never published	1
CPU user / sys per msg	1,625 µs / 450 µs
CPU (share of a core)	10.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,365 µs
due in window, never published	1
CPU user / sys per msg	1,550 µs / 425 µs
CPU (share of a core)	9.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	399 / 400
schedule lag p50 / p99 / max	541 µs / 1,128 µs / 1,128 µs
due in window, never published	1
CPU user / sys per msg	1,679 µs / 301 µs
CPU (share of a core)	9.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 399 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

2,949 µs

run 1 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,162 µs
due in window, never published	1
CPU user / sys per msg	1,625 µs / 450 µs
CPU (share of a core)	10.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,365 µs
due in window, never published	1
CPU user / sys per msg	1,550 µs / 425 µs
CPU (share of a core)	9.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	399 / 400
schedule lag p50 / p99 / max	541 µs / 1,128 µs / 1,128 µs
due in window, never published	1
CPU user / sys per msg	1,679 µs / 301 µs
CPU (share of a core)	9.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 399 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

5,374 µs

run 1 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 480
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,149 µs
due in window, never published	1
CPU user / sys per msg	1,271 µs / 375 µs
CPU (share of a core)	9.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 2 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 480
schedule lag p50 / p99 / max	541 µs / 1,147 µs / 1,170 µs
due in window, never published	1
CPU user / sys per msg	1,250 µs / 396 µs
CPU (share of a core)	9.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 3 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 480
schedule lag p50 / p99 / max	573 µs / 1,147 µs / 1,254 µs
due in window, never published	1
CPU user / sys per msg	1,167 µs / 458 µs
CPU (share of a core)	9.7 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

zmqtt 0.2.4 asyncio experimental

730 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	3999 / 4000
schedule lag p50 / p99 / max	737 µs / 1,343 µs / 2,742 µs
due in window, never published	1
CPU user / sys per msg	628 µs / 103 µs
CPU (share of a core)	36.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 3999 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 1,278 µs / 2,042 µs
due in window, never published	1
CPU user / sys per msg	628 µs / 100 µs
CPU (share of a core)	36.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.23 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 3,798 µs
due in window, never published	1
CPU user / sys per msg	642 µs / 92.5 µs
CPU (share of a core)	36.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

385 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	3999 / 4000
schedule lag p50 / p99 / max	737 µs / 1,343 µs / 2,742 µs
due in window, never published	1
CPU user / sys per msg	628 µs / 103 µs
CPU (share of a core)	36.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 3999 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 1,278 µs / 2,042 µs
due in window, never published	1
CPU user / sys per msg	628 µs / 100 µs
CPU (share of a core)	36.3 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.23 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 3,798 µs
due in window, never published	1
CPU user / sys per msg	642 µs / 92.5 µs
CPU (share of a core)	36.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

3,784 µs

run 1 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	399 / 400
schedule lag p50 / p99 / max	803 µs / 1,343 µs / 1,419 µs
due in window, never published	1
CPU user / sys per msg	2,607 µs / 1,178 µs
CPU (share of a core)	18.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 399 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 2 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 2,236 µs
due in window, never published	1
CPU user / sys per msg	2,650 µs / 1,125 µs
CPU (share of a core)	18.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 1,394 µs
due in window, never published	1
CPU user / sys per msg	2,525 µs / 1,275 µs
CPU (share of a core)	19.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

4,325 µs

run 1 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	399 / 400
schedule lag p50 / p99 / max	803 µs / 1,343 µs / 1,419 µs
due in window, never published	1
CPU user / sys per msg	2,607 µs / 1,178 µs
CPU (share of a core)	18.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 399 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.16 cores busy outside the client, peer and broker

run 2 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 2,236 µs
due in window, never published	1
CPU user / sys per msg	2,650 µs / 1,125 µs
CPU (share of a core)	18.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 1,394 µs
due in window, never published	1
CPU user / sys per msg	2,525 µs / 1,275 µs
CPU (share of a core)	19.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.10 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

7,995 µs

run 1 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	479 / 480
schedule lag p50 / p99 / max	737 µs / 1,343 µs / 1,459 µs
due in window, never published	1
CPU user / sys per msg	2,150 µs / 919 µs
CPU (share of a core)	18.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 479 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.20 cores busy outside the client, peer and broker

run 2 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 480
schedule lag p50 / p99 / max	868 µs / 1,343 µs / 1,347 µs
due in window, never published	1
CPU user / sys per msg	2,125 µs / 854 µs
CPU (share of a core)	17.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.15 cores busy outside the client, peer and broker

run 3 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 480
schedule lag p50 / p99 / max	737 µs / 1,343 µs / 1,665 µs
due in window, never published	1
CPU user / sys per msg	2,208 µs / 854 µs
CPU (share of a core)	18.4 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

aiomqtt 2.5.1 asyncio

758 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	868 µs / 1,671 µs / 2,351 µs
due in window, never published	1
CPU user / sys per msg	712 µs / 45.0 µs
CPU (share of a core)	37.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	705 µs / 1,671 µs / 2,534 µs
due in window, never published	1
CPU user / sys per msg	685 µs / 72.5 µs
CPU (share of a core)	37.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.13 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	803 µs / 1,671 µs / 3,519 µs
due in window, never published	1
CPU user / sys per msg	692 µs / 62.5 µs
CPU (share of a core)	37.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

967 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	868 µs / 1,671 µs / 2,351 µs
due in window, never published	1
CPU user / sys per msg	712 µs / 45.0 µs
CPU (share of a core)	37.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.21 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	705 µs / 1,671 µs / 2,534 µs
due in window, never published	1
CPU user / sys per msg	685 µs / 72.5 µs
CPU (share of a core)	37.9 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.13 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	803 µs / 1,671 µs / 3,519 µs
due in window, never published	1
CPU user / sys per msg	692 µs / 62.5 µs
CPU (share of a core)	37.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

3,000 µs

run 1 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	770 µs / 1,409 µs / 1,487 µs
due in window, never published	1
CPU user / sys per msg	2,550 µs / 500 µs
CPU (share of a core)	15.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	836 µs / 1,343 µs / 1,410 µs
due in window, never published	1
CPU user / sys per msg	2,475 µs / 525 µs
CPU (share of a core)	15.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	399 / 400
schedule lag p50 / p99 / max	803 µs / 1,343 µs / 1,427 µs
due in window, never published	1
CPU user / sys per msg	2,406 µs / 551 µs
CPU (share of a core)	14.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 399 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

3,604 µs

run 1 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	770 µs / 1,409 µs / 1,487 µs
due in window, never published	1
CPU user / sys per msg	2,550 µs / 500 µs
CPU (share of a core)	15.2 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	836 µs / 1,343 µs / 1,410 µs
due in window, never published	1
CPU user / sys per msg	2,475 µs / 525 µs
CPU (share of a core)	15.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	399 / 400
schedule lag p50 / p99 / max	803 µs / 1,343 µs / 1,427 µs
due in window, never published	1
CPU user / sys per msg	2,406 µs / 551 µs
CPU (share of a core)	14.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 399 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

8,651 µs

run 1 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 480
schedule lag p50 / p99 / max	803 µs / 1,343 µs / 2,690 µs
due in window, never published	1
CPU user / sys per msg	2,208 µs / 896 µs
CPU (share of a core)	18.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.19 cores busy outside the client, peer and broker

run 2 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 480
schedule lag p50 / p99 / max	737 µs / 1,343 µs / 1,467 µs
due in window, never published	1
CPU user / sys per msg	2,229 µs / 854 µs
CPU (share of a core)	18.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.38 cores busy outside the client, peer and broker

run 3 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 480
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 1,379 µs
due in window, never published	1
CPU user / sys per msg	2,229 µs / 875 µs
CPU (share of a core)	18.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

amqtt 0.12.1 asyncio

805 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	3999 / 4000
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 2,373 µs
due in window, never published	1
CPU user / sys per msg	703 µs / 92.5 µs
CPU (share of a core)	39.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 3999 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 1,705 µs
due in window, never published	1
CPU user / sys per msg	742 µs / 62.5 µs
CPU (share of a core)	40.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 2,060 µs
due in window, never published	1
CPU user / sys per msg	748 µs / 57.5 µs
CPU (share of a core)	40.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.25 cores busy outside the client, peer and broker

369 µs

run 1 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	3999 / 4000
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 2,373 µs
due in window, never published	1
CPU user / sys per msg	703 µs / 92.5 µs
CPU (share of a core)	39.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 3999 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 1,705 µs
due in window, never published	1
CPU user / sys per msg	742 µs / 62.5 µs
CPU (share of a core)	40.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 3 · valid

client sent	4,999
client completed	4,999
broker received ($SYS)	4,999
broker sent ($SYS)	4,999
C sink received	4,999
in window: sent / delivered	4000 / 4000
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 2,060 µs
due in window, never published	1
CPU user / sys per msg	748 µs / 57.5 µs
CPU (share of a core)	40.3 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 4999 from the client; client sent 4999, completed 4999
broker_confirms_deliveries: broker sent 4999; peer received 4999
no_loss: client saw 4999 completions; peer received 4999
offered_rate_held: client published 4000 of 4000 offered in the window
payloads_intact: 0 of 4999 payloads had an unexpected length
broker_headroom: broker used 0.12 of its core
host_quiet: 0.25 cores busy outside the client, peer and broker

2,925 µs

run 1 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	399 / 400
schedule lag p50 / p99 / max	803 µs / 1,343 µs / 1,372 µs
due in window, never published	1
CPU user / sys per msg	2,456 µs / 451 µs
CPU (share of a core)	14.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 399 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	836 µs / 1,343 µs / 1,722 µs
due in window, never published	1
CPU user / sys per msg	2,525 µs / 425 µs
CPU (share of a core)	14.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

run 3 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	737 µs / 1,343 µs / 1,692 µs
due in window, never published	1
CPU user / sys per msg	2,525 µs / 400 µs
CPU (share of a core)	14.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

3,080 µs

run 1 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	399 / 400
schedule lag p50 / p99 / max	803 µs / 1,343 µs / 1,372 µs
due in window, never published	1
CPU user / sys per msg	2,456 µs / 451 µs
CPU (share of a core)	14.5 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 399 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

run 2 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	836 µs / 1,343 µs / 1,722 µs
due in window, never published	1
CPU user / sys per msg	2,525 µs / 425 µs
CPU (share of a core)	14.8 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.22 cores busy outside the client, peer and broker

run 3 · valid

client sent	499
client completed	499
broker received ($SYS)	499
broker sent ($SYS)	499
C sink received	499
in window: sent / delivered	400 / 400
schedule lag p50 / p99 / max	737 µs / 1,343 µs / 1,692 µs
due in window, never published	1
CPU user / sys per msg	2,525 µs / 400 µs
CPU (share of a core)	14.6 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 499 from the client; client sent 499, completed 499
broker_confirms_deliveries: broker sent 499; peer received 499
no_loss: client saw 499 completions; peer received 499
offered_rate_held: client published 400 of 400 offered in the window
payloads_intact: 0 of 499 payloads had an unexpected length
broker_headroom: broker used 0.09 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

7,209 µs

run 1 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 480
schedule lag p50 / p99 / max	737 µs / 1,343 µs / 1,427 µs
due in window, never published	1
CPU user / sys per msg	2,208 µs / 792 µs
CPU (share of a core)	18.0 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 2 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	480 / 480
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 1,465 µs
due in window, never published	1
CPU user / sys per msg	2,188 µs / 812 µs
CPU (share of a core)	18.0 %
threads	2

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 480 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.17 cores busy outside the client, peer and broker

run 3 · valid

client sent	599
client completed	599
broker received ($SYS)	599
broker sent ($SYS)	599
C sink received	599
in window: sent / delivered	479 / 480
schedule lag p50 / p99 / max	770 µs / 1,343 µs / 1,610 µs
due in window, never published	1
CPU user / sys per msg	2,067 µs / 919 µs
CPU (share of a core)	17.8 %
threads	3

worker_completed: worker reported its counts
peer_completed: peer reported its counts
broker_counters_read: fresh $SYS reading before and after the run
broker_confirms_client_publishes: broker received 599 from the client; client sent 599, completed 599
broker_confirms_deliveries: broker sent 599; peer received 599
no_loss: client saw 599 completions; peer received 599
offered_rate_held: client published 479 of 480 offered in the window
payloads_intact: 0 of 599 payloads had an unexpected length
broker_headroom: broker used 0.08 of its core
host_quiet: 0.18 cores busy outside the client, peer and broker

aiomqtt3 3.0.0a1 asyncio experimental

unsupported

Other points

sub_qos1_max — How many QoS 1 messages can the client receive per second?
pub_qos1_max_v5 — QoS 1 publish capacity over MQTT 5.
pub_qos1_max_16k — QoS 1 publish capacity with 16 KiB payloads.
rtt_qos0_fixed — Round trip at 1,000 req/s with QoS 0.