Check out the new USENIX Web site. next up previous
Next: Conclusions and Future work Up: Performance Evaluation Previous: Mkbench Evaluation

Chat Evaluation

The Chat benchmark was run for three different configurations ranging from 10 rooms, 100 messages per user to 30 rooms, 300 messages. For brevity, these configurations are labelled (10,100), (20,200) and (30,300) where the first number refers to the number of rooms and the second one refers to the number of messages.


Table 6: PMQS as compared to MQS,DSS for Chat on a 4x4-way NUMA system.
Scheduler (10,100) (20,200) (30,300)
DSS -63.92 -74.95 -79.26
Poolsize=4
LBOFF -27.59 -50.29 -53.70
IP -39.05 -53.62 -59.29
LBP-45 0.65 -15.26 -25.34
LBP-10 -13.92 -18.38 -19.25
LBC -1.14 -9.54 -4.41
Poolsize=8
LBOFF -7.55 -40.64 -51.32
IP -27.38 -40.98 -47.15
LBP-45 -16.32 -30.18 -25.74
LBP-10 2.76 -14.85 -14.27
LBC -3.27 -0.66 -0.23
Poolsize=16
LBC -1.42 -2.44 -4.62


The results for the 4x4-way NUMA system with poolsize 4, 8 and 16 are shown in Table 6. MQS improves over DSS between 277% and 482% for this scheduler intensive benchmark. For PMQS, in general we observe the almost inverse behavior when comparing Chat and Mkbench. Here, all PMQS versions either substantially underperform MQS or break even. The higher the load, the worse the performance degradation. Increasing the poolsize also increases the performance for all PMQS but LBP-45. The reason for this is that Chat has, due to the send/recv interactions between threads, rapidly changing runqueue lengths, which then trigger load balancing as observed in Figures 4-6. It is likely that the frequent load balancing leads to continuously moving tasks, often before they get a chance to run. Investigating this aspect is part of our future work.

We now turn our attention to the SMP case to answer the question whether pooling within an SMP provides benefits. The results are shown in Table 7. With the exception of LBC at very high load, PMQS substantially underperforms MQS. PMQS still outperforms DSS. Two general trends can be observed within each category. Performance increases for any given load and LB algorithm with increasing the poolsize and performance increases with load.


Table 7: PMQS as compared to MQS,DSS for Chat on an 8-way SMP system.
PoolSize (10,100) (20,200) (30,300)
DSS
N/A -44.03 -73.90 -81.97
LBOFF
1 -50.54 -49.98 -47.17
2 -34.43 -42.67 -44.68
4 -24.98 -10.63 -11.50
8 -16.17 -5.65 -6.90
IP
1 -49.19 -53.84 -48.43
2 -34.59 -41.88 -43.84
4 -17.90 -15.09 -10.91
8 -16.80 -9.01 -8.22
LBP-45
1 -39.51 -25.90 -13.98
2 -28.31 -14.98 -2.88
4 -12.38 -3.66 -2.53
8 -14.79 -6.20 -5.98
LBP-10
1 -35.17 -11.18 -14.73
2 -30.70 -8.64 -1.29
4 -20.34 -5.88 -1.09
8 -12.85 -5.09 -7.75
LBC
1 -31.08 -13.90 -0.52
2 -29.06 -7.06 3.36
4 -19.95 -4.45 2.83
8 -16.00 4.22 8.31



next up previous
Next: Conclusions and Future work Up: Performance Evaluation Previous: Mkbench Evaluation
2001-09-18