pgbench (Postgres Benchmark)

Server specification

dual Intel(R) Xeon(TM) CPU 3.60GHz
8 GB RAM
Linux 2.6.10
Debian 3.0
140 GB RAID 1+0 storage array (where PGDATA resides); JFS
mirrored pair primary array (where WAL resides); ext3

We ran a complete series of tests using the default configuration file and then attempted to tune the configuration files based on best practices and conventional wisdom. For each version of PostgreSQL I've provided excerpts of the configuration files where configuration differs from the defaults for parameters that typically affect performance.

pgbench was initialized with the scaling factor shown in the output below. Otherwise, only the -c and -t options were used, also as shown in the output. The means and standard deviations for each output set refer to including and excluding establishing connections, respectively.

The mean tps and standard deviation were derived using a modified version of pgbench (7.4.7, 8.0.2). In each case, 16 iterations were performed.

An older version of this document with previous testing can be found here.

Default	Custom
scaling factor: 1 number of clients: 1 number of transactions per client: 1000
mean tps = 962.736320 standard deviation = 29.086186 mean tps = 964.750010 standard deviation = 29.187203	mean tps = 953.260669 standard deviation = 21.815866 mean tps = 955.205297 standard deviation = 21.901721	mean tps = 813.449004 standard deviation = 9.970749 mean tps = 815.130662 standard deviation = 10.015605	mean tps = 782.031602 standard deviation = 8.553368 mean tps = 783.640515 standard deviation = 8.567197
scaling factor: 1 number of clients: 1 number of transactions per client: 10000
mean tps = 754.651548 standard deviation = 55.605972 mean tps = 754.780396 standard deviation = 55.623768	mean tps = 731.888242 standard deviation = 86.161566 mean tps = 732.007517 standard deviation = 86.190329	mean tps = 648.031414 standard deviation = 47.744621 mean tps = 648.144800 standard deviation = 47.765723	mean tps = 692.136361 standard deviation = 72.189804 mean tps = 692.268843 standard deviation = 72.219163
scaling factor: 10 number of clients: 1 number of transactions per client: 1000
mean tps = 854.735562 standard deviation = 44.001954 mean tps = 856.322124 standard deviation = 44.139346	mean tps = 767.431864 standard deviation = 188.428087 mean tps = 768.769201 standard deviation = 188.906800	mean tps = 799.754210 standard deviation = 21.636130 mean tps = 801.391642 standard deviation = 21.715568	mean tps = 731.694843 standard deviation = 25.333766 mean tps = 733.110851 standard deviation = 25.432218
scaling factor: 10 number of clients: 1 number of transactions per client: 10000
mean tps = 763.375935 standard deviation = 33.593844 mean tps = 763.506686 standard deviation = 33.604290	mean tps = 500.750047 standard deviation = 25.816311 mean tps = 500.805977 standard deviation = 25.823476	mean tps = 762.773254 standard deviation = 50.898084 mean tps = 762.934966 standard deviation = 50.920482	mean tps = 741.568574 standard deviation = 46.721595 mean tps = 741.723654 standard deviation = 46.739633
scaling factor: 10 number of clients: 10 number of transactions per client: 1000
mean tps = 1229.821973 standard deviation = 97.525503 mean tps = 1232.855605 standard deviation = 98.049790	mean tps = 755.576707 standard deviation = 103.414956 mean tps = 756.748916 standard deviation = 103.749397	mean tps = 1255.842707 standard deviation = 123.810027 mean tps = 1259.820011 standard deviation = 124.519059	mean tps = 1307.793540 standard deviation = 108.549542 mean tps = 1312.325898 standard deviation = 109.202968
scaling factor: 10 number of clients: 10 number of transactions per client: 10000
mean tps = 660.484103 standard deviation = 142.643989 mean tps = 660.589455 standard deviation = 142.671919	mean tps = 568.936432 standard deviation = 59.662275 mean tps = 569.003330 standard deviation = 59.674979	mean tps = 805.540444 standard deviation = 307.536674 mean tps = 805.736407 standard deviation = 307.655595	mean tps = 987.550751 standard deviation = 101.364224 mean tps = 987.809025 standard deviation = 101.416701
scaling factor: 100 number of clients: 1 number of transactions per client: 1000
mean tps = 555.908418 standard deviation = 240.436292 mean tps = 556.726193 standard deviation = 241.057905	mean tps = 597.125856 standard deviation = 276.075116 mean tps = 598.081135 standard deviation = 276.678698	mean tps = 681.863024 standard deviation = 133.815933 mean tps = 683.119343 standard deviation = 134.124513	mean tps = 673.535169 standard deviation = 6.276083 mean tps = 674.764364 standard deviation = 6.302611
scaling factor: 100 number of clients: 1 number of transactions per client: 10000
mean tps = 421.267767 standard deviation = 25.599591 mean tps = 421.313688 standard deviation = 25.605839	mean tps = 376.349208 standard deviation = 28.443268 mean tps = 376.383249 standard deviation = 28.448940	mean tps = 467.896070 standard deviation = 189.202178 mean tps = 467.967930 standard deviation = 189.252647	mean tps = 452.126710 standard deviation = 184.444421 mean tps = 452.197909 standard deviation = 184.496927
scaling factor: 100 number of clients: 10 number of transactions per client: 1000
mean tps = 611.550012 standard deviation = 57.845445 mean tps = 612.293759 standard deviation = 57.984845	mean tps = 547.253691 standard deviation = 46.996599 mean tps = 547.868599 standard deviation = 47.089361	mean tps = 853.060159 standard deviation = 405.833183 mean tps = 855.234510 standard deviation = 407.516886	mean tps = 792.108344 standard deviation = 418.012036 mean tps = 794.211576 standard deviation = 419.872165
scaling factor: 100 number of clients: 10 number of transactions per client: 10000
mean tps = 477.634012 standard deviation = 8.837929 mean tps = 477.679859 standard deviation = 8.839355	mean tps = 458.476533 standard deviation = 7.153815 mean tps = 458.519379 standard deviation = 7.154913	mean tps = 514.394037 standard deviation = 12.722759 mean tps = 514.459692 standard deviation = 12.725900	mean tps = 498.797344 standard deviation = 13.715204 mean tps = 498.862975 standard deviation = 13.719599
scaling factor: 100 number of clients: 100 number of transactions per client: 1000
mean tps = 477.113876 standard deviation = 22.823954 mean tps = 477.557923 standard deviation = 22.864005	mean tps = 442.119135 standard deviation = 9.498558 mean tps = 442.502186 standard deviation = 9.514237	mean tps = 501.430803 standard deviation = 34.725833 mean tps = 502.044298 standard deviation = 34.810390	mean tps = 465.294982 standard deviation = 29.038351 mean tps = 465.857479 standard deviation = 29.110569
scaling factor: 100 number of clients: 100 number of transactions per client: 10000
mean tps = 248.580078 standard deviation = 10.233475 mean tps = 248.591916 standard deviation = 10.234535	mean tps = 209.251153 standard deviation = 12.360038 mean tps = 209.259792 standard deviation = 12.361087	mean tps = 353.439508 standard deviation = 21.345201 mean tps = 353.470424 standard deviation = 21.349105	mean tps = 343.424252 standard deviation = 19.799562 mean tps = 343.453805 standard deviation = 19.803211
scaling factor: 100 number of clients: 25 number of transactions per client: 1000
mean tps = 576.293783 standard deviation = 23.319332 mean tps = 576.942829 standard deviation = 23.370597	mean tps = 525.282367 standard deviation = 21.170633 mean tps = 525.833453 standard deviation = 21.216533	mean tps = 666.010195 standard deviation = 108.821857 mean tps = 667.135438 standard deviation = 109.133338	mean tps = 621.154547 standard deviation = 97.457609 mean tps = 622.182379 standard deviation = 97.752530
scaling factor: 100 number of clients: 25 number of transactions per client: 10000
mean tps = 403.184606 standard deviation = 13.202705 mean tps = 403.216734 standard deviation = 13.205383	mean tps = 396.556664 standard deviation = 13.155769 mean tps = 396.587811 standard deviation = 13.157821	mean tps = 474.941586 standard deviation = 12.800575 mean tps = 474.997241 standard deviation = 12.803560	mean tps = 460.827880 standard deviation = 10.495588 mean tps = 460.883263 standard deviation = 10.498199

Default

Custom

7.4.7

8.0.2

7.4.7 (postgresql.conf)

8.0.2 (postgresql.conf)

scaling factor: 1
number of clients: 1
number of transactions per client: 1000

mean tps = 962.736320
standard deviation = 29.086186

mean tps = 964.750010
standard deviation = 29.187203

mean tps = 953.260669
standard deviation = 21.815866

mean tps = 955.205297
standard deviation = 21.901721

mean tps = 813.449004
standard deviation = 9.970749

mean tps = 815.130662
standard deviation = 10.015605


mean tps = 782.031602
standard deviation = 8.553368

mean tps = 783.640515
standard deviation = 8.567197

scaling factor: 1
number of clients: 1
number of transactions per client: 10000

mean tps = 754.651548
standard deviation = 55.605972

mean tps = 754.780396
standard deviation = 55.623768

mean tps = 731.888242
standard deviation = 86.161566

mean tps = 732.007517
standard deviation = 86.190329

mean tps = 648.031414
standard deviation = 47.744621

mean tps = 648.144800
standard deviation = 47.765723

mean tps = 692.136361
standard deviation = 72.189804

mean tps = 692.268843
standard deviation = 72.219163

scaling factor: 10
number of clients: 1
number of transactions per client: 1000

mean tps = 854.735562
standard deviation = 44.001954

mean tps = 856.322124
standard deviation = 44.139346

mean tps = 767.431864
standard deviation = 188.428087

mean tps = 768.769201
standard deviation = 188.906800

mean tps = 799.754210
standard deviation = 21.636130

mean tps = 801.391642
standard deviation = 21.715568

mean tps = 731.694843
standard deviation = 25.333766

mean tps = 733.110851
standard deviation = 25.432218

scaling factor: 10
number of clients: 1
number of transactions per client: 10000

mean tps = 763.375935
standard deviation = 33.593844

mean tps = 763.506686
standard deviation = 33.604290

mean tps = 500.750047
standard deviation = 25.816311

mean tps = 500.805977
standard deviation = 25.823476


mean tps = 762.773254
standard deviation = 50.898084

mean tps = 762.934966
standard deviation = 50.920482

mean tps = 741.568574
standard deviation = 46.721595

mean tps = 741.723654
standard deviation = 46.739633

scaling factor: 10
number of clients: 10
number of transactions per client: 1000

mean tps = 1229.821973
standard deviation = 97.525503

mean tps = 1232.855605
standard deviation = 98.049790

mean tps = 755.576707
standard deviation = 103.414956

mean tps = 756.748916
standard deviation = 103.749397

mean tps = 1255.842707
standard deviation = 123.810027

mean tps = 1259.820011
standard deviation = 124.519059

mean tps = 1307.793540
standard deviation = 108.549542

mean tps = 1312.325898
standard deviation = 109.202968

scaling factor: 10
number of clients: 10
number of transactions per client: 10000

mean tps = 660.484103
standard deviation = 142.643989

mean tps = 660.589455
standard deviation = 142.671919

mean tps = 568.936432
standard deviation = 59.662275

mean tps = 569.003330
standard deviation = 59.674979


mean tps = 805.540444
standard deviation = 307.536674

mean tps = 805.736407
standard deviation = 307.655595

mean tps = 987.550751
standard deviation = 101.364224

mean tps = 987.809025
standard deviation = 101.416701

scaling factor: 100
number of clients: 1
number of transactions per client: 1000

mean tps = 555.908418
standard deviation = 240.436292

mean tps = 556.726193
standard deviation = 241.057905

mean tps = 597.125856
standard deviation = 276.075116

mean tps = 598.081135
standard deviation = 276.678698

mean tps = 681.863024
standard deviation = 133.815933

mean tps = 683.119343
standard deviation = 134.124513

mean tps = 673.535169
standard deviation = 6.276083

mean tps = 674.764364
standard deviation = 6.302611

scaling factor: 100
number of clients: 1
number of transactions per client: 10000

mean tps = 421.267767
standard deviation = 25.599591

mean tps = 421.313688
standard deviation = 25.605839

mean tps = 376.349208
standard deviation = 28.443268

mean tps = 376.383249
standard deviation = 28.448940


mean tps = 467.896070
standard deviation = 189.202178

mean tps = 467.967930
standard deviation = 189.252647

mean tps = 452.126710
standard deviation = 184.444421

mean tps = 452.197909
standard deviation = 184.496927

scaling factor: 100
number of clients: 10
number of transactions per client: 1000

mean tps = 611.550012
standard deviation = 57.845445

mean tps = 612.293759
standard deviation = 57.984845

mean tps = 547.253691
standard deviation = 46.996599

mean tps = 547.868599
standard deviation = 47.089361

mean tps = 853.060159
standard deviation = 405.833183

mean tps = 855.234510
standard deviation = 407.516886


mean tps = 792.108344
standard deviation = 418.012036

mean tps = 794.211576
standard deviation = 419.872165

scaling factor: 100
number of clients: 10
number of transactions per client: 10000

mean tps = 477.634012
standard deviation = 8.837929

mean tps = 477.679859
standard deviation = 8.839355

mean tps = 458.476533
standard deviation = 7.153815

mean tps = 458.519379
standard deviation = 7.154913

mean tps = 514.394037
standard deviation = 12.722759

mean tps = 514.459692
standard deviation = 12.725900

mean tps = 498.797344
standard deviation = 13.715204

mean tps = 498.862975
standard deviation = 13.719599

scaling factor: 100
number of clients: 100
number of transactions per client: 1000

mean tps = 477.113876
standard deviation = 22.823954

mean tps = 477.557923
standard deviation = 22.864005

mean tps = 442.119135
standard deviation = 9.498558

mean tps = 442.502186
standard deviation = 9.514237

mean tps = 501.430803
standard deviation = 34.725833

mean tps = 502.044298
standard deviation = 34.810390

mean tps = 465.294982
standard deviation = 29.038351

mean tps = 465.857479
standard deviation = 29.110569

scaling factor: 100
number of clients: 100
number of transactions per client: 10000

mean tps = 248.580078
standard deviation = 10.233475

mean tps = 248.591916
standard deviation = 10.234535

mean tps = 209.251153
standard deviation = 12.360038

mean tps = 209.259792
standard deviation = 12.361087


mean tps = 353.439508
standard deviation = 21.345201

mean tps = 353.470424
standard deviation = 21.349105

mean tps = 343.424252
standard deviation = 19.799562

mean tps = 343.453805
standard deviation = 19.803211

scaling factor: 100
number of clients: 25
number of transactions per client: 1000

mean tps = 576.293783
standard deviation = 23.319332

mean tps = 576.942829
standard deviation = 23.370597

mean tps = 525.282367
standard deviation = 21.170633

mean tps = 525.833453
standard deviation = 21.216533

mean tps = 666.010195
standard deviation = 108.821857

mean tps = 667.135438
standard deviation = 109.133338

mean tps = 621.154547
standard deviation = 97.457609

mean tps = 622.182379
standard deviation = 97.752530

scaling factor: 100
number of clients: 25
number of transactions per client: 10000

mean tps = 403.184606
standard deviation = 13.202705

mean tps = 403.216734
standard deviation = 13.205383

mean tps = 396.556664
standard deviation = 13.155769

mean tps = 396.587811
standard deviation = 13.157821


mean tps = 474.941586
standard deviation = 12.800575

mean tps = 474.997241
standard deviation = 12.803560

mean tps = 460.827880
standard deviation = 10.495588

mean tps = 460.883263
standard deviation = 10.498199

Download pgbench

Versions

pgbench (Postgres Benchmark)

Server specification