This page last changed on Feb 17, 2010 by aaime.

References

See http://wiki.osgeo.org/wiki/Benchmarking_2009

Observations

Between GS 1.7.0 and GS 2.0 there were some significant improvements:

  • SDE got significantly faster
  • Oracle one improved as well
  • Labelling got faster, despite 1.7.0 not supporting the more expensive curved labels

However, GS 2.0 was benchmarked by mistake with a high PNG compression ratio compared to GS 1.7.0 and MapServer, resulting in generally weaker results in many tests.

FOSS4G 2009 - edges merge

Big simple line shapefile with cased line rendering and multiple road classes. 1:10k to 1:100k scales, random screen sized requests.

Shapefiles

  1 10 20 40
MS 5.6b3 fcgi 8.2 17.1 16.8 17.6
GS 1.7.0 7.9 15.1 12.6 14.6
GS 2.0.0 7.6 15 13.1 15.1
GS 2.0.1 8.4 16.4 14.2 16.2

PostGIS

  1 10 20 40
MS 5.6b3 fcgi 6.6 15.8 15.1 16.4
GS 1.7.0 9.0 19.1 16.6 18.1
GS 2.0.0 7.2 16.3 14.8 16.6
GS 2.0.1 7.9 18.3 16.3 18.5

Oracle

  1 10 20 40
MS 5.6b3 fcgi 5.6 12.6 11.6 12.8
GS 1.7.0 5.3 16.1 13.9 15.7
GS 2.0.0 5.9 12.5 11.5 12.7
GS 2.0.1 6.7 13.7 11.3 13.5

SDE
(GeoServer 2.0.x results not available since the SDE license expired)

  1 10 20 40
MS 5.6b3 fcgi 4.7 11.1 9.7 11
GS 1.7.0 4.3 5.9 4.8 5.6
GS 2.0.0 6.1 13.3 11.6 13

FOSS4G 2009 - edges merge labelled

Big simple line shapefile with cased line rendering and multiple road classes and labels following lines where supported (the only one not supporting them is GS 1.7.0). 1:3k to 1:10k scales, random screen sized requests.

Shapefile

  1 10 20 40
MS 5.6b3 fcgi 8.2 17.1 16.8 17.6
GS 1.7.0 4.9 10.6 11.1 10.9
GS 2.0.0 6.3 13.4 13.9 13.2
GS 2.0.1 9 14.7 15.2 15

PostGIS

  1 10 20 40
MS 5.6b3 fcgi 8 18.6 19.4 19.1
GS 1.7.0 5.6 10.7 11.1 11.0
GS 2.0.0 6.6 14.3 14.9 14.7
GS 2.0.1 7.1 16.2 15.6 16.5

Oracle

  1 10 20 40
MS 5.6b3 fcgi 6.8 16.8 17.5 17.3
GS 1.7.0 4.0 10.2 10.8 10.7
GS 2.0.0 6 13.2 13.9 13.5
GS 2.0.1 6.5 14.6 15.1 14.9

SDE
(GeoServer 2.0.x results not available since the SDE license expired)

  1 10 20 40
MS 5.6b3 fcgi 6.4 16.4 17.4 17.2
GS 1.7.0 3.9 7.4 7.7 7.7
GS 2.0.0 5.6 12.8 13.3 13.1

FOSS4G 2009 - areawater

Relatively big polygon layer, simple solid fill rendering. 10k to 100k scales, random screen sized requests.

Shapefile

  1 10 20 40
MS 5.6b3 fcgi 12 25.8 26.2 26.8
GS 1.7.0 13.3 31.2 32.2 30.9
GS 2.0.0 11 25 25.2 25.1
GS 2.0.1 12.8 30 31.2 30.4

PostGIS

  1 10 20 40
MS 5.6b3 fcgi 10.1 23.7 24.2 24.5
GS 1.7.0 12.9 30.8 31.0 31.6
GS 2.0.0 10.7 24.4 25.2 25.7
GS 2.0.1 12.4 30.6 31.3 32.7

Oracle

  1 10 20 40
MS 5.6b3 fcgi 9.2 21.1 21.7 22
GS 1.7.0 6.8 22.7 22.4 22.7
GS 2.0.0 10.2 23.1 23.8 23
GS 2.0.1 12 29.5 29.7 29.4

SDE
(GeoServer 2.0.x results not available since the SDE license expired)

  1 10 20 40
MS 5.6b3 fcgi 8.9 22.3 23.2 23.6
GS 1.7.0 8.4 15.5 15.2 15.9
GS 2.0.0 9.5 23.3 23.6 23.3

FOSS4G 2009 - GNIS 2009

Relatively small point layer, a dozen different icons used to depict different point classes. 10k to 100k scales, random screen sized requests.

Shapefile

  1 10 20 40
MS 5.6b3 fcgi 12.2 26.5 26.6 27.1
GS 1.7.0 13.1 32.8 32.9 33.7
GS 2.0.0 9.3 24.3 25 25.2
GS 2.0.1 12.9 30.6 31 30.2

PostGIS

  1 10 20 40
MS 5.6b3 fcgi 10.8 24.3 24.6 25
GS 1.7.0 12.9 30.5 30.8 30.9
GS 2.0.0 11 25.1 25.3 25.8
GS 2.0.1 12.8 30.8 32.3 32.7

Oracle

  1 10 20 40
MS 5.6b3 fcgi 9.8 23.3 23.4 23.9
GS 1.7.0 7.0 22.7 23.2 23.2
GS 2.0.0 10.5 25 25.2 24.6
GS 2.0.1 12.4 30.6 29.1 32.5

SDE
(GeoServer 2.0.x results not available since the SDE license expired)

  1 10 20 40
MS 5.6b3 fcgi 9.6 23.6 23.9 24.5
GS 1.7.0 9.7 22.3 21.5 22.8
GS 2.0.0 10.1 24.5 24.6 23.9

FOSS4G 2009 - Bluemarble TNG

Relatively big raster layer, 21600x21600, in ECW, Mosaic of 512 GeoTiff files, Mosaic of 8 GeoTiff files (GS only) and single BigTiff (MapServer only). Mosaics are 16GB each.

ECW

  1 10 20 40
MS 5.6b3 fcgi 7.4 20 19.8 19.1
GS 1.7 n.a. n.a. n.a. n.a.
GS 2.0.0 5 11.1 11.2 10.5
GS 2.0.1 5.7 12.3 12.5 11.7

512 tiles mosaic (16GB)

  1 10 20 40
MS 5.6b3 fcgi 6.5 14.9 16.4 16.9
GS 1.7 n.a. n.a. n.a. n.a.
GS 2.0.0 4.8 9.7 9.6 9.9
GS 2.0.1 5.2 10.2 10.6 11.1

8 files mosaic (16GB) for GeoServer, single BigTIFF (16GB) for MapServer

  1 10 20 40
MS 5.6b3 fcgi 11.1 26.9 28.1 27.3
GS 1.7 n.a. n.a. n.a. n.a.
GS 2.0.0 6.4 13.7 13.3 13.6
GS 2.0.1 7.4 15.3 14.8 15.2
Document generated by Confluence on May 14, 2014 23:00