Mathias Ball

DSBENCH ARTICLE RELEASED

  • It's done! After nearly 2 years we finished compiling the results collected with DSBENCH-marking several servers and desktops.
  • Abstract: To find means to qualify arbitrary computers regarding their capability to act as a database server we perform a large number of tests to understand which characteristics of a computer system influence the performance most. We qualify performance by measuring storage system throughput and by extensively testing the system with a self--developed TPC-B like performance benchmark program called DSBENCH. Benchmarking produces a number of characteristic diagrams for a system as well as a single qualifying performance indicator (DSI) which we demonstrate to be useful to compare system performance easily.

Some conclusions regarding DSBENCH

  • DSBENCH is able to test PostgreSQL and Firebird database servers with both SELECT and standard TPC-B strategies.
  • Transactions are implemented as PSQL database functions. This turned out to be a performance gain compared to pgbench which realizes transactions as a set of primitive SQL commands.
  • A single DSBENCH run makes a comprehensive test by varying the database size, by acquiring all transaction residence times as well as CPU and IO load data. It writes result tables and diagrams that also contain a detailed residence time frequency distribution analysis. Load data and statistics help to identify the influence of the system stack layers to the overall performance. For quick comparison of plenty systems a single digit (logarithmically scaled) performance index DSI is calculated from the transaction rate function.
  • DSBENCH can also disclose network related bottlenecks by simultaneously stress testing a database server from many remote clients.

Download-Link:

The full paper including appendix, ca. 50 MB.
The paper without appendix, ca. 1.4 MB.

DSBENCH released!

New Benchmark for Database Systems now available

Rajko Thon

DSBENCH in a Nutshell

  • DSBENCH is a new (as of 2016) cross-platform, cross-database benchmark which assesses the capability of a computer to act as a server for relational database systems
  • DSBENCH uses a "TPC-like" benchmark profile; its model is based on the technical parts of the TPC-B specification.
    DSBENCH is, however, NOT in any way certified by or related to the Transaction Processing Performance Council (TPC) and does not claim to produce results compatible with TPC-B.
  • DSBENCH or the DSBENCH-site is not related to other tools with similar names. The solely focus of the DSBENCH software package as published on this website is on benchmarking database systems.
  • DSBENCH is easy to use and determines a characteristic performance profile as well as a performance indicator (DSI)
  • DSBENCH can be used locally on the system to be tested or to orchestrate a number of remote nodes (machines) which access the server simultaneously from a local network
  • DSBENCH is written in Python 3 and runs on Linux and Windows with Firebird and PostgreSQL as databases
  • DSBENCH is free software and is published under GPL V3 license

Download-Links (Version 1.1.9):

TAR-Archiv for Linux
ZIP-Archiv for Windows

For questions feel free to contact us at: