Scalability of database bulk insertion with multi-threading

Abstract

The advancement of multicore processors and database technologies have enable database insertion to be implemented concurrently via multithreading programming. In this work, we evaluate the performance of using multithreading technique to perform database insertion of large data set with known size. The performance evaluation includes techniques such as using single database connection, multithreads the insertion process with respective database connections, single threaded bulk insertion and multithreaded bulk insertion. MySQL 5.2 and SQL Server 2008 were used and the experimental results show that larger datasets bulk insertion of both databases can drastically be improved with multithreading. © 2011 Springer-Verlag.