Look at this answer I recently gave: Do Drupal websites have bad performance or are heavy?Do Drupal websites have bad performance or are heavy? In short you might need to tune MySQL a little bit. What does SHOW VARIABLES LIKE 'innodb_buffer_pool_size'
say?