With Drupal and other similar software it's a good idea to debug performance problems by disabling modules one by one until performance improves. It could be there's a serious cpu hog module in there, 5 seconds is a fairly long time though, are there any modules that are accessing external APIs? A slow network call could easily account for a 5s delay.
_________________
Paid supportHow to ask for help
1. Give details of your problem
2. Post any errors
3. Post relevant logs.
4. Don't hide details i.e. your domain, it just makes things harder
5. Be polite or you'll be eaten by a grue