You have to understand where the bootleneck is, look at CPU, RAM and HARD-DISK usage.
i'm really confident that is a HARD-DISK realted, as far as i know minecraft map can be really big. Also if your ram can't hadle all the map it will frequently swapped to disk, causing a lot of additional computing time