The solution is quite simple ...
PDO connecting to localhost -> 1 second
PDO connecting to 127.0.0.1 -> 50 miliseconds...
dont aks me why ... seems to have something to do with try & wait for ipv6 connection, then fall back to good old ipv4 ... the ipv4 adresse does not try ipv6 ...