Perl change working directory of caller

Question

I want to write a perl script that changes its working directory to somewhere else, does something, and then leaves me in that directory after I call it from the shell. chdir only does the first part. How do I change the working directory of the caller?