The problem is you need to remove the PPA after that is done, you can simply install the original packages from ubuntu again. There is a Tool called ppa-purge
which does this exact thing. It's not installed by default so simply install it using:
$ sudo apt-get install ppa-purge
Then remove the PPA. All packages you installed from this PPA get removed too!
$ sudo ppa-purge ppa:ondrej/php5
Install the official packages from ubuntu again:
$ sudo apt-get install php5 # ... other PHP 5.3 stuff
You may wan't to remove ppa-purge
afterwards:
$ sudo apt-get remove ppa-purge