Yes, you can.
The only breaking change I've encountered so far is in debugging - the debugger interfaces changed in 4.5, which can be tricky if you're trying to debug process dumps. It's not an issue if you use the latest Visual Studio (or just use WinDbg, although that certainly isn't for everyone) and copy the framework directory from the computer that had the error, but it's very annoying.