Found it.
You have to add each framework to your test target that is needed. In my case, I needed to add:
CoreLocation.framework
AssetsLibrary.framework
CoreGraphics.framework
MobileCoreServices.framework
After that, the unit tests failed as expected.