Your mouse and keyboard control the camera, not objects in the scene (by default at least). This makes a lot more sense when there is more than one object in the scene, a street for example.
When you press up you move the camera upwards; as a result all objects in the scene appear to go downwards. The same for all the other directions