I wonder if I delete App.config file, then copy my application to other pc, is it have any strange behavior?
Nope, it should be fine. There are various (somewhat tortuous) rules about exactly what version of the CLR etc gets used in what situations, but for the most part you're fine to just rely on the default behaviour.
You really don't need an app.config
file unless you need to give specific settings.