Do I need to include it in the installer and put near the exe file on the target computer?
Yes. This file needs to exist next to the installed exe post-deployment.
Most installers that understand .NET deployment will automatically handle this for you, so it's likely you won't need to "do" anything special (other than verify it got copied across correctly.)