The .Config that applies to libraries is the one of the executing assembly using those libraries, so you don't have to add an App.Config to your project, it will use the App or Web.Config of your startup project.
In order to get access to the ConfigurationManager
you need to add a reference to System.Configuration
in your library project.