I would strongly suggest to create a new Portable Class Library instead of a Class Library. Theese PCLs can then be used in Windows Phone 8.1 and Windows 8.1 Projects.
If the Library worked on Windows Phone 8, you should be able to simply copy over the code from the Class Library to the PCL.