Here's what I did, (thx @Blender)
Exported the Latex file to html using tex4ht (texmaker) and used pandoc to convert the html file to reStructuresText, and edited that .rst to fit the specifications of sphinx. This was needed since I wanted to break the latex file to few different HTML files.
Then used sphinx to generate the PDF file. I think I'm going to keep writing in .rst, so it's easy to convert both to HTML, and PDF.
Adding the answer so anyone having the same problem will get some ideas.