I don't think CUDA is really much use for computional algebraic/general topology. Sure, you can use it to mess around with homology groups etc., but that's rather algebra than topology, which itself tends to be too abstract/"dynamic" to really benefit from SIMD. If you don't have a clear idea, I'd first try some CPU implementations and only port to CUDA as a later optimisation.
Anyway, what you describe sounds rather like you're mainly interested in creating visual representations of topological spaces, i.e. in giving concrete embeddings T → ℝ³. That's rather in the realm of differential topology, which I reckon could quite well make use of gpgpu processing. However for the final "visualisation step", you want to use something more specific; openGL + GLUT is fine. You can use that from many languages, I'd recommend Haskell (undisputedly great for everything mathematical), but C or C++ is of course closer to the library, you will find more examples and can easier get CUDA in.