If they are coplanar, they are all on a plane in 3d, like this:
p = p0 + p1*s + p2*t
All the triangle vertices on this plane can be expressed as just s and t. You can pick p0 as one of the triangle vertices and p1 and p2 as edges of one triangle. Then solve for s and t for every p that is a triangle vertex. Then do the problem in 2d with s,t coordinates. Once you are done, you can just use the result s and t coordinate to go back to 3d.