So to fix this I did end up negating all of the time stamps so that the new data would "enter" the graph on the left and move to the right as it got older.
Then to create the sliding window effect I removed the oldest point in the graph for every point that I added.
Another unforeseen issue was that the GraphPane
by default would add some padding in front of and behind the min and max points, so to fix this I found the minimum and maximum points in my curve and set the dimensions of the axis' scales to that.