The short answer is that as the storage gets larger, a copy takes 4 times as long, but happens only 1/4th as often. The 4 and 1/4th cancel so you end up with (amortized) constant time.
Ignoring the precise factor you've chosen, in the long term you get O(N * 1/N) = O(1) -> amortized constant time.