An abstract class can, with care, be extended in a non-breaking manner; all changes to an interface are breaking changes.
Update:
In contrast, an interface can be an in or out type-parameter and an abstract class cannot. Sometimes one or the other is more appropriate for a given design, and sometimes it is a toss-up.