Both the ViewAction and the TrackAction are currently represented in Gmail with a similar button, so users won't see any difference at this time, but you should always adopt the highest-fidelity schema for your use case, so that future changes in the UI will provide users with a better experience.
In the case of parcel deliveries, you should not only set the "trackingUrl" property, but also include the other properties you mentioned ("deliveryAddress", "expectedArrivalUntil", "carrier", "itemShipped", "partOfOrder", ...) to describe the transaction.
You can check an example of such markup at https://developers.google.com/gmail/actions/reference/parcel-delivery