Try leaving your value, or setting up a calculated field that just uses =CDate(Fields!AverageTime.Value)
or =DateTime.Parse(Fields!AverageTime.Value)
Then, I assume you use that date field as a category on your graph. Set the format on the X axis to HH:mm as shown below. Let the graph handle the display using format strings, don't use the Format
function.