ALTER TABLE TableWithManyRows
ADD TestNull INT NULL;
Does nothing to the table's records
ALTER TABLE TableWithManyRows
ADD TestWithValues INT NOT NULL DEFAULT 0 WITH VALUES;
Updates every record for that column to a value of 0. With a large amount of data this will take time.
Not a lot you can do about that if that is your business rule.