Assuming you know the size, you can insert a range:
vector.insert(vector.end(), buffer, buffer + size);
There's also a more generic algorithm for this sort of thing:
#include <iterator>
#include <algorithm>
std::copy(buffer, buffer + size, std::back_inserter(vector));