Your approach is fine. If you prefer to use more built-in BitSet methods, you can clone the first bit set and do a logical AND with the second then check for equality with the second.
private static boolean containsAll(BitSet s1, BitSet s2) {
BitSet intersection = (BitSet) s1.clone();
intersection.and(b2);
return intersection.equals(s2)
}