My config
Bundle product - simple product - simple product - simple product - etc
The simple products has the filterable attribute.
Solution: Add the filterable attributes to the bundle product and leave them empty. I'm surprised that this worked out. :?