If all domains and subdomains should have HTTPS, your best move is to deploy a SSL certificate for those domains/subdomains in the ELB and configure SSL termination at it. That being said, you are able to add multiple SANs (Subject Alternative Names) to your SSL certificates, making your ELB respond to multiple domains/subdomains over HTTPS.
This way, the traffic between your ELBs and your instances won't be over HTTPS, but you said that is not a problem. Actually, this is pretty much the default configuration on ELBs when HTTPS is needed.