Add this at the end of the execution of your command:
$spool = $this->mailer->getTransport()->getSpool();
$transport = $this->getContainer()->get('swiftmailer.transport.real');
$spool->flushQueue($transport);
You have to extend the ContainerAwareCommand
class to have access to the service container in your command.