Actually you are placing things in the wrong band it should be in the Summary Band. As the Column footer is meant to be footer at all the pages to the column so it will print on every single page.
But as per your requirement you need the totals at the end of the report so you can place all these elements which you have placed in the Column Footer in the Summary Band.
That should work for you.
Thanks.