Sigh... After digging around here for a while I found this answer:
https://stackoverflow.com/a/2275001/124536
That took me on the right path: The controller did not configure the cache_sweeper for this particular action which triggered the sweeper. Strange enough the sweeper was triggered anyway but just not working correctly.