ItemGroups are cummulative. Each time an item group if referenced, items are added to the existing group. If you want to have explicit groups, you either need to give them a unique name or you need to clear them before usage.
Use <DeployFiles Remove="**/*">