I don't think you can specify the niceness of a particular Celery task as niceness is a property of the process. A task is simply some code that runs on a Celery worker.
However you can setup a Celery worker with a lower niceness and route maintanance tasks to that worker using Celery's task routing configuration.