The mutex lives as long as there exist handles to it. When the last handle to the mutex is closed, the mutex dies. In that regard it is no different from any other object that can be shared across multiple processes.
The documentation for CreateMutex
says it like this:
The mutex object is destroyed when its last handle has been closed.