Why doesn't the red dot shut down the program?

Question

If I use the red dot in the upper left of the last window of a program, why doesn't it shut the program down?

Except for rare programs that run without windows, what's the point of keeping programs running after all their windows are shut?