Online Algorithm for Standard Deviation Proof [closed]

Question

It's difficult to tell what is being asked here. This question is ambiguous, vague, incomplete, overly broad, or rhetorical and cannot be reasonably answered in its current form. For help clarifying this question so that it can be reopened, visit the help center.

Closed 8 years ago.

I saw this algorithm in an answer to this question.

Does this correctly calculate standard deviation? Can someone walk me through why this works mathematically? Preferably working back from this formula:

public class Statistics {

    private int n;
    private double sum;
    private double sumsq;

    public void reset() {
        this.n = 0;
        this.sum = 0.0;
        this.sumsq = 0.0;
    }

    public synchronized void addValue(double x) {
        ++this.n;
        this.sum += x;
        this.sumsq += x*x;
    }

    public synchronized double calculateMean() {
        double mean = 0.0;
        if (this.n > 0) {
            mean = this.sum/this.n;
        }
        return mean;
    }

    public synchronized double calculateStandardDeviation() {
        double deviation = 0.0;
        if (this.n > 1) {
            deviation = Math.sqrt((this.sumsq - this.sum*this.sum/this.n)/(this.n-1));
        }
        return deviation;
    }
}

Answer 1

There is a proof on wikipedia at the start of the section I linked to.

By the way, I remember from somewhere that calculating this way can produce more error. As you can see this.sumsq can become huge. Whereas calculating the normal way always has smaller intermediate values.

Anyway, I do use this online calculation a lot, because most of the time error didn't matter that much.

Answer 2

I believe population standard deviation would substitute N-1 for N in that formula, because there's one degree of freedom less when the mean is given. I'm not a statistician, so I don't have the proof.

The formula is correct - standard deviation is the square root of the mean variance.