You can extract the p-values of the object returned by aov
with
pvalues <- summary(fit)[[1]][ , 5, drop = FALSE]
where fit <- aov(...)
.
Now, you can compare the p-values with a certain alpha level, e.g., 0.01:
pvalues < 0.01
This returns TRUE
or FALSE
.