"Taxonomy" by SP's definition is having terms defined in a hierarchical manor, similar to biological classifications (http://en.wikipedia.org/wiki/Biological_classification).
The benefit to a hierarchical taxonomy is that when it's applied to metadata, you can restrict the choices to specific sections, and when filtering data your results can be inclusive of child terms.
Synonyms only apply to the terms within your taxonomy.