Turns out almost everyone treats this data as propritary. There isn't a way to get it from google or the like.
However, there are shapefiles you can download that have a lot of the data. post codes, zip codes, counties, etc. But then you have to deal with the complexity of shapefiles.
mapbox & OpenStreetMap have some polygon lookup facilities as well.