The API you are looking at gives you ground level altitude based on a reference data set. It want be able to tell your on the second floor of a building. The best it will do is tell you is the altitude for the ground floor of the building.
If you want height above ground level then you could get something probably accurate to about +-0.5m on a phone with a pressure sensor but that would mean getting a reading at ground level and then at the level your interested in. There is a getAltitude(float,float) method you can use to get relative altitude at two points based off pressure readings. Without calibration the absolute altitude values will not be accurate but relative to each other they should be good. My testing shows I can see the difference just picking my xperia Active up off the desk with this setup with a bit of filtering on the raw pressure values.