You're looking for the Convex Hull of the points. There are many viable algorithms for finding the hull; see wikipedia, for example.
Find which points are vertices of polygon
Question
I have points of polygon, some of the points are inside the polygon and some points are the vertices of this polygon. How can I know how many vertices this polygon has and which points are the vertices?
Solution
Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow