You can technically do either, but since the fragment manages the listview, you should set it there. Doing it through activity forces the activity to find the fragment first. It's a layer of indirection you don't need.
It also makes your fragment more modular, since the two pieces of code travel together now (it handles it's own adapter), if you decide to place the fragment in new activity class.