From documentation of Active Reputation System:
Let's say we want to keep track of user karma in Q&A site where user karma is sum of questioning skill and answering skill. Questioning skill is sum of votes for user's questions and Answering skill is sum of average rating of user's answers.
looks to me like it describes exactly your case. I would go with this and probably would use merit gem too to have badges at some point for user.