I agrre with you that the Reputation can be used to "attack" someone (unfortunatelly, I've seen it).
But sometimes it is a good indicator if you're doing a bad/good job... I've seen cases that the person started with neg reputation (on the first posts), as he/she spamed and sometimes made posts with no usefull content, but he/she improved and today he/she has pos reputation.
So, the problem that is more complained here is about the unfair reputation. In this point we
maybe had to make an upgrade. People have said that we could make a system that new people doesn't get voted, or, the case here, to stop it. Just would like to remember that some people here don't get stressed with reputation.
I have to agree that people with good reputation (or not or none) in most cases come here to help or get helped. AND I would like to remember that we cannot make h´ppy all the people, so a neg rep (when is fair) is normal (now we're coming back to the unfair part).
So, in my opinion, it can be stoped the reputation system, but, if it continues (is that I belive that is going to hapen, as, if I'm not wrong it have been instaled for people interaction or something similar) no problem too.
Ohh... I was forgeting: maybe we could choose some people (the older ones here) to judge the reputation, but maybe it's difficult. Also, try to search on the forum, because posts with suggestions about the reputation have been made...
EDIT: But contacting an Adim. is good to when we need to make things fair... Have to agree with you again...