i think that they should stay in there, since "timed" sports also have issues in a very similar way. just think of alpine skiing, someone decided to use hill X for the olympics. maybe its steeper, bumpier or longer than other hills. so some skiers have already a disadvantage because they are good gliders and the hill is to steep or they like to get in a rhythm and there are bumbs and changes all over the place. furthermore, some guy sets the course, adding another form of judgement.
same goes for biathlon (i cant believe you guys over there feeling nothing for that sport), crosscountry, nordic combination, ski jumping, etc...
rarely is a sport providing equal possibilites for anyone, in the winter olympics i can only think of speed skating. controlled environment and not regarding minor ice-differences, you can really say that the BEST guy at this date won.
bottom line: no sport goes without judgement in any way, so the obvious judged sports have no reason to be eliminated