one side of the brake or both "prongs" of the brake?
if its both prongs, the definite answer would be yes.
if its only one prong, you would get some saying yes, but you would probably be fine as your careful, however if it does come off and doesn't catch, the ski will be gone and its out of your control what happens next, seem skis hit jumps in the park, pretty dangerous