Replying to Broken Collarbone

So I broke my collarbone about a week ago falling on my shoulder learning 270s on, and I'm going to Whistler March 12th... It basically doesn't even hurt anymore and I've been drinking tons of milk and taking it easy. A quick search gave me stories of people skiing anywhere from 4 weeks to 8 weeks. Do you guys think I'll be fine skiing groomers and pow 4 weeks after the break? I won't be hitting any park, so I think I should be fine, but I figured I'd get some extra opinions. Doctor's prognosis was 4-6 weeks.