I always had that problem.
Basically just practise. You should be able to ski switch looking over either shoulder. You can just learn that by skiing switch a ton and forcing the look over your uncomfortable shoulder.
When I fixed this in my skiing, I simply forced myself to ski blue runs backwards top to bottom for an hour each time I went skiing.