Replying to Saga size dilemma

Maybe some of you can help me out. I am 5'6/5'7 and I have been wearing a medium saga anomie pb&j. I really like the length however I have pretty broad shoulders and a somewhat thick build so it is a little tight around the shoulders/back. I'm not sure if the large would be huge on me so I'm kinda torn on what to do. I like the look of the anomie but if there are other jackets that might fit better I'm open to suggestions. +k for helping