Replying to Facebook is logging my gps locations

Got on Facebook and they have a new thing suggesting I rate things. They are all very specific places that I have been. I thought, maybe they are places I uploaded photos. Nope. Maybe places I just took photos. Nope. Recent places. Nope.
I have an iPhone 5s (meaning it's not possible to be over a year old yet). They are suggesting specific restaurants that I have been to on vacations years ago. I never use the check in feature and I rarely post to my Facebook account as it is.
I know Facebook it notoriously bad for infringing on privacy, but logging my gps locations on all of my different phones is crazy. I even switched carriers this year.