Your logic is flawed in several ways, the first of which is that you are arguing with someone's ghost story on the internet, which is retarded because ghost stories are fun and entertaining and you're being a turd in the punchbowl. The second reason is that saying "X isn't real because X is impossible" is a flawed argument, even if the conclusion happens to be true. To make a deductive argument to prove that ghosts don't exist because they are physically impossible, you would have to have a perfect knowledge of physics. You, nor anyone else on this planet, has that. Before Einstein, people probably thought that changing time based on motion or proximity to massive objects probably wasn't possible, because there was no physics to explain it.
All that being said, I happen to agree that ghosts (and god) probably aren't real, but not because I have deemed them "impossible." The reason that I don't think these things exist, is because there is not sufficient high quality evidence to show that they do. I don't think that OP is actually experiencing ghosts, but calling him a small minded idiot for believing in something that is "physically impossible" smacks of the Europeans who thought Columbus would sail of the edge of the earth because they didn't understand gravity and a round earth.
Anyway.....