For convenience, I'll copy the sentence in question here:

 The one slightly left of you is called “The Red Dwarf Inn” the building looks as if abandoned. The brickwork missing a few pieces in places. But despite the look, the lights inside and the buzz of people suggest maybe the town is just not so keen on keeping appearances too tidy.

- "Slightly left of you" is really vague. After reading the post, I assume you mean, "in front of and to the left of you, across the street." I decided not to bring this up because you clearly know the layout of the town, so you will likely clear up my uncertainty about directions in your next post.
- "looks as if abandoned" could mean a few things. Either the building looks abandoned, or it looks as if it had been abandoned.
- "despite the look...suggest maybe the town...too tidy" is the main problem I had. As it is written, the Inn could have lights inside, but still be abandoned, whereas the town could have a buzz of people, suggesting that the town is well populated, but doesn't care about the upkeep of its buildings. It could also mean what you intended it to mean, that the inn had a buzz of people and lights within it, suggesting that despite how popular the Inn was, the keeper didn't really care about how the outside looked. 

You could argue that this text not contradict itself, but in many ways, it does. You have to read it, pick apart each piece, look at the grammar, and weigh each option carefully in order to be certain that the meaning of this text is, in fact, not implying that the Inn is abandoned and buzzing with activity at the same time. Had you worded it more clearly, "The Inn looked abandoned [b]at first glance,[/b] but the lights and activity within the Inn revealed the townsfolk's indifference towards tidiness," I would have gobbled it up like popcorn and moved right along. :3

You could also argue, as you did, that there are many reasons for the guards to be wearing a sword on the right side of their hip. I understand that you are highly creative, and that this argument could go either way, but the reason none of your propositions could work is quite simple: you didn't bring it up in your post. You just threw it out there without any extra information. The guards just had their swords on their right sides, for whatever reason. If you described said reason, or implied that there was a reason that this was the case, I would not have brought it up, because then it would be quite clear why you described it in that manner.

Also, holy cow, you are actually [b]the first[/b] person on the internet who has not rage-quitted a discussion with me as a result of my diction. [b]*applause*[/b] It's a miracle! [s]I'll put this in my diary[/s]

Shy, this is not a minor detail. This is the only description we have about the Inn. A minor detail would be the wind which messed with the guards' chainmail. I only waste such a [b]major[/b] chunk of my free time writing these comments so that we can avoid such mistakes in the future.