Get the nice house. You might not like the neighbors but you can hide from them in a nice house.
Wait, if you get the recluse house, you won't have neighbors, and you could always update the house slowly until it's nice.
Wait, over time, others will probably move next to you and it will no longer be a recluse house, so you'll be stuck with neighbors AND a less nice house.
Wait, they say fences make good neighbors so, if you get the nice house and then put up a fence....