I would wholeheartedly recommend a stay at Carberry Tower if you are looking to get far from the madding crowds. This beautiful country house hotel is set in magnificent grounds and is just stunning, both inside and out. My wife and I travelled through to go to Musselburgh races and stayed here for the night. The Gamekeepers breakfast was delicious.
The best part was, it is very reasonably priced. If you are visiting Edinburgh and have your own transport, stay here instead of the city centre.