La Granja of San Ildefonso is a quiet and calm small town located on the northern foot of the Guadarrama Mountains. La Granja has a variety of places to eat, sleep and shop that you will enjoy exploring. It is very near Madrid about a 50-minute drive no matter which way you go through and a 7 minute drive from Segovia. You can go by bus or train; with a first stopover in Segovia and then taking a local bus towards the site. However, the quickest and easiest way to get there is by car.
The most famous and important attraction to visit is The Royal Palace of La Granja of San Ildefonso and its gardens. However, the Glass and Tapestry Museums are worth taking a look. I personally enjoy walking around the town and breathing the fresh air coming from the mountains. These days there are plenty of different places to eat and for all budgets. Recently I tried Casa Zaca Restaurant and had a very pleasant experience. Moreover, I stayed at the new hotel Parador of La Granja and took some pictures since the building was also part of the Royal Site.
La Granja is an excellent example of a small traditional Castilian town that has great things to offer to its visitors. If you have time on your busy travel schedule when you come to Madrid, driving to La Granja for a couple of days will definitely charge your batteries and relax you.