A house can be cooler than others in the same place if it has a fire place and chimney. Cool air is heavier than hot air. If it is cooler outside than inside, hot air escapes through the chimney and cool air enters from outside. If however it is cooler inside than out side no air will escape through the chimney.
