For the most part, buildings act as impassable terrain. That said, units are allowed to enter buildings and 'garrison' them.