Although the pagoda has the same number of floors as Tento's house, the later pales in comparison when it comes to the space occupied. Each floor is the size of a major soccer stadium in the reader's world, making the pagoda appear like a tower. The first floor is where all the non-violent gambling activities happen: the space is protected by 2-Star Bushi and Madoshi Tama-Artists; picking a fight would be announcing a fight against the Katsuragi-rin clan, a subsidiary clan of the Katsuragi clan.
The second floor, however, is less guarded, because it's where fight gambling starts. For one to participate in the upper floors, they have to complete the two task on this floor. That being said, it's easier for a camel to fit through a needle than advance through the first stage.
