In order to tour the Imperial Palace or Villa, you must first get a permission slip from the Imperial Household.
Amazingly, they gave Abdul permission.
The first tour is of the Imperial Palace and the tour guide speaks English. So Abdul knows that no one may enter the area past this gate...