He is politely but forcefully removed from the Palace, but he is allowed to go into the garden.
Abdul thinks "This is great! Note to self: have slaves build me a garden just like this at home."