The kitchen garden is located to the southeast of your main workplace and house. A sign here will show that the tavern keeper will give you permission if you talk to him. He'll tell you that the Merchant seized the land, but you're fine to use it if you talk to him about it as well as give you the permission slip. Using the slip at the building bench of the garden gives you the trophy and access to growing your own crops here.