Preheat the oven to 350 degrees F. Line 2 baking sheets with parchment paper.
In a medium bowl, whisk together the flour, baking powder, baking soda, salt, ginger, cinnamon, cardamom, cloves, allspice, and pepper.
To the large bowl of a stand mixer, add the sugar, cream cheese, and butter. Beat until light and fluffy, about 1 minute. Add the oil and beat until incorporated. next, add the egg, milk, and vanilla. Continue to beat until smooth. In 2 additions, add the flour mixture, being sure to scrape down the sides of the bowl in between, until just mixed.