Preheat the oven to 350°F and line a standard cupcake pan with 12 cupcake liners.
In a large bowl, cream together the butter and sugar until light and fluffy.
Add the egg, egg yolk, and vanilla extract, mixing until smooth.
Mix in the milk, sour cream, and pumpkin puree until well combined.
In a separate bowl, whisk together the sifted flour, cocoa powder, pumpkin pie spice, baking powder, baking soda, and salt.
Gradually add the dry ingredients to the wet ingredients, mixing until smooth.
Divide the batter evenly among the cupcake liners and bake for 17-19 minutes.
Let the cupcakes cool in the pan for 5 minutes before transferring them to a cooling rack to cool completely.