Preheat the oven to 375°F.
In a medium bowl, stir together flour, baking powder, baking soda, and salt. Set aside.
In the base of a stand mixer or with a hand mixer, cream together the room temperature butter and sugar on medium-high speed for 2 minutes until light and fluffy.
Add the egg, vanilla extract, and almond extract. Beat for another 2 minutes on medium-high speed until light and fluffy.
Reduce the mixer speed to low and alternate adding the buttermilk and flour mixture, starting and ending with the dry ingredients. Do this in the following order: 1/3 of the dry ingredients, 1/2 of the buttermilk, 1/3 of the dry ingredients, remaining buttermilk, remaining dry ingredients. Mix just until combined after each addition, being careful not to overmix.
Spread the batter evenly in a 9x9-inch glass pan lined with parchment paper and sprayed with cooking spray.
Top the batter with the cherry layer, followed by the brown sugar crumble.
Bake for 45-55 minutes, or until a toothpick comes out clean.