Grease an 11x6 loaf pan and preheat the oven to 350°F.
In a food processor, combine lemon zest and sugar; process for 30 seconds.
In a stand mixer, cream together softened butter and lemon sugar mixture until light and fluffy (3-5 minutes).
Add vanilla and lemon extract. With the mixer on low, add eggs one at a time and the lemon juice.
Mix in flour, baking soda, baking powder, and salt on low speed.
Slowly pour in buttermilk and mix until everything is incorporated.
Pour the batter into the prepared pan and bake for 40-45 minutes or until fully baked through.