Mix banana pudding according to the package instructions and set aside.
In a large bowl, combine flour, sugar, baking powder, and salt.
Whisk these dry ingredients together.
Add buttermilk, oil, and egg to the dry mixture.
Stir until the batter is smooth and free of lumps.
Heat a non-stick skillet over medium heat.
Pour 1/4 cup of batter onto the skillet for each pancake.
Cook until bubbles appear on the surface, then flip and cook the other side until golden.
To assemble, place one pancake on a plate.
Spread about 1/4 cup of banana pudding on it.
Add 4-5 banana slices on top, then drizzle with caramel sauce.
Repeat the layers and finish with whipped cream if desired.