In a large bowl, beat egg, oil, brown sugar, pumpkin puree, and milk until combined. Add dry ingredients to pumpkin mixture. Stir until well combined.
Pour half batter into prepared pan. Then pour cream cheese mixture over pumpkin batter followed by the remaining batter over the cream cheese mixture. Swirl with a butter knife. Then gently tap the pan on the counter several times.
Bake in preheated oven for 1 hour or until a wooden toothpick inserted near the center comes out clean. For high altitude, bake for 50 minutes.
Cool in pan for 10 minutes, remove and allow pumpkin bread to cool completely on a wire rack before slicing.