Beat the cream cheese, granulated sugar, and vanilla until completely smooth.

Lay an egg roll wrapper in a diamond orientation. Spread about 1 tablespoon of cream cheese mixture across the center, then top with about 1 1/2 tablespoons peach pie filling.

Fold the bottom corner over the filling, fold in both sides, and roll tightly. Moisten the top corner with water and press firmly to seal. Repeat with remaining wrappers.

Brush or spray all sides of each egg roll lightly with oil.

Arrange seam side down in a single layer in the air fryer basket, leaving space between each. Air fry 8 minutes, flipping at 5 minutes, until deep golden and crisp. Work in batches as needed.

Stir the granulated sugar and cinnamon together in a shallow dish. Brush the hot egg rolls with melted butter and roll immediately in the cinnamon sugar.

Whisk the powdered sugar, milk, and vanilla until smooth and drizzle over the egg rolls. Rest 5 minutes before serving.