Line 2 baking sheets or one large baking sheet used in batches with parchment paper. In a small bowl, stir together the brown sugar and cinnamon. In another small bowl, whisk the egg with the water to make an egg wash.
Lightly flour a work surface and unfold the thawed puff pastry sheet. Brush the entire surface with the melted butter, then sprinkle the cinnamon-sugar mixture evenly over the top.
Using a sharp knife or pizza cutter, cut the pastry into 18 narrow strips of roughly equal width. Working with one strip at a time, fold it back and forth in decreasing lengths to create a zigzag tree shape with a small trunk at the bottom, then press a wooden pick or small skewer through the center if desired for support during shaping. If not using picks, press the layers together gently so the shape holds.
Arrange the shaped trees on the prepared baking sheet, leaving space between them. Brush each one lightly with egg wash. Place the tray in the refrigerator for 10 minutes so the pastry firms up and keeps its shape while baking.
Meanwhile, preheat the oven to 400°F. Bake the chilled pastry trees for 13 to 15 minutes, or until puffed and deep golden brown. Transfer the baked cookies to a wire rack and let them cool completely before glazing.
To make the glaze, whisk the powdered sugar, milk, and vanilla extract in a small bowl until smooth and pourable. If needed, add a few extra drops of milk to loosen it slightly.
Drizzle the glaze over the cooled pastry trees, then immediately sprinkle with the green sanding sugar so it adheres before the glaze sets. Let the glaze stand for about 10 minutes before serving.