Add sugar, water and peaches to a medium saucepan. Bring to a boil and remove from heat immediately. Add rosemary. Cover and steep for 15 minutes.
Remove rosemary and purée peach mixture. Strain into a pitcher. Add lemon juice and stir.
Add thinly sliced lemon and peach to pitcher. Serve over lots of ice.