While I don't imagine these pieces resemble the feather Yankee Doodle wore, these headbands from Etsy shops FeatherBrain and sewsephine are feathers I would happily don.
The fascinators and hairpieces I mentioned before were mostly ones that felt perfect for a special occasion, but these would work with a variety of outfits.