Unfrosted Carrot Cake Cupcakes can be kept at room temperature for 3 days, refrigerated for a week, or frozen for up to two months. Store unused cream cheese frosting in an airtight container in the refrigerator for up to 2 weeks. Once frosted, cupcakes can be kept at room temperature for up to three days or refrigerated for longer storage.