Learning to Let Go of the Seasons