“Rock Me Baby” is a long-distance love song Lily co-wrote with Jesse Singer and Chris Soper during the tracking of her 2019 LP, Retro-Moderne. It might be the only song with that title that doesn't actually "rock." Instead, it finds Frost cooing sweet nothings into her lover's ear with a gentle sigh, breathy vocals.