Falling and yearning to come back, but forgive me, grace is what I lack

You lost us both.
I was less than what you wished for,
now you have to decide who you miss more.
Your frivolity,
your actions so dumbly,
I'm leaving town,
sweeping the street at sundown.
Pick up my belongings, wrap my heart in protective gear,
take everything I need,
all but you, my dear.