After listening to it a bunch of times in a row, this is my take on the meaning.
She's talking about seeing someone in LA she used to be in a relationship with.
"The garden walls grow quick, before you know you're outside of it, and the ivy's coming in, it's so beautiful if you can find it."
Their relationship ended so quickly and it took her by surprise how quickly she was on the outside, but time moves quickly too and the ivy has grown around the wall (their relationship) so now she no longer feels the hurt and can look back on their time together fondly. It's beautiful when the ivy grows and you can be friends with someone despite the pain they caused you.
Also, the when she says, "time's always been kind to you, some people still fight their fate" I think she's talking about how people try to get surgery/procedures to look younger and "fight their fate" of getting older.