Manage lower back pain

Hi, I've had nagging lower back pain for a few years now, especially when I start to ramp up my exercise. It feels like right at the base of my spine just above the hits and is mainly center/center-left. I try and do my best with stretching and core work, but what should I focus on? Tia