Is it too late to prune my pepper plant?

Last year was eventful in growing my first pepper plant indoors. I didn’t get a bountiful harvest because I learned too late on the methods of pollinating indoors. When winter started and growth slowed, I trimmed off dying leaves and some branches, but now I’m wondering if I didn’t do enough. The branch in the back started growing and flowering much sooner than I expected, and I’m yet to refertilize the soil for this year.

Should I trim these three branches more? Should I leave the one flourishing branch as is or also trim that one?