Two tiny plants, loads of peppers

I have 2 white ghost pepper plants going in my AeroGarden. Both plants stayed rather small but recently have been producing a surprising amount of peppers and more flowers started.

Should I be cutting off new flowers so the peppers grow bigger, or should I just let them go and see what I get?