TINY ripe Habanero pepper

Hey everyone. I am in New Zealand so currently the middle of summer. My Habanero plant (new to me I have never grown peppers) has heaps of fruit on it but they’re tiny and have turned orange! What have I done wrong? I did go away for a week recently and my partner did not water them properly. I thought they were dead when I got home! Heaps of the fruit turned orange 😭 I assume this is probably half the problem