first pepper!

I started growing some "white carolina reaper" peppers in early September. so far I've had over 100 flowers appear on my three plants over the last month but so far only two small peppers have popped up and quite a few flowers have dropped. I've used cotton swabs and shake them everyone in a while to try and pollinate them. does it usually take pretty long for fruit to appear? any tips would be great! thank you!