If you're average like you say then what is the big deal (not you, haha)? When you're with a girl that actually enjoys you for your personality rather than your rugged good looks alone you'll have nothing to worry about.

Just be confident, don't blow your load in five seconds (ten is a good goal), and the last thing on her mind will be your tiny penis.