If i am a decent enough guy, will this make any difference?

Trust me, that's not something that should get to you. A lot of guys are older than 23 and haven't slept with anyone, and that doesn't bother girls at all, if it does, they're probably too ually promiscuous and not worth worrying about anyway. It's all good, I wouldn't be bothered by it and you shouldn't too. :)