How to deal with distractions during sex?

The sex starts nicely and then few situations make it distracting where you start going soft as something else took your attention or turned you off.

The points that could turn you off could be something said by partner or something done by partner. Or it could be nearby sounds or in my case when partner touching and squeezing the penis a lot then my attention goes to my penis and it start going off.

Please suggest some details on how to overcome this distraction and enjoy what you like. Thanks