Chastity and orgasm denial discussion

My bond recently fell apart and even though it was never brought up, I suspect our differing sexual needs played a role. Aside from the fact that I’m okay with chastity, my partner had a particular fetish that not only left me cold but actually repelled me. Rather than asking him to stop or making him quit, I just stopped showing any interest in him sexually and became a somewhat dull companion when his obsession was part of our intimacy. Consequently, our sex life shrank, and I essentially neglected him by opting for self-pleasure over intercourse. I don’t claim my choices were perfect, but I own them. My question is: how would you all handle this? Is being with someone who has a disliked kink an obstacle that can be cleared, or is sexual match more crucial to relationship success than we usually admit?