Chastity and orgasm denial discussion

Last night, I locked him in his cage as usual, but we decided to call over a stranger to have him suck his cock. Then, we had the stranger bend him over and fuck him while he was blind folded. This is the first time that either of us has ever done this, though its a fantasy of his its one I mirror. Well… at the end of this he was not fine, and he needed aftercare that I did not give him. Instead I freaked out… not because I didn’t like the act, but I guess I was just scared in general. He had to be strong for both of us and that just isn’t right. He feels that I thought he was dirty… disgusting… and I don’t know how to make him understand that it had nothing to do with him. I broke his trust… I wasn’t there when I should have been, and I have no idea how to fix it. He doesn’t want to wear his collar or cage, but he hasn’t told me that I need to leave yet. He didn’t deserve that, but now he won’t even barely look or speak to me. Please help me.