Hey I am in a relationship for last 5.5 years....

Hey I am in a relationship for last 5.5 years. After 3.5 years I ditched him first time by having affair with someone else. He caught me red handed and then he forgave me and asked me to stay in relationship. But the relationship becomes so toxic as there were so many fights. After 2 years I have again felt for someone. Now my boyfriend is very angry and upset and I am too. But I feel it's not in my control as I get attracted easily. Please help me what should I do. And at some point I feel I should not continue this relationship