Husband cheated

A bit of background husband and me have been together for 21 years and married for 13 years. I believe my husband had cheated on me twice before, I caught him both times from messages I have seen in his phone but there was not enough evidence to back up the affairs both times as he was very smart in deleting it and the other time was using snapchat. He denied everything after I confronted him and since I didn't have physical proof I had to believe him. But I did warn him that if I ever catch him again I will be leaving him. Fast forward to present, I have been noticing my husband been distant from me since 2-3 months ago but I had put it down to him been busy with work and his new business which he started 2 months ago. But last week he changed his phone password and wouldn't tell what it is and when I asked him why he said he wants his privacy so I started doubting that he had an affair. Two days ago, he said he was going to his friend's place and since I was doubting him I tracked his location but he turned off his location after a while(he never did this before) so I don't know where he was. When he got home I asked him where he was and he told me he was at this friend's place and thus started an argument, him obviously denying everything and he was pissed off that I was tracking his location and that he has no privacy in this house. I'm not sure what to do, I told him I can't live like this, me doubting him all the time since he doesn't have the spine to admit it. And for him to have all this affairs means he doesn't love me and I don't trust him anymore. I asked for a divorce but he doesn't want to divorce since he says that he hasn't cheated. He still won't tell me his phone password to believe him that he is innocent and his location is still turned off. Aitah for not giving him privacy?

UPDATE: Thank you all for your support, it gave me sense of what I should do. After 2 months of emotional and heartbreaking days, we are getting DIVORCED!!!!