Yikes

So an older married man I work with is very attracted to me sexually and I rejected him. Then he called my manager and said “the feelings she has for me are not reciprocated”. I’m like uhhhhhhhhhh I don’t like him like that, and I obv kept this next part to myself but I’m a grey ace and in my 20s. Lol poor dude