Companion Affinity - "Evil Quests"

Does completing an "evil quest" with a non-active companion (not following, sent to ship or home) affect your affinity with them?

There are a ton of quests that I want to complete that are "evil" but would be annoyed if they reduce affinity for the good two-shoe companions that are currently available.