Has anyone else had a skin reaction to silicone?

When I used to lay with my doll, I always had an itchy feeling on my chest. Has anyone else experienced something similar with a silicone or even a TPE doll?