Visual/graphic problem

I have a constant problem with the game's performance and graphics. When I start a game I can play without problems with medium graphic quality, however as time goes by the graphic quality begins to decrease on its own and the textures begin to look bad and the fps drop. It usually fixes restarting the game but I want to know if there is a solution.