Large Language Models Think Too Fast to Explore Effectively