Home Assistant Voice PE api issues

So I have 3 of the new PE voice kits and the first one setup just fine. Perfectly actually. But the last 2 keep giving me api errors. "Can't connect to ESP. Please make sure your YAML file contains an 'api:' line." I've tried factory restting it, flashing it with the newest firmware via their webflasher but still the same error. There was like 2 times it eventually worked but ofc I couldn't control anything so i'm gussing it only worked because of a glitch. Anybody else having this issue or know why i'm getting this error?