I did not expect this big of a different

I just swapped my air stone for a sponge filter. Then did some basic maintenance which usually kicks up a bunch of debris it takes about 30 minutes to settle, but this time it was done settling by the time the glass was clean.

If you have a filterless setup and have an air stone I recommend swapped it for a sponge filter.