Frying help - should I increase 1/4 seam allowance here?

My (first) quilt is starting to really fray! The fabric is 100% cotton and on the higher end ($30/yard), so I don’t think it’s happening because it’s cheap. I think it might be due to the looser weave of the fabric. Anyway, it’s my first quilt, so there’s definitely some trial and error happening here. Some pieces are fraying more than others, and I don’t think laying it out on my carpet while organizing the pattern helped (oops).

I’m about to attach the border—should I use more than a 1/4” seam allowance to prevent further fraying? It might cut into the design a bit, but I’m worried about the durability. What would you suggest? And will it stop frying inside once all quilted? Also nervous about washing it etc given the fraying

Pics included!