In Ap Calc-Bad math score

Im in AP calc, yet have scored worse this year, than both my previous years taking the PSAT on the math section. Additionally I plan on applying to college for a Physics degree, which is heavily math intensive. Im good at math normally, should I be worried?

Edit: The math score was 490, overall wqs a 1100