Owning a NYC apt without "living" in NYC

Does anyone here own a NYC apt as a vacation home, without paying NY state taxes? I know the law says less than 180 days, but I have heard that means yearly audits and always having to prove how long you stayed in NY. I would love to hear some experiences...