What matters for an extremely accurate long distance rifle?

I know that Barrel, optics and ammunition all play a part. What else do we need to consider?

Say i went with a 24" criterion and a nice ass scope, and (after some googling) some really accurate ammo. What else would I need to do? No moving targets or anything just plates at the back of the property.