Potential vorticity conservation for plasma turbulence in an inhomogeneous magnetic field: Theory and implications