Electric and magnetic contributions to spatial diffusion in collisionless plasmas