Spontaneous electromagnetic fluctuations in unmagnetized plasmas I: General theory and nonrelativistic limit