Electromagnetic fluctuations in magnetized plasmas II: Extension of the theory for parallel wave vectors