Energetic electron effects on an energetic-ion driven toroidal Alfvén eigenmode (TAE) are investigated via hybrid simulations of an MHD fluid interacting with energetic particles. Both energetic electrons and energetic ions described by drift-kinetic equations are included in the present work. It is found that the TAE can be effectively stabilized by off-axis peaked energetic electrons which are located near the mode center, while the centrally peaked energetic electrons fail to stabilize the mode. It is confirmed that the spatially localized pressure profile of energetic electrons causes the stabilization of TAE. The stabilized TAE has a more localized mode structure accompanied by a significant reduction in the energetic ion driving rate. The small change of mode frequency and dissipation rate indicate the stabilization mechanism is different from the so-called pressure gradient stabilization that drives the TAE into continuum. The results suggest that the strong plasma non-uniformity induced by the energetic electron beta profile may be responsible for the change of mode structure. It is also found that this stabilizing effect is more effective for a high-n TAE. Moreover, it is numerically verified that the positive (negative) pressure gradient at the TAE center will increase (decrease) the mode frequency. The wave-particle interactions are also analysed for a case with energetic electrons peaked at the inner side of the TAE center. It is found that the power transfer to a resonant barely trapped energetic electron, which taps energy from the wave, can be comparable to the power transfer from a resonant energetic ion. This suggests that if a sufficient number of resonant barely trapped electrons are present, they might stabilize energetic-ion driven TAE through the wave-particle interaction.