In recent years, the treatment of wastewater treatment plant (WWTP) effluent has gained increasing attention. However, researches on the relationships between nitrogen forms and nitrogen removal efficiency are very limited. Based on the fact that the nitrogen forms in the WWTP effluent may vary as the season changes, the nitrogen removal efficiencies of an integrated ecological floating bed (IEFB) was studied under different influent nitrogen forms. In addition, the effects of sediments in the system were also quantified during the experiment. Results showed that the total nitrogen (TN) removal rates of the IEFB were 25.61 ± 5.72% and 60.03 ± 7.00%, respectively, when the main influent nitrogen forms are nitrate and ammonia. The sediments in the system also played vital roles in the removal processes: when the sediments were covered with a polyethylene membrane, the total nitrogen (TN) removal rate of the system dropped from 27.86 ± 5.53% to 14.78 ± 4.97%, and the total phosphorus (TP), from 58.77 ± 6.20% to 33.51 ± 25.52%.