Nitrogen-fixing plants provide critical nitrogen inputs that support the high productivity of tropical forests, but our understanding of the ecology of nitrogen fixers – and especially their interactions with herbivores – remains incomplete. Herbivores may interact differently with nitrogen fixers vs. non-fixers due to differences in leaf nitrogen content and herbivore defence strategies. To examine these potential differences, our study compared leaf carbon, nitrogen, toughness, chemical defence and herbivory for four nitrogen-fixing tree species (Inga oerstediana, Inga sapindoides, Inga thibaudiana and Pentaclethra macroloba) and three non-fixing species (Anaxagorea crassipetala, Casearia arborea and Dipteryx panamensis) in a lowland tropical rain forest. Leaf chemical defence, not nutritional content, was the primary driver of herbivore damage among our species. Even though nitrogen fixers exhibited 21.1% higher leaf nitrogen content, 20.1% lower C:N ratios and 15.4% lower leaf toughness than non-fixers, we found no differences in herbivory or chemical defence between these two plant groups. Our results do not support the common hypotheses that nitrogen fixers experience preferential herbivory or that they produce more nitrogen-rich defensive compounds than non-fixers. Rather, these findings suggest strong species-specific differences in plant–herbivore relationships among both nitrogen-fixing and non-fixing tropical trees.