The neutral theory of biodiversity challenges the classical niche-based view of ecological communities, where species attributes and environmental conditions jointly determine community composition. Functional equivalence among species, as assumed by neutral ecological theory, has been recurrently falsified, yet many patterns of tropical tree communities appear consistent with neutral predictions. This may mean that neutral theory is a good first-approximation theory or that species abundance data sets contain too little information to reject neutrality. Here we present a simple test of neutrality based on species abundance distributions in ecological communities. Based on this test, we show that deviations from neutrality are more frequent than previously thought in tropical forest trees, especially at small spatial scales. We then develop a nonneutral model that generalizes Hubbell's dispersal-limited neutral model in a simple way by including one additional parameter of frequency dependence. We also develop a statistical method to infer the parameters of this model from empirical data by approximate Bayesian computation. In more than half of the permanent tree plots, we show that our new model fits the data better than does the neutral model. Finally, we discuss whether observed deviations from neutrality may be interpreted as the signature of environmental filtering on tropical tree species abundance distributions.