Invertebrate diversity has rapidly declined throughout Europe during the last century. Various reasons for this decrease have been proposed including human induced factors like climate change. Temperature changes alter distributions and occurrences of butterflies by determining habitat conditions at different scales. We evaluated changes in the composition of butterfly communities recorded at nine areas of fallow ground in south-western Germany in 1973, 1986, 2010 and 2012 using Pollard’s transect technique. To demonstrate the importance of climatic changes in affecting butterfly communities, we calculated the community temperature index (CTI) for each butterfly community in each year. Although they increased slightly, the CTI-values did not match the temperature trends recorded in the study region. However, the reduction in the standard deviations of the CTIs over time is reflected in the marked loss of cold- and warm-adapted species due to their inability to cope with temperature and land use induced habitat changes. Results of our butterfly surveys indicate a marked decline in species richness and striking changes in the composition of the butterfly communities studied. This trend was most pronounced for habitat specialists and, thus mirroring a depletion in trait diversity. Our results indicate that, in the course of large-scale anthropogenic changes, habitat degradation at smaller scales will continuously lead to the replacement of habitat specialists by ubiquitous species.