This study investigates changes in soil phosphorus (P) in different fertilization treatments applied since 1902 on Chernozem soil at a “Static Fertilization Experiment” in Germany. Total and plant-available soil P, and soil P balances were assessed at 0–30, 30–60, and 60–90 cm depth layers in unfertilized “Zero”, mineral “NK” and “NPK”, and combined mineral and organic “FYM + NK” (farmyard manure + NK) and “FYM + NPK” fertilization treatments. P-use efficiencies were determined for each crop in rotation (sugar beet, spring barley, potato, and winter wheat). The 110 yr of P fertilization at rates between 22 and 55 t ha⁻¹ yr⁻¹ resulted in a significant increase of available P contents. P stocks increased up to 60 cm depth. Total P accumulation comprised 1.4 t ha⁻¹ for NPK, 1.3 t ha⁻¹ for FYM + NK, and 3.1 t ha⁻¹ for FYM + NPK. Crops cultivation without P fertilization in Zero and NK treatments resulted in negative P balances and reduction of available P below recommended levels. Reduction of mineral P application rates after 1981, along with crop variety-dependent yield increases, resulted in an improved P-use efficiency. An organic fertilization combined with mineral N and K fertilizers (FYM + NK) was found to be the most P-efficient treatment for Chernozem soils.