The healthy prostate is a relatively quiescent tissue. Yet, prostate epithelium overgrowth is a common condition during aging, associated with urinary dysfunction and tumorigenesis. For over thirty years, TGF-beta ligands have been known to induce cytostasis in a variety of epithelia, but the intracellular pathway mediating this signal in the prostate, and its relevance for quiescence, have remained elusive. Here, using mouse prostate organoids to model epithelial progenitors, we find that intra-epithelial non-canonical Activin A signaling inhibits cell proliferation in a Smad-independent manner. Mechanistically, Activin A triggers Tak1 and p38 MAPK activity, leading to p16 and p21 nuclear import. Spontaneous evasion from this quiescent state occurs upon prolonged culture, due to reduced Activin A secretion, a condition associated with DNA replication stress and aneuploidy. Organoids capable to escape quiescence in uitro are also able to implant with increased frequency into immunocompetent mice. This study demonstrates that non-canonical Activin A signaling safeguards epithelial quiescence in the healthy prostate, with potential implications for the understanding of cancer initiation, and the development of therapies targeting quiescent tumor progenitors.