When a pathogen is rare in a host population, there is a chance that it will die out because of stochastic effects instead of causing a major epidemic. Yet no criteria exist to determine when the pathogen increases to a risky level, from which it has a large chance of dying out, to when a major outbreak is almost certain. We introduce such an outbreak threshold (T₀), and find that for large and homogeneous host populations, in which the pathogen has a reproductive ratio R₀, on the order of 1/Log(R₀) infected individuals are needed to prevent stochastic fade-out during the early stages of an epidemic. We also show how this threshold scales with higher heterogeneity and R0 in the host population. These results have implications for controlling emerging and re-emerging pathogens.