This paper studies generic properties of Markov perfect equilibria in dynamic stochastic games. We show that almost all dynamic stochastic games have a finite number of locally isolated Markov perfect equilibria. These equilibria are essential and strongly stable. Moreover, they all admit purification. To establish these results, we introduce a notion of regularity for dynamic stochastic games and exploit a simple connection between normal form and dynamic stochastic games.