We describe the non-equilibrium dynamics of the Sachdev-Ye-Kitaev models of fermions with all-to-all interactions. These provide tractable models of the dynamics of quantum systems without quasiparticle excitations. The Kadanoff-Baym equations show that the final state is thermal, and their numerical analysis appears consistent with a thermalization rate proportional to the absolute temperature of the final state. We also obtain an exact analytic solution of the non-equilibrium dynamics in the large $q$ limit of a model with $q$ fermion interactions. In this limit, the thermalization of the fermion Green’s function is instantaneous.