Development of mature blood cell progenies from hematopoietic stem cells involves the transition through lineage-restricted progenitors. The first branching point along this developmental process is thought to separate the erythro-myeloid and lymphoid lineage fate by yielding two intermediate progenitors, the common myeloid and the common lymphoid progenitors (CMPs and CLPs). Here, we use single-cell lineage tracing to demonstrate that so-called CMPs are highly heterogeneous with respect to cellular output, with most individual CMPs yielding either only erythrocytes or only myeloid cells after transplantation. Furthermore, based on the labeling of earlier progenitors, we show that the divergence between the myeloid and erythroid lineage develops within multipotent progenitors (MPP). These data provide evidence for a model of hematopoietic branching in which multiple distinct lineage commitments occur in parallel within the MPP pool.