To meet the requirements for rapid tumor growth, a complex array of non-neoplastic cells are recruited to the tumor microenvironment. These cells facilitate tumor development by providing matrices, cytokines, growth factors, as well as vascular networks for nutrient and waste exchange, however their precise origins remain unclear. Through multicolored tissue transplant procedures; we have quantitatively determined the contribution of bone marrow-derived and adipose-derived cells to stromal populations within syngeneic ovarian and breast murine tumors. Our results indicate that subpopulations of tumor-associated fibroblasts (TAFs) are recruited from two distinct sources. The majority of fibroblast specific protein (FSP) positive and fibroblast activation protein (FAP) positive TAFs originate from mesenchymal stem/stromal cells (MSC) located in bone marrow sources, whereas most vascular and fibrovascular stroma (pericytes, α-SMA(+) myofibroblasts, and endothelial cells) originates from neighboring adipose tissue. These results highlight the capacity for tumors to utilize multiple sources of structural cells in a systematic and discriminative manner.