Adipose tissue is an organized endocrine organ with important metabolic and immunological functions and immune cell-adipocyte crosstalk is known to drive various disease pathologies. Suitable 3D adipose tissue organoid models often lack resident immune cell populations and therefore require the addition of immune cells isolated from other organs. We have created the first 3D adipose tissue organoid model which could contain and maintain resident immune cell populations of the stromal vascular fraction (SVF) and proved to be effective in studying adipose tissue biology in a convenient manner. Macrophage and mast cell populations were successfully confirmed within our organoid model and were maintained in culture without the addition of growth factors. We demonstrated the suitability of our model for monitoring the lipidome during adipocyte differentiation in vitro and confirmed that this model reflects the physiological lipidome better than standard 2D cultures. In addition, we applied mass spectrometry-based lipidomics to track lipidomic changes in the lipidome upon dietary and immunomodulatory interventions. We conclude that this model represents a valuable tool for immune-metabolic research.