Aromatase is the rate-limiting enzyme in the biosynthesis of estrogens and a key risk factor for hormone receptor-positive breast cancer. In postmenopausal women, estrogens synthesized in adipose tissue promotes the growth of estrogen receptor positive breast cancers. Activation of peroxisome proliferator-activated receptor gamma (PPARγ) in adipose stromal cells (ASCs) leads to decreased expression of aromatase and differentiation of ASCs into adipocytes. Environmental chemicals can act as antagonists of PPARγ and disrupt its function. This study aimed to test the hypothesis that PPARγ antagonists can promote breast cancer by stimulating aromatase expression in human adipose tissue. Primary cells and explants from human adipose tissue as well as A41hWAT, C3H10T1/2, and H295R cell lines were used to investigate PPARγ antagonist-stimulated effects on adipogenesis, aromatase expression, and estrogen biosynthesis. Selected antagonists inhibited adipocyte differentiation, preventing the adipogenesis-associated downregulation of aromatase. NMR spectroscopy confirmed direct interaction between the potent antagonist DEHPA and PPARγ, inhibiting agonist binding. Short-term exposure of ASCs to PPARγ antagonists upregulated aromatase only in differentiated cells, and a similar effect could be observed in human breast adipose tissue explants. Overexpression of PPARG with or without agonist treatment reduced aromatase expression in ASCs. The data suggest that environmental PPARγ antagonists regulate aromatase expression in adipose tissue through two mechanisms. The first is indirect and involves inhibition of adipogenesis, while the second occurs more acutely.