Proteoglycans are central components of the extracellular matrix (ECM) and binding partners for inflammatory chemokines. Morphological differences in the ECM and increased inflammation are prominent features of the white adipose tissues in patients with obesity. The impact of obesity and weight loss on the expression of specific proteoglycans in adipose tissue is not well known. This study aimed to investigate the relationship between adiposity and proteoglycan expression. We analyzed transcriptomic data from two human bariatric surgery cohorts. In addition, RT-qPCR was performed on adipose tissues from female and male mice fed a high-fat diet. Both visceral and subcutaneous adipose tissue depots were analyzed. Adipose mRNA expression of specific proteoglycans, proteoglycan biosynthetic enzymes, proteoglycan partner molecules, and other ECM-related proteins were altered in both human cohorts. We consistently observed more profound alterations in gene expression of ECM targets in the visceral adipose tissues after surgery (among others VCAN (p = 0.000309), OGN (p = 0.000976), GPC4 (p = 0.00525), COL1A1 (p = 0.00221)). Further, gene analyses in mice revealed sex differences in these two tissue compartments in obese mice. We suggest that adipose tissue repair is still in progress long after surgery, which may reflect challenges in remodeling increased adipose tissues. This study can provide the basis for more mechanistic studies on the role of proteoglycans in adipose tissues in obesity.