(1) Background: Highly sensitive cardiac troponin T (hs-cTnT) plays an essential role in the diagnosis of myocardial injury. The upper reference limit of the respective assay is generally applied, irrespective of age, renal function, or sex. We aimed to identify age-adjusted and sex-adjusted upper reference limits in relation to renal function in a large population-based cohort without cardiac diseases. (2) Methods: We included 5428 subjects of the population-based LIFE-Adult cohort, free of diagnosed cardiac diseases. Sex-adjusted and age-adjusted 99th percentiles for hs-cTnT in subjects with preserved renal function were obtained. (3) Results: The hs-cTnT values were higher in men of all age groups. In both sexes, an increasing age positively correlated with higher hs-cTnT values. Hs-cTnT weakly correlated with serum creatinine. The three-dimensional analysis of age, creatinine, and hs-cTnT showed no relevant additional effect of creatinine on hs-cTnT. In men aged above 60 and women above 70, the calculated 99th percentiles clearly exceeded the commonly applied thresholds. (4) Conclusion: Age and sex have a major impact on the serum concentration of hs-cTnT, while renal function does not. We propose to consider age-adjusted and sex-adjusted reference values.