(1) Background: Acupressure is a noninvasive, low-cost technique that makes use of physical pressure on specific points using a finger or a device and shows positive effects on chronic pain as an adjunctive method to the rehabilitation exercises. The study’s aim was to evaluate the therapeutic efficacy on pain, disability, and life quality of an acupressure mat associated with a rehabilitation program in patients with chronic low back pain. (2) Methods: All participants underwent a specific rehabilitation program, initially with 10 supervised exercise sessions, then as home exercise for 6 months. The subjects in the experimental group (EG) were additionally provided with an acupressure mat and used it for 60 min per day. (3) Results: 44 patients (31 females) were equally divided among the treatment groups. A significant time interaction was found in both groups for McGill Pain Questionnaire, Oswestry Disability Index, and EuroQol-5D, and only in the EG for Visual Analog Scale. (4) Conclusions: The acupressure mat is simple and provides an additional benefit for patients in relieving pain and improving function and quality of life, especially in the medium-to-long term.