Background. It has been suggested that pelvic floor dysfunction may contribute to the development of chronic non-specific low back pain (LBP). However, there is limited evidence of the impact of pelvic floor muscle training (PFMT) on clinical outcomes such as pain or disability in the conservative management of LBP. Objective. The aim of this study was to investigate the effectiveness of PFMT in contrast to conventional treatment by comparing the disability and pain scores of patients with non-specific LBP. Methods. Thirty-seven participants with chronic non-specific LBP were recruited. They were randomly assigned to: a control group (n = 11) who received routine physiotherapy treatment and regular exercises; or one of two intervention groups who received either routine physiotherapy treatment and PFMT alone (n = 12), or routine physiotherapy treatment and PFMT focusing on transversus abdominis muscle coactivation (n = 14). The clinical characteristics of the participants were measured using the Oswestry Disability Index and the Numerical Pain Rating Scale. Results. Pain intensity and functional disability were significantly decreased in the control group (P < 0.05) and the two intervention groups (P < 0.05). There was no significant difference between the groups after treatment. Conclusion. Pelvic floor muscle training focusing on transversus abdominis muscle coactivation could be included in the conservative management of patients with non-specific LBP after reviewing their pelvic health history and performing a clinical assessment of their pelvic floor.