Yes, hence concentrating them on the 'mainline' route. I don't think they've been that sparsely used though have they? I think one covers a Stratford diagram and on a few occasions I've seen three of them coupled together forming a peak departure from Marylebone to Bicester (I think).
They're used more now. Originally they were only used in the peaks and not at all at weekends. The reason given was that many of the 165 diagrams interwork Aylesbury via Amersham and Mainline work. That and the services they were originally intended for, the Gerrards Cross terminators were never included in the timetable in the end.