I'm pretty certain that I've heard talk of a service to and from Swansea over the years.... perhaps from Ilfracombe? Whether there would be sufficient customers for the service.....well, there's been nothing happening so far.
I would venture that any service further east would find it difficult to demonstrate cost or time savings over existing road and rail options.