It actually does seem possible to do with pytorch according to this guys implementation but going off the benchmarks, it looks slower.
