A literature review group I’m a part of with former Ditto co-workers published an article of our learnings on Transformers networks. It can be found at the link below:

https://medium.com/@deepganteam/what-are-transformers-b687f2bcdf49