Figure 1

Position encoding plus clever MLPs; an alternative to convolutional_networks

1 References

Tolstikhin, Houlsby, Kolesnikov, et al. 2021. MLP-Mixer: An All-MLP Architecture for Vision.” In Advances in Neural Information Processing Systems.
Touvron, Bojanowski, Caron, et al. 2022. ResMLP: Feedforward Networks for Image Classification With Data-Efficient Training.” IEEE Transactions on Pattern Analysis and Machine Intelligence.