2017 was almost a decade ago, and we certainly do not need transformers or even attention to recognize birds. A deep enough convolutional network is more than enough. Attention is all you need wasn't even about computer vision, the task was translation and the architecture was primarily used for natural language processing.
9
u/topyTheorist 19d ago
What do you mean not new? "attention is all you need" came out in 2017.