Transformers, More Than Meets the Eye

    How transformers are changing the field of computer vision

  • How transformers are changing the world of computer vision

    While Transformers are not new to deep learning, their successful application to computer vision is. Transformers holding the SOTA in a vision benchmark is certainly a massive breakthrough, but it’s unclear whether they’ll be able to compete with convolutional networks in the (relatively) “low-data low-compute” regime long term.

    Even more interesting is the potential for a convergence of NLP and CV around similar architectural components; if this trend is to continue, it could rapidly accelerate the progress of the field as a whole as the DL community, as its many niches and sub-categories begin to adopt similar techniques to solve wildly different problems. Transformers have only been around for 4 years, but it’s clear that their impact on DL research will resonate for years to come.