PhD student position in the research project “Mathematics for AI: geometric deep learning and equivariant transformers” at the Department of Mathematical Sciences at Chalmers University of Technology.

Project description

Despite the overwhelming success of deep neural networks we are still at a loss for explaining exactly why deep learning works so well. One way to address this is to explore the underlying mathematical framework. A promising direction is to consider symmetries as a fundamental design principle for network architectures. This can be implemented by constructing deep neural networks that are compatible with a symmetry group G that acts transitively on the input data. This is directly relevant for instance in the case of spherical signals where G is a rotation group. In practical applications, it was found that equivariance improves per-sample efficiency, reducing the need for data augmentation. Group equivariance has successfully been implemented in convolutional neural networks.

Recently, transformer networks have increased in popularity, in particular with impressive results both in natural language processing and computer vision. The goal of the present project is to explore equivariance in the context of transformers. This entails developing the underlying mathematical theory of equivariant transformers, as well as to consider applications in image processing, such as for example in cosmology, medical imaging or autonomous driving (e.g. fisheye camera images).

View all positions
We use cookies to personalise content and ads, to provide social media features and to analyse our traffic. We also share information about your use of our site with our social media, advertising and analytics partners. View more
Cookies settings
Privacy & Cookie policy
Privacy & Cookies policy
Cookie name Active
The WASP website uses cookies. Cookies are small text files that are stored on a visitor’s computer and can be used to follow the visitor’s actions on the website. There are two types of cookie:
  • permanent cookies, which remain on a visitor’s computer for a certain, pre-determined duration,
  • session cookies, which are stored temporarily in the computer memory during the period under which a visitor views the website. Session cookies disappear when the visitor closes the web browser.
Permanent cookies are used to store any personal settings that are used. If you do not want cookies to be used, you can switch them off in the security settings of the web browser. It is also possible to set the security of the web browser such that the computer asks you each time a website wants to store a cookie on your computer. The web browser can also delete previously stored cookies: the help function for the web browser contains more information about this. The Swedish Post and Telecom Authority is the supervisory authority in this field. It provides further information about cookies on its website,
Save settings
Cookies settings