PhD Position in gaze estimation and its applications

Updated: over 2 years ago
Deadline: 01 Dec 2021

The Computer Vision Lab looks for an enthusiastic and talented PhD candidate who is eager to develop computer vision and machine learning techniques for advanced interactive systems.

Computer interfaces are designed to interact with human users at the proper timing according to the attention and intention of the user. With the development of the internet of things, it is expected that a human will interact with different types of digital devices in a greater physical span of movement such as an entire room. Therefore, tracking human attention becomes both a more challenging and interesting task. Human eye gaze is one of the important signals for attention estimation as a non-verbal cue. Unfortunately, the current human eye gaze estimation methods cannot be used with different devices and tedious personal calibration is critical for performance. Other signals such as body pose, hand pose, and speech can assist the task of attention estimation. However, it has not fully explored the usage of different input signals, especially on how to merge them to achieve robust performance.

The proposed PhD project includes three subjects:

  • Main goal: Improving the current gaze estimation method that can work with different types of devices such as desktop machine and mobile phone and require minimal effort from the user for personal calibration.
  • Applying human attention estimation to the intelligent interactive system in real-world settings.
  • Combing gaze information with other input signals such as body pose, hand pose, and speech for human attention estimation.

The PhD candidate will work on computer vision and machine learning techniques specifically for the human eye gaze estimation to improve its usability and combine the existing methods for other input signals as additional aids for attention estimation. The final presentation of this PhD project is proofing the developed attention estimation method that can be used in intelligent interactive systems. There is room to adjust the project according to your research interests. For example, we can focus on one of the subjects in this PhD project.

We value different perspectives and we strongly believe that diversity drives innovation. We offer an open and safe working environment for employees and students regardless of their nationality, cultural background, gender or sexual orientation.

  • A master’s degree (or equivalent) in Computer Science or a closely related field.
  • A strong and demonstrable interest in computer vision and human-computer interaction research.
  • Strong programming and software engineering skills.
  • Good knowledge of computer vision and deep learning are a definite plus.
  • Good communication and writing skills in English.
  • Ability to work in a project team and take leadership and responsibility for research tasks

TU Delft offers PhD-candidates a 4-year contract, with an official go/no go progress assessment after one year. Salary and benefits are in accordance with the Collective Labour Agreement for Dutch Universities, increasing from € 2434 per month in the first year to € 3111 in the fourth year. As a PhD candidate you will be enrolled in the TU Delft Graduate School. The TU Delft Graduate School provides an inspiring research environment with an excellent team of supervisors, academic staff and a mentor. The Doctoral Education Programme is aimed at developing your transferable, discipline-related and research skills.

The TU Delft offers a customisable compensation package, discounts on health insurance and sport memberships, and a monthly work costs contribution. Flexible work schedules can be arranged. For international applicants we offer the Coming to Delft Service and Partner Career Advice to assist you with your relocation.

Delft University of Technology is built on strong foundations. As creators of the world-famous Dutch waterworks and pioneers in biotech, TU Delft is a top international university combining science, engineering and design. It delivers world class results in education, research and innovation to address challenges in the areas of energy, climate, mobility, health and digital society. For generations, our engineers have proven to be entrepreneurial problem-solvers, both in business and in a social context. At TU Delft we embrace diversity and aim to be as inclusive as possible (see our Code of Conduct ). Together, we imagine, invent and create solutions using technology to have a positive impact on a global scale.

Challenge. Change. Impact! 

The Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS) brings together three disciplines - electrical engineering, mathematics and computer science. Combined, they reinforce each other and are the driving force behind the technology we use in our daily lives. Technology such as the electricity grid, which our faculty is helping to make future-proof. We are also working on a world in which humans and computers reinforce each other. We are mapping out disease processes using single cell data, and using mathematics to simulate gigantic ash plumes after a volcanic eruption. There is plenty of room here for ground-breaking research. We educate innovative engineers and have excellent labs and facilities that underline our strong international position. In total, more than 1,100 employees and 4,000 students work and study in this innovative environment.

Click here to go to the website of the Faculty of Electrical Engineering, Mathematics and Computer Science.

For information about this vacancy, you can contact Dr. Xucong Zhang, email: xucong.zhang@ tudelft.nl

Application review will begin in October, 2021. Applications will be accepted until 01-12-2021, or until the position is filled.

Are you interested in this vacancy? Please apply via the application button and upload:

  • A detailed CV (including a list of publications if available) with contact details of 2-3 references.
  • A motivation letter (1-2 pages) that should address your vision of the project. You could try to address questions: what are your research interests and why you want to do it? What is your understanding of this PhD research project and how it links to your interests? How would you approach that topic? Why you are the perfect candidate for this PhD project (skills and knowledge)? Hints: Do not provide a standard letter, and do not be afraid to talk about your ideas, solutions, thoughts, and interests.
  • A detailed transcript with grades.
  • A copy or link to your Master's thesis if available.

A pre-employment screening can be part of the selection procedure.

You can apply online. We will not process applications sent by email and/or post.

Acquisition in response to this vacancy is not appreciated.


The Computer Vision Lab looks for an enthusiastic and talented PhD candidate who is eager to develop computer vision and machine learning techniques for advanced interactive systems.

Computer interfaces are designed to interact with human users at the proper timing according to the attention and intention of the user. With the development of the internet of things, it is expected that a human will interact with different types of digital devices in a greater physical span of movement such as an entire room. Therefore, tracking human attention becomes both a more challenging and interesting task. Human eye gaze is one of the important signals for attention estimation as a non-verbal cue. Unfortunately, the current human eye gaze estimation methods cannot be used with different devices and tedious personal calibration is critical for performance. Other signals such as body pose, hand pose, and speech can assist the task of attention estimation. However, it has not fully explored the usage of different input signals, especially on how to merge them to achieve robust performance.

The proposed PhD project includes three subjects:

  • Main goal: Improving the current gaze estimation method that can work with different types of devices such as desktop machine and mobile phone and require minimal effort from the user for personal calibration.
  • Applying human attention estimation to the intelligent interactive system in real-world settings.
  • Combing gaze information with other input signals such as body pose, hand pose, and speech for human attention estimation.

The PhD candidate will work on computer vision and machine learning techniques specifically for the human eye gaze estimation to improve its usability and combine the existing methods for other input signals as additional aids for attention estimation. The final presentation of this PhD project is proofing the developed attention estimation method that can be used in intelligent interactive systems. There is room to adjust the project according to your research interests. For example, we can focus on one of the subjects in this PhD project.

We value different perspectives and we strongly believe that diversity drives innovation. We offer an open and safe working environment for employees and students regardless of their nationality, cultural background, gender or sexual orientation.

  • A master’s degree (or equivalent) in Computer Science or a closely related field.
  • A strong and demonstrable interest in computer vision and human-computer interaction research.
  • Strong programming and software engineering skills.
  • Good knowledge of computer vision and deep learning are a definite plus.
  • Good communication and writing skills in English.
  • Ability to work in a project team and take leadership and responsibility for research tasks

TU Delft offers PhD-candidates a 4-year contract, with an official go/no go progress assessment after one year. Salary and benefits are in accordance with the Collective Labour Agreement for Dutch Universities, increasing from € 2434 per month in the first year to € 3111 in the fourth year. As a PhD candidate you will be enrolled in the TU Delft Graduate School. The TU Delft Graduate School provides an inspiring research environment with an excellent team of supervisors, academic staff and a mentor. The Doctoral Education Programme is aimed at developing your transferable, discipline-related and research skills.

The TU Delft offers a customisable compensation package, discounts on health insurance and sport memberships, and a monthly work costs contribution. Flexible work schedules can be arranged. For international applicants we offer the Coming to Delft Service and Partner Career Advice to assist you with your relocation.

Delft University of Technology is built on strong foundations. As creators of the world-famous Dutch waterworks and pioneers in biotech, TU Delft is a top international university combining science, engineering and design. It delivers world class results in education, research and innovation to address challenges in the areas of energy, climate, mobility, health and digital society. For generations, our engineers have proven to be entrepreneurial problem-solvers, both in business and in a social context. At TU Delft we embrace diversity and aim to be as inclusive as possible (see our Code of Conduct ). Together, we imagine, invent and create solutions using technology to have a positive impact on a global scale.

Challenge. Change. Impact! 

The Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS) brings together three disciplines - electrical engineering, mathematics and computer science. Combined, they reinforce each other and are the driving force behind the technology we use in our daily lives. Technology such as the electricity grid, which our faculty is helping to make future-proof. We are also working on a world in which humans and computers reinforce each other. We are mapping out disease processes using single cell data, and using mathematics to simulate gigantic ash plumes after a volcanic eruption. There is plenty of room here for ground-breaking research. We educate innovative engineers and have excellent labs and facilities that underline our strong international position. In total, more than 1,100 employees and 4,000 students work and study in this innovative environment.

Click here to go to the website of the Faculty of Electrical Engineering, Mathematics and Computer Science.

For information about this vacancy, you can contact Dr. Xucong Zhang, email: xucong.zhang@ tudelft.nl

Application review will begin in October, 2021. Applications will be accepted until 01-12-2021, or until the position is filled.

Are you interested in this vacancy? Please apply via the application button and upload:

  • A detailed CV (including a list of publications if available) with contact details of 2-3 references.
  • A motivation letter (1-2 pages) that should address your vision of the project. You could try to address questions: what are your research interests and why you want to do it? What is your understanding of this PhD research project and how it links to your interests? How would you approach that topic? Why you are the perfect candidate for this PhD project (skills and knowledge)? Hints: Do not provide a standard letter, and do not be afraid to talk about your ideas, solutions, thoughts, and interests.
  • A detailed transcript with grades.
  • A copy or link to your Master's thesis if available.

A pre-employment screening can be part of the selection procedure.

You can apply online. We will not process applications sent by email and/or post.

Acquisition in response to this vacancy is not appreciated.



Similar Positions