PhD Position in 3D Perception and Large Language Models

3D Perception and Large Language Models

The world we inhabit is highly structured. Consider how humans operate in a 3D environment, where passive objects and active agents (e.g. machines, humans, and animals) coexist. Understanding scenes and spatial awareness is fundamental for enabling robots to interact with their surroundings effectively. Just as humans intuitively break down scenes into object-centric representations, robots can benefit from information about object types, their appearance, constituent parts, and their position and orientation in 3D space.

This PhD project is designed to enhance the environmental understanding of robots in a manufacturing setting, where they need to collaborate with each other and humans. This project aims to contribute to the field by utilizing large language models to support the robots’ perception and improve their communication capabilities.

We are looking for a highly motivated PhD candidate to join our team and work on cutting-edge research in 3D perception, scene understanding and large language models.

Your Role:

• Use cutting-edge 3D computer vision and machine learning methods
• Design and set up experiments
• Deploy your algorithms on robots
• Write well-documented code
• Prepare demonstrators
• Write scientific papers
• Guide Master's students
• Connect with academic and industry partners and promote your work

This position is situated at the p4MARS research group within the Faculty of Aerospace Engineering of the Technical University of Delft. p4MARS is a young research group working on robot perception for manufacturing and space applications.

Delft University of Technology is a world-renowned institution ranked 3rd globally in Aeronautical, Manufacturing and Mechanical Engineering. As a member of the prestigious IDEA League, our collaborative culture and innovative spirit offer endless opportunities for personal and professional growth. Join our community of over 23,000 students and 3,300 scientific staff and be part of shaping the future of technology.

• Master's degree in Aerospace/Mechanical/Electrical Eng., Computer Science, Applied Math or related disciplines
• Strong programming skills in Python and/or C++
• Knowledge in machine learning and deep learning methods and LLMs
• Knowledge in OpenCV, ROS, and Gazebo
• Well organized and excellent in time management
• Excellent command of English and communication skills

Doing a PhD at TU Delft requires English proficiency at a certain level to ensure that the candidate is able to communicate and interact well, participate in English-taught Doctoral Education courses, and write scientific articles and a final thesis. For more details please check the Graduate Schools Admission Requirements .

Doctoral candidates will be offered a 4-year period of employment in principle, but in the form of 2 employment contracts. An initial 1,5 year contract with an official go/no go progress assessment within 15 months. Followed by an additional contract for the remaining 2,5 years assuming everything goes well and performance requirements are met.

Salary and benefits are in accordance with the Collective Labour Agreement for Dutch Universities, increasing from € 2770 per month in the first year to € 3539 in the fourth year. As a PhD candidate you will be enrolled in the TU Delft Graduate School. The TU Delft Graduate School provides an inspiring research environment with an excellent team of supervisors, academic staff and a mentor. The Doctoral Education Programme is aimed at developing your transferable, discipline-related and research skills.

The TU Delft offers a customisable compensation package, discounts on health insurance, and a monthly work costs contribution. Flexible work schedules can be arranged. 

For international applicants, TU Delft has the Coming to Delft Service . This service provides information for new international employees to help you prepare the relocation and to settle in the Netherlands. The Coming to Delft Service offers a Dual Career Programme  for partners and they organise events to expand your (social) network.

Delft University of Technology is built on strong foundations. As creators of the world-famous Dutch waterworks and pioneers in biotech, TU Delft is a top international university combining science, engineering and design. It delivers world class results in education, research and innovation to address challenges in the areas of energy, climate, mobility, health and digital society. For generations, our engineers have proven to be entrepreneurial problem-solvers, both in business and in a social context.

At TU Delft we embrace diversity as one of our core values  and we actively engage  to be a university where you feel at home and can flourish. We value different perspectives and qualities. We believe this makes our work more innovative, the TU Delft community more vibrant and the world more just. Together, we imagine, invent and create solutions using technology to have a positive impact on a global scale. That is why we invite you to apply. Your application will receive fair consideration.

Challenge. Change. Impact!

The Faculty of Aerospace Engineering at Delft University of Technology is one of the world’s most highly ranked (and most comprehensive) research, education and innovation communities devoted entirely to aerospace engineering. More than 200 science staff, around 270 PhD candidates and close to 3000 BSc and MSc students apply aerospace engineering disciplines to address the global societal challenges that threaten us today, climate change without doubt being the most important. Our focal subjects: sustainable aerospace, big data and artificial intelligence, bio-inspired engineering and smart instruments and systems. Working at the faculty means working together. With partners in other faculties, knowledge institutes, governments and industry, both aerospace and non-aerospace. Working in field labs and innovation hubs on our university campus and beyond. 

Click here  to go to the website of the Faculty of Aerospace Engineering.

For additional information about this vacancy please contact Reza Sabzevari ([email protected] ).

Are you interested in this vacancy? Please apply no later than 16 August 2024 via the application button and upload your motivation and CV.

• A pre-employment screening can be part of the selection procedure.
• Applying for an exemption for specific research and educational areas is an obligatory part of the selection procedure for this vacancy. This exemption must be obtained from the Ministry of Education, Culture and Science (OCW) before an employment contract is agreed upon. Click here for more information.
• You can apply online. We will not process applications sent by email and/or post.
• Please do not contact us for unsolicited services.