In a collaboration between the Sensing, Interaction & Perception Lab (Prof. Christian Holz) and Microsoft Research (Dr. Daniel McDuff and Dr. Tadas BaltruĊĦaitis), we are looking for a candidate with an interest in performing cutting edge research, strong motivation, and a desire to learn. In this project, we will develop novel deep learning methods for estimating stress as well as cardiovascular and pulmonary signals. Half of these methods will be computer vision-based and operate on webcam input, whereas the second half will be based on multimodal sensor signals from emerging headsets in Augmented Reality/Virtual Reality (e.g., inertial sensors, eye tracking, contact sensors).
Project background
The passive measurement of cognitive stress and its impact on performance in cognitive tasks has a huge potential for human-computer interaction and affective computing, including workload optimization or “flow” understanding for future of work productivity scenarios, remote learning, automated tutor systems, as well as stress monitoring, mental health and telehealth applications more generally. When cognitive demands exceed resources, people experience stress and task performance degrades.
Job description
The aim of this project is to develop intelligent software experiences that reduce workers’ stress and optimize their cognitive resources. We will develop sensing models that capture the body’s autonomic nervous system (“fight or flight”) responses to cognitive demands in real-time using information from multiple physiologic processes. These inputs will then help drive AI support that adapts to provide cognitive support while also maintaining autonomy (e.g., avoiding unnecessary and annoying interventions.)
We will develop novel computer vision and signal processing approaches for measuring cardiovascular, respiratory, pupil/ocular, and dermal changes using ubiquitous sensors. These approaches will operate in two settings:
- For desktop environments, we will develop, evaluate, and demonstrate our methods using non-contact sensing using cameras.
- For head-mounted displays (e.g., Hololens), we will appropriate our methods to utilize signals originating from the wearer’s head using built-in headset sensors.
In both cases, our developments will produce novel datasets, computational methods, and the results of in-situ evaluations in productivity scenarios.
Using our novel methods, we will also investigate their implications for tele-health scenarios, which often contain cardiovascular and respiratory assessments. We will develop scenarios that guide the user while assessing these metrics and visually present the remote physician with the results for examination.
Your profile
- written and spoken fluency in English
- an excellent degree (M.Sc., M.Eng. or equivalent) in Computer Science, Electrical Engineering, or a related field
- programming experience, preferably in Python, working with data science or ML tools (e.g., pandas, R, TensorFlow, PyTorch, MATLAB)
- experience working with large multi-modal datasets (e.g., vision, physiology, multi-modal signals, acceleration, PPG, EDA)
- experience implementing research prototypes (frontend, backend, or both)
- strong interpersonal and communication skills
Prior experience in conducting research and experiments using human-centered approaches in the fields of HCI, machine learning, computer vision, or biomedical engineering are a plus.
We offer
We offer an exciting and stimulating environment to study and work in: ETH and Microsoft Research have several internationally recognized research groups dedicated to computer vision, machine learning, signal processing, and physiological computing. We also collaborate with several other institutions and companies in Switzerland and abroad.
For an overview of our projects, learn more about
- Christian Holz and the Sensing, Interaction & Perception Lab (meet the team)
- Daniel McDuff and the HUE: Human Understanding and Empathy group at Microsoft Research, Redmond
- Tadas Baltrusaitis at Microsoft Cambridge, UK
ETH Zurich is one of the world’s leading universities specialising in science and technology. We are renowned for our excellent education, cutting-edge fundamental research and direct transfer of new knowledge into society. Over 30,000 people from more than 120 countries find our university to be a place that promotes independent thinking and an environment that inspires excellence. Located in the heart of Europe, yet forging connections all over the world, we work together to develop solutions for the global challenges of today and tomorrow.
Interested?
If you are interested in joining our group, please submit your complete application through the online application portal, including:
- a (short) motivation letter
- curriculum vitae
- school and university score records
- contact details of at least two academic referees
- a link to your Github profile and/or your personal portfolio/website
Applications will be evaluated on a rolling basis.
In line with our values, ETH Zurich encourages an inclusive culture. We promote equality of opportunity, value diversity and nurture a working and learning environment in which the rights and dignity of all our staff and students are respected. Visit our Equal Opportunities and Diversity website to find out how we ensure a fair and open environment that allows everyone to grow and flourish.
No comments:
Post a Comment