Jaguar Land Rover’s Mind Sense research monitors brainwaves through the hands via sensors in the steering wheel
Jaguar Land Rover has revealed the ‘Sixth Sense’ project, a range of new road safety technology research projects that are being developed to reduce the number of accidents caused by stressed and distracted drivers. With its road safety research, the British firm is joining a number of other car makers that have been researching the measurement of brainwaves to monitor driver concentration in the car.Dr Wolfgang Epple, JLR Director of Research and Technology, said: “One key piece of new research is to see how we could measure brainwaves to monitor if the driver is alert and concentrating on driving.
Even if the eyes are on the road, a lack of concentration or a daydream will mean the driver isn’t paying attention to the driving task. They may miss a warning icon or sound, or be less aware of other road users so we are looking at how we could identify this and prevent it causing an accident.”
Mind Sense is the name of JLR’s research to see if a car could effectively read the brainwaves that indicate a driver is beginning to daydream, or feeling sleepy, whilst driving.
“If brain activity indicates a daydream or poor concentration, then the steering wheel or pedals could vibrate to raise the driver’s awareness and re-engage them with driving,” added Dr Epple. “If Mind Sense does not detect a surge in brain activity following the car displaying a warning icon or sound, then it could display it again, or communicate with the driver in a different way, to ensure the driver is made aware of a potential hazard.”
The most common method for monitoring brainwaves is close to the source using sensors attached to a headband, something that would be impractical in a vehicle. Jaguar Land Rover is investigating a method already used by NASA to develop a pilot’s concentration skills and also by the US bobsleigh team to enhance concentration and focus.
This detects brainwaves through the hands via sensors embedded in the steering wheel. Because the sensing is taking place further away from the driver’s head, software is used to amplify the signal and filter out the pure brainwave from any background ‘noise’.
Jaguar Land Rover is currently conducting user trials to collect more information on the different brainwaves identified through the steering wheel sensors and will involve leading neuroscientists in the project to verify the results.
Driver Wellness Monitoring
On top of brainwave monitoring, Jaguar Land Rover is also assessing how a vehicle could monitor the well-being of the driver using a medical-grade sensor embedded in the seat of a Jaguar XJ. The sensor, which was originally developed for use in hospitals, has been adapted for in-car use and detects vibrations from the driver’s heart beat and breathing.
“As we develop more autonomous driving technologies, there will be instances when the autonomous car needs to hand control back to the driver,” added Dr Epple. “To do this safely the car will need to know if the driver is alert and well enough to take over. So our research team is looking at the potential for a range of driver monitoring technologies to give the car enough information to support this decision. If the car detects severe health issues, or simply how alert the driver is, then the car could take steps to ensure the driver is focussed enough on the driving task to take over.”
Monitoring the physical health of the driver could not only detect the onset of sudden and serious illness that may incapacitate the driver, but also allow the car to monitor driver stress levels. This would then allow the car to help reduce stress, for example by changing mood lighting, audio settings and climate control.
Predictive Infotainment Screen with mid-air touch
JLR also has a ‘Predictive Infotainment Screen’ prototype that uses cameras embedded in the car to track the driver’s hand movements and this enables the system to predict which button the driver intends to press. This allows successful button selection to take place in mid-air, which means users wouldn’t have to touch the screen itself. In user trials this increases the speed of successful button selection by 22 per cent and therefore reduces the amount of time the driver is looking at the screen with their eyes off the road.
The system could also use mid-air touch to provide the driver with a sensation, otherwise known as haptic feedback, that their button selection has been successful. Mid-air touch uses ultrasonics to create a touch sensation in mid-air without the skin needing to be in contact with any surface.
The sensations could include a ‘tap’ on your finger or a ‘tingling’ on your fingertips. As touch provides an immediate response to the brain, there will be no need for the driver to glance at the screen for visual confirmation which would help keep their gaze on the road ahead.
Haptic Accelerator Pedal
Haptics could also be used to communicate with the driver through the accelerator pedal to increase the speed of response and to ensure the correct action is taken. To create these sensations in the accelerator pedal, an actuator sits at the top of the pedal arm and allows for vibrations or pulses to be passed through to the foot of the driver.
The technology also uses a torque motor which can create resistance in the pedal feel. This resistance could be used to notify the driver that they are pushing the accelerator through a speed limit. Alternatively, if you were crawling along in traffic a timely warning through the accelerator could prevent you bumping into the car in front.