Action on Hearing Loss Logo
    Total results:
    Search
      Total results:

      Detecting sound is easy - the hard bit is getting a machine to know what it means

      Whether it’s the sound of a doorbell, or complex speech patterns, sound recognition technology will transform everyone’s lives - including people with hearing loss and deafness. Kevin Taylor, our Product Technologist, tells us more.

      Scientists estimate that airborne hearing evolved over 350 million years ago when animals first colonised the land. However, creatures that lived in the oceans may have been sensitive to vibrations long before that.

      It is likely that hearing came about as a survival strategy - a wild animal has greater chance of survival if it knows the sound of a predator, and hearing has evolved in all sorts of ways. Take a bat for example: its finely tuned hearing has evolved to detect ultrasonic sounds that bounce off objectives. That way, it can navigate and detect prey. We humans use sound to warn of danger, for communication, and for pleasure.

      We’re good at sound recognition and so are animals, but could our technology ever match nature’s hearing abilities? And if it could, would there be benefits for people with hearing loss and deafness?

      German-born Emile Berliner solved the easy bit over a hundred years ago. He invented the microphone, a mechanical equivalent of the ear that converts sound into an electrical signal.

      We are now making inroads into the hard part: getting machines to make sense of what they hear. Or are we?

      Can technology recognise sounds critical to our safety?

      How do we get a machine to ‘know’ that a sound picked up through its microphone is a siren, a doorbell or conversation? We may not have to – what we can do is create an illusion. We can easily get hardware to flash a light when it detects the sound of a doorbell. We can do this by detecting sound level (loudness), duration, and frequency (pitch). The problem is the hardware may flash the light for other sounds too.

      A machine that can respond to a particular sound through a complex learning process, or when it matches the sound to a database of stored sounds is a step further. And there are already devices and applications that use this sort of technology to identify sounds in the environment.

      One example is the Braci Sound Alert app. It responds to nearby sounds, such as a doorbell, and can be set up to give a vibration alert on the phone, or relay the alert to another device. The app is not smart enough to tell you if the sound is too far away to pick up and process. So whether you’d want to rely on it for safety-critical sounds, such as a fire alarm, is a good question.

      Sonicco has a different approach. Their soon to be launched Orb is a dedicated device that can learn a particular alarm sound. Once it recognises the sound, it activates a wireless connected vibrating pad that goes under a pillow. A typical use is to listen out for fire alarms in hotel rooms. It learns to recognise the sound from the fire alarm, which regulations state has to be above a certain loudness level in the hotel room.

      Developments in speech-to-text technology

      Human speech is the most complex sound and we learn to make sense of it at an early age. Technology can respond to these complex sounds we make to a high degree of accuracy. Although speech-to-text technology has been around for a while, it’s improving all the time, to the point where it can work out context in a conversation and automatically add punctuation. Try this with the Geemarc TextHear app (free on Android). Download the app and say this into your device’s microphone: ‘This year I am going to Greece for a holiday’. Then say ‘I need to grease the door hinges’. TextHear ‘knows’ the context of the word ‘Greece’ and ‘grease’ in both conversations.

      Speech-to-text technology is set to have huge benefits for people with hearing loss and deafness, from translating ad-hoc announcements at train stations in real time to automated text relay over phone networks. But will each word, sentence and paragraph ever have real meaning to a machine, and would we want it to?

      When we think of the word ‘Greece’, we know it’s a country in southern Europe. But a word can conjure up so much more - a thought, a feeling, or a memory. Can a machine ever go that deep? For sound and speech to be truly meaningful, might the machine need to be self-aware? If that ever comes about, then human ingenuity is truly remarkable. And ‘it’ probably will ask us to stop calling it a machine.

      Find out more


      By: Kevin Taylor | 17 September 2018
      A futuristic robotic ear
      A futuristic robotic ear

      Recent Posts

      Get relief from snoring and a better night's sleep

      Are you kept awake by your partner snoring? Repeated exposure to loud snoring can cause sleep deprivation and even hearing damage. To mark National Stop Snoring Week, we’re shining the spotlight on noise-cancelling earplugs that can offer welcome relief and a better night’s sleep.

      By: Sally Bromham
      23 April 2019

      The cuticular plate: the foundations of hearing

      Tiny sensory cells in the inner ear, called hair cells, are vital for our hearing. One particular part of the hair cell, the cuticular plate, has recently been the focus of research by a team at the University of Virginia School of Medicine. The structure was found to play an important role in hearing and it was discovered that defects in it may lead to hearing loss.

      By: Dr Marta Narkiewicz
      15 April 2019

      Identifying antibiotics that are less toxic to the ear

      We funded a consortium of researchers from universities and industry to identify antibiotics, which are less toxic to the ear, but that are still effective in fighting life-threatening bacterial infections. The results have now been published in the journal Scientific Reports. Our Translational Research Manager, Dr Carina Santos, tells us more about their work.

      By: Dr Carina Santos
      15 April 2019

      Stress-relieving products to make life easier

      To mark Stress Awareness Month, we’ve selected our top stress-relieving products for people with deafness, tinnitus and hearing loss. We’ve a practical solution for every situation, to reduce anxiety and give you, or a loved one, a renewed zest for life.

      By: Sally Bromham
      14 April 2019