³Ô¹ÏÍøÕ¾

AI is cracking a hard problem – giving computers a sense of smell

Over 100 years ago, Alexander Graham Bell asked the readers of ³Ô¹ÏÍøÕ¾ Geographic to do something bold and fresh – “.” He pointed out that sciences based on the measurements of sound and light already existed. But there was no science of odor. Bell asked his readers to “measure a smell.”

Author


  • Ambuj Tewari

    Professor of Statistics, University of Michigan

Today, smartphones in most people’s pockets provide impressive built-in capabilities based on the sciences of sound and light: voice assistants, facial recognition and photo enhancement. The science of odor does not offer anything comparable. But that situation is changing, as advances in machine olfaction, also called “digitized smell,” are finally answering Bell’s call to action.

Research on machine olfaction faces a formidable challenge due to the complexity of the human sense of smell. Whereas human vision mainly relies on – rods and three types of cones – smell is experienced through about 400 types of .

Machine olfaction starts with sensors that detect and identify molecules in the air. These sensors serve the same purpose as the receptors in your nose.

But to be useful to people, machine olfaction needs to go a step further. The system needs to know what a certain molecule or a set of molecules smells like to a human. For that, machine olfaction needs machine learning.

Applying machine learning to smells

Machine learning, and particularly a kind of machine learning called , is at the core of remarkable advances such as voice assistants and facial recognition apps.

Machine learning is also key to digitizing smells because it can learn to map the molecular structure of an odor-causing compound to textual odor descriptors. The machine learning model learns the words humans tend to use – for example, “sweet” and “dessert” – to describe what they experience when they encounter specific odor-causing compounds, such as .

However, machine learning needs large datasets. The web has an unimaginably huge amount of audio, image and video content that can be used to train artificial intelligence systems that recognize sounds and pictures. But machine olfaction has long faced a data shortage problem, partly because most people cannot verbally describe smells as effortlessly and recognizably as they can describe sights and sounds. Without access to web-scale datasets, researchers weren’t able to train really powerful machine learning models.

However, things started to change in 2015 when researchers launched the . The competition released by and , biologists who study olfaction, and invited teams from around the world to submit their machine learning models. The models had to predict odor labels like “sweet,” “flower” or “fruit” for odor-causing compounds based on their molecular structure.

The top performing models were published in a in 2017. A classic machine learning technique called , which combines the output of multiple decision tree flow charts, turned out to be the winner.

I am a with a longstanding interest in applying machine learning to chemistry and psychiatry. The DREAM challenge piqued my interest. I also felt a personal connection to olfaction. My family traces its roots to the small town of Kannauj in northern India, which is . Moreover, my father is a chemist who spent most of his career analyzing geological samples. Machine olfaction thus offered an irresistible opportunity at the intersection of perfumery, culture, chemistry and machine learning.

Progress in machine olfaction started picking up steam after the DREAM challenge concluded. During the COVID-19 pandemic, many cases of , were reported. The sense of smell, which usually takes a back seat, rose in public consciousness. Additionally, a research project, the , made more and larger datasets publicly available.

Smelling deeply

By 2019, the largest datasets had grown from less than 500 molecules in the DREAM challenge to about 5,000 molecules. A Google Research team led by was finally able to bring the deep learning revolution to machine olfaction. Their model, based on a type of deep learning called , established in machine olfaction. Wiltschko is now the founder and CEO of , whose mission is “giving computers a sense of smell.”

Recently, Wiltschko and his team used a graph neural network to create a “,” where perceptually similar odors are placed closer to each other than dissimilar ones. This was not easy: Small changes in molecular structure can lead to large changes in olfactory perception. Conversely, two molecules with very different molecular structures can nonetheless smell almost the same.

Such progress in cracking the code of smell is not only intellectually exciting but also has highly promising applications, including personalized perfumes and fragrances, better insect repellents, novel chemical sensors, early detection of disease, and more realistic augmented reality experiences. The future of machine olfaction looks bright. It also promises to smell good.

The Conversation

Ambuj Tewari does not work for, consult, own shares in or receive funding from any company or organization that would benefit from this article, and has disclosed no relevant affiliations beyond their academic appointment.

/Courtesy of The Conversation. View in full .