As many of our regular visitors will know, the focus of our work here at SciBite is unlocking the knowledge held in the vast amount of biomedical text researchers have access to. Sometimes this yields well, interesting, results…

Of Burns and Bums: Machine Learning Surprises!

As many of our regular visitors will know, the focus of our work here at SciBite is unlocking the knowledge held in the vast amount of biomedical text researchers have access to. We use many different techniques to do this, all embedded in our award-winning text analytics software. As you might expect, machine learning and artificial intelligence techniques are at the heart of what we do, and are particularly important for our enrichment activities where we look to expand the coverage of concepts and terms of many of the world’s major biomedical ontologies. It was in the midst of such an activity that we noticed an interesting output from the system, suggesting the English word ‘bum’ as an adverse medical event alongside words such as ‘lightning’ and ‘frostbite’!

It may help to take a step back and explain. We use a technique called ‘word embedding’ to embed words into an n-dimensional vector space – or, in English, to convert words into sets of numbers. Each number in this set of numbers contains some semantic information about the word, captured by passing masses of text data through a system known as a neural network. We can feed these into simple mathematical operations; for example, ‘uncle – male + female’ returns the result ‘aunt’, and ‘Paris – France + England’ returns London. Similarly, ‘citalopram – depression + schizophrenia’ returns ‘risperidone’, a drug commonly used to treat schizophrenia.

We can also calculate ‘distances’ between words to determine how similar they are, and this is a functionality that is particularly useful when constructing vocabularies. The most important aspect of a vocabulary entry is the set of synonyms, and when words occupy a similar semantic space in our word embeddings, there is a good chance that they are synonymous. In tandem with careful human curation, this helps to make the coverage of our vocabs as thorough as possible. And not only does it help experts to recall related words more quickly, it also, occasionally, comes up with an association that no human would have thought to check.

And now we get to the bottom of the matter.

Among the most similar words to ‘bum’ are ‘battlefield’, ‘polytrauma’ and ‘firecracker’. Either there’s a side to life science literature that we are unfamiliar with, or there is something else going on here. You may have figured it out already. How about if I tell you that the second most similar word to ‘bum’ is ‘scald’? The first is ‘burn’. The word ‘bum’, as it most commonly occurs in life science literature, is, in fact, a misreading of the word ‘burn’, where the ‘r’ and ‘n’ have blurred together to become an ‘m’; probably an artefact of transcription errors, particularly when PDF files are converted into raw text.

Here are some examples: