Google uses Natural Language Processing (NLP) routines to convert its understanding of text into topics and concepts (Entities). We looked out how much understanding Google misses using this approach in the Software sector.
InLinks analyzed the page content of the top 10 Google results (in the US Market) ranking for the phrase natural language processing and compared the Named Entities recognized by Google’s NLP API with the proprietory routines designed by Inlinks to uncover gaps in Google’s machine learning in the Software sector
The results showed that 11.2% of entities seen on the results in the Software sector SERPS (search engine Results pages) were positively identified by Google.
This compares to 16.9% average across all analyzed industry sectors.
Different sectors tend to be analyzed with a different degree of accuracy by the search engines. This stems from two main challenges.
|Software Industry||Google Analysis||InLinks Analysis|
|Avg. Number of words per page||2363|
|Avg. Number of Topics per page||8.1||72.3|
|Benchmark - Avg. nb of entities/page (all sectors)||8.3||50.6|
|Of which, Topic types are:|
|- Cities & geo. areas||4||5|
Google’s Search API returned URLs for the following sites competing for this phrase:
#web.stanford.edu, #algorithmia, #en.wikipedia, #machinelearningmastery, #searchenterpriseai.techtarget, #towardsdatascience, #forbes, #ibm, #microsoft, #sas
The texts of each page are then sent to Google’s NLP API, in order to determine which entities are identified by the search engine. These are important for search since Google is then able to link these to its Knowledge Graph to feed its services including Google Discover, Google search, Voice Search and Google News. (Although, correct identification does not guarantee inclusion in these results)
Here is first of all the synthesis of the results returned by Google:
Here are some errors in the categorization of entities:
By understanding where Google is failing to recognize important concepts within the industry, there is an opportunity for companies in the sector to write clearer content that Google can better understand.
Another option is to explicitly state these concepts in Webpage schema for machine learning algorithms to take into account. This would require using Schema.org/WebPage and the "about" and mentions" properties for important concepts such as .
Internal linking of topics topages dedicated to each important topic will also help to reduce cannibalisation of content in Google’s understanding of contect within your content.
Google's understanding of the Software market, based on its NLP algorithms remains limited at 11.2% for this industry. Businesses either need to improve their schema or make their content more understandable by Google to improve its level of understanding.