Wikidata SPARQL Query Log Item and Property Co-occurrence Analysis

This is part 2 of a blog post describing Wikidata SPARQL query logs. Part 1 is here. In this part, we’ll look at the most used items and specifically look at diseases, drugs, genes and proteins. And then look at co-occurrence of properties within queries..

Below is a plot of the most used items by total query count and by unique query count

 

Next, I’ll look specifically at diseases. These are the most used disease items by total query count and by unique query count:

I then retrieved all diseases, drugs, genes and protein from Wikidata and summed the counts for each type. The table below shows some summary information for each. The columns unique and total display the number of unique and total queries containing any item of that type, respectively.  The columns organic and robotic contain the number of unique queries classified as organic or robotic, and num_items contains the total number of each type in Wikidata.

 

unique total organic robotic num_items
disease 82388 181241 1742 80465 11240
gene 11795 30899 163 11618 757218
protein 950 3798 37 913 533161
drug 42692 209740 544 42136 145961

 

Property Co-occurrence

If two properties are used together within the same query, it may indicate something special.

First we’ll look at all properties. Below is a plot of the of top pairs of properties used together in a query, by total and unique count

and by organic vs robotic count:

 

Next, looking specifically at biomedical-related properties:

And lastly, I wanted to see the most common useragents for each of these pairs of properties.

 

These plots together indicates that there were thousands of unique, organic, integrative queries involving biomedical items of different classes performed during this time.


Leave a Reply

Your email address will not be published. Required fields are marked *