Wikidata SPARQL Query Log Item and Property Co-occurrence Analysis
This is part 2 of a blog post describing Wikidata SPARQL query logs. Part 1 is here. In this part, we’ll look at the most used items and specifically look at diseases, drugs, genes and proteins. And then look at co-occurrence of properties within queries..
Below is a plot of the most used items by total query count and by unique query count
Next, I’ll look specifically at diseases. These are the most used disease items by total query count and by unique query count:
I then retrieved all diseases, drugs, genes and protein from Wikidata and summed the counts for each type. The table below shows some summary information for each. The columns unique and total display the number of unique and total queries containing any item of that type, respectively. The columns organic and robotic contain the number of unique queries classified as organic or robotic, and num_items contains the total number of each type in Wikidata.
If two properties are used together within the same query, it may indicate something special.
First we’ll look at all properties. Below is a plot of the of top pairs of properties used together in a query, by total and unique count
and by organic vs robotic count:
Next, looking specifically at biomedical-related properties:
And lastly, I wanted to see the most common useragents for each of these pairs of properties.
These plots together indicates that there were thousands of unique, organic, integrative queries involving biomedical items of different classes performed during this time.
Wikidata Sparql Query Log Analysis
by Greg Stupp | Aug 31, 2018 | bioinformatics, Biomedical Informatics, biomedical research, Gene Wiki, SPARQL, Uncategorized, WikidataWe recently gained access to the anonymised logs of several hundred million SPARQL queries from the Wikidata SPARQL endpoint. This blog post contains some discussion about the main takeaway points, while the full analysis and code can be found...
BD2K Hackathon Travel Awards & Diversity Scholarships
by Greg Stupp | Apr 8, 2015 | BD2K, big data, BioThings, hackathonThe BD2K Hackathon is right around the corner (May 7-9th 2015, see here for more information). We still have a few travel awards & scholarships available, especially for under-represented minorities in science. The deadline to apply will be...
1st BD2K 3rd Network of BioThings Hackathon
by Greg Stupp | Mar 3, 2015 | BD2K, big data, BioThings, hackathon, network of biothingsNEW! Travel and diversity scholarships are available. See the details page. We are very excited to announce our first BD2k / 3rd Network of Biothings Hackathon! This purpose of this hackathon is to bring together experts in their respective fields...