Data and tools‎ > ‎

Paper citations for important Computer Science venues

Every year, a significant percentage of papers that should be considered as being of "high quality" under any metric or human judgement, either never get cited at all or take just a few citations. In other words, high quality papers are not immune from the well known observation that a few papers take most of the citations.
To illustrate this phenomenon, perhaps overlooked, we collected and analyzed the citation counts for all papers published in some top-level venues of Computer Science from 2000 to 2009. The analysis outcome suggests clearly that when evaluation of researchers is based on citation counts, many papers that are definitely high quality have a remarkable chance of contributing very little, if at all, to the assessment.

Data

The charts presented here are obtained using citations data for the paper published between 2000 and 2009 (included) on the following journals:
  1. ACM Transactions on Computer Systems
  2. ACM Transactions on Internet Technology
  3. IEEE Transactions on Knowledge and Data Engineering
  4. IEEE Transactions on Software Engineering
and conference proceedings:
  1. ACM Symposium on Operating Systems Principles
  2. IEEE Symposium on Security and Privacy
  3. Internet Measurement Conference
  4. Symposium on Principles of Distributed Computing
The data has been obtained using Microsoft Academic Search.

Overall number of citations

In the following charts, for each paper we consider the overall number of citations it received from its publication to November 2012.

Histogram of citations

Boxplot of citations vs. year

Percentage of papers with 0 citations vs. year, per venue

Percentage of papers with 1 or less citations vs. year, per venue

Percentage of papers with 5 or less citations vs. year, per venue

Number of citations within the first 2 years

In the following charts, for each paper we consider the number of citations it received from its publication to two years later (e.g, for a paper of 2005, we condiser citations received in 2005, 2006 and 2007).

Histogram of 2-years citations

Boxplot of 2-years citations vs. year

Percentage of papers with 0 2-years citations vs. year, per venue

Percentage of papers with 1 or less 2-years citations vs. year, per venue

Percentage of papers with 5 or less 2-years citations vs. year, per venue