We provide here a labeled dataset which can be useful for document understanding research experiments (download the dataset).
We used this dataset (or part of it) for assessing the performance of several systems for document understanding and classification we built:
Please cite our work if you use the dataset.
The dataset is composed as follows. It contains two groups of documents: 110 data-sheets of electronic components and 136 patents. Each group is further divided in classes: data-sheets classes share the component type and producer; patents classes share the patent source.
For each document the dataset contains:
Three sample images corresponding to the 1st page of three documents of the dataset are presented here. The former two concern the data-sheets and patents groups; the latter belongs to a third portion of the dataset (invoices) which we could not publish due to privacy concerns. Click on the image to see a larger version.
Here follows a snippet of the dataset file structure:
The filenames follows this conventions:
A block consist in a rectangular portion of the processed image where the OCR sofware found a single-line piece of text. We made the OCR work with standard configuration concerning line segmentation. A block includes:
An example of two lines of a blocks csv file follows:
The text part is double-quoted when needed (possible double-quotes are escaped).
We manually build the groundtruth by visually inspecting each document and, by means of a UI, selecting the blocks of interest. We looked for the following information (elements):
Each document could contain 0, 1 or more values for each element.
For each document, for each element which has a value in the document, we inserted in the groundtruth one or two blocks, as follows:
Where possible, we kept the same behaviour in selecting one or two blocks for the same element in the document of the same class. The value block text could contain other text other then the value itself.
The actual groundtruth csv file contains one line for each value: the line always contains both the two blocks. There can be more than one line for the same element (for example, the document show the patent number in two places).
A groundtruth csv line contains:
An example of two lines of a blocks csv file follows (the actual second line is splitted):
The dataset name is inspired by Carl Ritter von Ghega, who designed a railway from our city, Trieste, to our past capital, Vienna.
Data and tools >