A framework of multitemplate ensemble for fingerprint verification
© Yin et al; licensee Springer. 2012
Received: 5 July 2011
Accepted: 19 January 2012
Published: 19 January 2012
How to improve performance of an automatic fingerprint verification system (AFVS) is always a big challenge in biometric verification field. Recently, it becomes popular to improve the performance of AFVS using ensemble learning approach to fuse related information of fingerprints. In this article, we propose a novel framework of fingerprint verification which is based on the multitemplate ensemble method. This framework is consisted of three stages. In the first stage, enrollment stage, we adopt an effective template selection method to select those fingerprints which best represent a finger, and then, a polyhedron is created by the matching results of multiple template fingerprints and a virtual centroid of the polyhedron is given. In the second stage, verification stage, we measure the distance between the centroid of the polyhedron and a query image. In the final stage, a fusion rule is used to choose a proper distance from a distance set. The experimental results on the FVC2004 database prove the improvement on the effectiveness of the new framework in fingerprint verification. With a minutiae-based matching method, the average EER of four databases in FVC2004 drops from 10.85 to 0.88, and with a ridge-based matching method, the average EER of these four databases also decreases from 14.58 to 2.51.
Keywordsfingerprint verification multi-template ensemble fusion rule establish polyhedron
Improving the performance of process steps of a biometrics system. These steps include segmentation , enhancement , extraction , matching , etc. However, there are some problems in this method. For example, the room of performance increasing is limited.
Fusing multiple sources of biometrics to increase the overall performance of a biometrics system. These sources include multiple sensors, multiple features , multiple matchers , multiple fingers , multiple impressions of a same finger , etc. Recent research results show that the most effective method to improve the performance of a biometrics system is to fuse more biometric information using ensemble learning . These ensemble approaches, particularly these ensemble approaches with multiple matching algorithms, need more computing resources and more storage. Ensembles of multiple sensors and multiple biometric verifications also need various kinds of sensors. Furthermore, it is very inconvenient for users since those multiple biometric verification ensembles need to capture various feature information from users in enrollment stage and verification stage.
Currently, multiple templates' ensemble is widely used in biometrics systems. In practice, multiple fingerprint images are captured and stored in database for one finger. These fingerprint images are called multiple templates. In current multiple templates ensemble researches, there are two challenges: (1) how to choose the proper templates for ensemble; (2) how to use the multiple templates information effectively.
For the second challenge, there are two major methodologies to use multi-template ensemble in fingerprint field: Mosaicking and Score level fusion. With mosaic [12, 13], a larger fingerprint image could be obtained from several small images. But, the major problem in creating a mosaicked image is that the alignment different impressions/pieces cannot be completely recovered. Meanwhile, with the score level fusion [9, 14, 15], a query fingerprint has some matching scores with the templates. So, the final score is to fuse these scores with different weights. However, these weights are difficult to be determined in practice.
In this article, a framework of multitemplate ensemble for fingerprint verification is proposed. As mentioned above, in the enrollment stage, some fingerprint images are chosen and stored in database as fingerprint templates. And then, a polyhedron is created by the matching results of multiple template fingerprints and a virtual centroid of the polyhedron is given. The matching scores are also stored in the database. During the verification stage, a distance is calculated from a query fingerprint to the centroid. We add the distance into the set which is constituted by the distance between the query and templates. Finally, the framework returns a proper distance from the set as the final score of the query image and the template fingerprints. The experimental results in FVC2004 show the effectiveness and robustness of the novel framework.
This article is a significant extension from the conference version which is published in . The rest of this article is organized as follows. Section 2 describes the flowchart of the framework in detail and introduces various parts of the framework detailed. Section 3 introduces two relative fingerprint matching algorithms which will be as the base matcher. Section 4 gives out the experimental results. Conclusion and future study are given in Section 5.
2. The proposed framework
As shown in Figure 2, the orange square is depicted in particular. In enrollment stage, when selecting templates, the number of templates is set beforehand. In this article, taking resources of computing and storing consideration, we prefer to set the number as 3. In database, we just store the feature sets of the templates and the scores among the templates. The distance describes the similarity of two fingerprints, if the two fingerprints are more similar, then the distance is shorter. Otherwise, the distance is longer. The remaining will describe each part of the framework detailed.
2.1. Enrollment stage
In this section, the template selection and the polyhedron establishment will be introduced in detail. Most systems store multiple templates of the same finger in order to represent the finger better, but when the number of templates is larger, the resource of computing and storing is needed more. While, template selection is an effective method to reduce the number of fingerprint templates in database. And in order to reduce the computing time of verification, the matching scores among the templates are also preserved in the enrollment stage.
2.1.1. Template selection
where m is the number of the enrolled fingerprints and F i is the i th fingerprint. S(F i , F j ) means similarity score of two enrolled fingerprints F i and F j . We will choose n (n < < m) fingerprints as the templates.
The template selection method is described as follows.
The a th fingerprint that the AVE a (F a ) is the maximum will be chosen as the first template fingerprint.
Step 2. For the second template fingerprint, the fingerprint F b that the S(F a , F b ) is minimum will be chosen as the second template. In this step, we only calculate these scores between the a th fingerprint and the others.
and the F c is as the third template.
and the F n is as the n th template.
2.1.2. Establish polyhedron
T1, T2, T3 indicate the three templates, L12, L13, L23 indicate the similarity distance among the three templates. Next, process of establish polyhedron is described in detail.
2.2. Verification stage
In this section, a distance calculated from query to centroid and a fusion rule will be introduced in detail.
When a query image is presented, the matching proceeds as follows:
The query image and each template of the same finger stored in database are matched to generate matching scores, and these scores are translated to distance using a proper distance expression;
Computing the distance from query image to the centroid, and output the distance.
Choosing a perfect distance and translating it to score using the inverse distance expression as the final score.
2.2.1. A distance calculated from query to centroid
Q indicates the query fingerprint, D*1, D*2, D*3 indicate the similarity distance between the query and templates, and D*cindicates the distance between the query and the centroid.
The final matching result will be given if we decide the distance expression. For example, the inverse of similarity S(F i , F j ) is a naïve choice of distance expression. In this article, we use the distance expression to compute the final matching result. In , we have confirmed that the distance expression is good.
2.2.2. Fusion rule
In Figure 4, the Q, T1, T2, T3, C means query image, template 1, template 2, template 3, centroid, respectively. These red lines mean the distance from query image to the template fingerprints. The green line means the distance from query image to the centroid of this geometric architecture. In Figure 5a, the length of red line is similar, so the green line is shortest. But in Figure 5b, the query image is more similar with template 2, and the black line is shortest. We all know that the more short of the length, the more similar. So, in this stage, we will use the Min rule to get the minimum distance from all the distance. And in the geometric architecture, we will get the shortest line.
Sometimes, we could get the distance between the query and templates, however, the geometric architecture could not be built because the distance cannot meet the rule of polyhedron. So, the distance between the query and the centorid cannot exist. In this case, we get the minimum distance between the query fingerprint and the templates as the final result.
3. Relative fingerprint matching algorithm
In this section, two base matchers that include minutiae-based algorithm  and ridge-based algorithm  will be introduced briefly. And in the experiment, the results are given based on the two base matchers.
3.1. Minutiae-based fingerprint matching algorithm
3.2. Ridge-based fingerprint matching algorithm
4. Experimental results
In this section, we present results on fingerprint database FVC2004 database. This database has four sub-databases: DB1, DB2, DB3, and DB4. Each sub-database consists of fingerprint impressions obtained from 100 non-habituated, cooperative subjects, and every subject was asked to provide eight impressions of the same finger.
where ω1 and ω2 represent the classes of true genuine matches and impostor matches, respectively, D1 and D2 denote the decisions of genuine matches and impostor matches, respectively. The EER is computed as the point where FAR(t) = FRR(t), usually we use EER to evaluate the biometric system . And the performance of the biometric system can also be shown as a receiver operating characteristic (ROC) curve that plots the FRR against the FAR at different thresholds on the matching score. In the experimental results, we will show out the performance of a fingerprint verification system by using the EER and ROC, respectively.
EER of the two base matchers
4.1. Template selection results
In this section, the proposed template selection is compared to MDIST  template selection. Uludag et al.  proposed two methods for template selection: DENT and MDIST, but MDIST method gets a better performance than DEND in their study. Lumini and Nanni  presented a novel clustering method for template selection, and this method is better than MDIST in their study. While this clustering method is depicted simply, we cannot reappear, so we select the MDIST as comparison.
When we carry out our experiments, each sub-database is divided into two subsets called template and query databases. Images selected by using template selection methods constitute the template database and the remaining images of the finger constitute the query database. A maximum matching score is chosen from all scores between a query fingerprint and templates as final score. We perform a comparison among the following methods for the same template selection:
Double-templates (DT): two images are selected as the templates, six images as the query images. And there will be 200 images in the template database, 600 images in the query database.
Three-templates (TT): three images are selected as the templates, five images as the query images. And there will be 300 images in the template database, 500 images in the query database.
Four-templates (FT): four images are selected as the templates, four images as the query images. And there will be 400 images in the template database, 400 images in the query database.
The EERs of template selection using minutiae-based method
The EERs of template selection using ridge-based method
Our proposed template selection method is better than MDIST. The reasons may be that the templates selected by our proposed method have a perfect complementary, while the templates selected by MDIST may be a high similarity and their differences are small.
4.2. Verification results
In this section, we will show the EERs of our proposed framework using minutiae- and ridge-based methods.
DT-framework, TT-framework, FT-framework mean our proposed framework using double templates, three templates, and four templates, respectively.
The EERs of our proposed framework using minutiae-based method
The EERs of our proposed framework using ridge-based method
Finally, although, with the number increasing of templates, the EERs are lower, but the resource of computing and storing is increasing. So, this is a trade-off between performance and resource. For guaranteeing the verification accuracy and resource saving, we recommend to use three templates.
The main contributions of this article to the fingerprint verification are (1) a template selection method is proposed, and this method is more robust and effective than the MDIST. (2) A polyhedron is established by using matching scores among templates, and gets a virtual centroid of the polyhedron. When a query image is inputted, a distance between the query image and the centroid is calculated, and then a distance is chosen from all the distances as the final score. (3) A complete framework for the fingerprint verification system is built based on these two steps.
The experiment of this framework is carried out on the FVC2004DB4 database. Due to the number of fingerprint images in the database the experiment results only represent the functionality of the framework. Future study is to be done on more samples to further verify the performance of both the new template selection method and the proposed framework.
This study was partly supported by the National Natural Science Foundation of China under Grant No. 61070097, 61173069 and the Research Fund for the Doctoral Program of Higher Education under Grant No. 20100131110021.
- Ong TS, Andrew TBJ, David NCL, Sek YW: Fingerprint images segmentation using two stages coarse to fine discrimination technique. Ai 2003. Adv Artif Intell 2003, 2903: 624-632.MathSciNet
- Hong L, Wan YF, Jain A: Fingerprint image enhancement: algorithm and performance evaluation. IEEE Trans Pattern Anal Mach Intell 1998, 20(8):777-789. 10.1109/34.709565View Article
- Farina A, Kovacs-Vajna ZM, Leone A: Fingerprint minutiae extraction from skeletonized binary images. Pattern Recognit 1999, 32(5):877-889. 10.1016/S0031-3203(98)00107-1View Article
- Tico M, Kuosmanen P: Fingerprint matching using an orientation-based minutia descriptor. IEEE Transact Pattern Anal Mach Intell 2003, 25(8):1009-1014. 10.1109/TPAMI.2003.1217604View Article
- Jain AK, Ross A, Prabhakar S: A hybrid fingerprint matching using minutiae and texture features. In Proc Int Conf Image. Thessaloniki, Greece; 2001:282-285.
- Ross A, Jain A, Reisman J: A hybrid fingerprint matcher. Pattern Recognit 2003, 36(7):1661-1673. 10.1016/S0031-3203(02)00349-7View Article
- Jain AK, Prabhakar S, Ross A: Fingerprint matching: data acquisition and performance evaluation. MSU Technical Report TR99-14 1999.
- Yang CY, Zhou J: A comparative study of combining multiple enrolled samples for fingerprint verification. Pattern Recognit 2006, 39(11):2115-2130. 10.1016/j.patcog.2006.05.008View Article
- Maltoni D, Maio D, Jain AK, Prabhakar S: Handbook of Fingerprint Recognition. Springer, New York; 2003.
- Uludag U, Ross A, Jain A: It biometric template selection: a case study in fingerprint. Pattern Recognit 2004, 37(7):1533-1542. 10.1016/j.patcog.2003.11.012View Article
- Lumini A, Nanni L: A clustering method for automatic biometric template selection. Pattern Recognit 2006, 39(3):495-497. 10.1016/j.patcog.2005.11.004View Article
- Jain A, Ross A: Fingerprint mosaicking, in 2002 IEEE Int. In Conf Acoustics, Speech, Signal Process. Orlando, FL, USA; 2002:4064-4067.
- Choi K, Choi HS, Lee S, Kim J: Fingerprint image mosaicking by recursive ridge mapping. IEEE Trans Syst Man Cyber Part B Cybern 2007, 37(5):1191-1203.View Article
- Jain AK, Prabhakar S, Chen SY: Combining multiple matchers for a high security fingerprint verification system. Pattern Recognit Lett 1999, 20(11-13):1371-1379. 10.1016/S0167-8655(99)00108-7View Article
- Fronthaler H, Kollreider K, Bigun J: Fingerprint image-quality estimation and its application to multialgorithm verification. IEEE Trans Inf Forensics Secur 2008, 3(2):331-338.View Article
- Ren CX, Yin YL, Ma J, Yang GP: A novel method of score level fusion using multiple impressions for fingerprint verification. In 2009 IEEE Conf Syst Man (Smc 2009). Volume 1-9. San Antonio, TX; 2009:5051-5056.
- Grünbaum B, Shephard G: Rotation and winding numbers for planar polygons and curves. Trans Am Math Soc 1990, 322: 169-188. 10.2307/2001527View Article
- Jiang XD, Yau WY: Fingerprint minutiae matching based on the local and global structures. In 15th Conf Pattern Recognit. Volume 2. Barcelona, Spain; 2000:1038-1041.
- Feng JJ, Ouyang Z, Cai AN: Fingerprint matching using ridges. Pattern Recognit 2006, 39(11):2131-2140. 10.1016/j.patcog.2006.05.001View Article
- Wayman JL, Jain AK, Maltoni D, Maio D: Biometric Systems-Technology, Design and Performance Evaluation. Springer, New York; 2005.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.