Skip to main content
EURASIP Journal on Advances in Signal Processing
Download PDF
  • Research Article
  • Open access
  • Published:

Robust and Adaptive OMR System Including Fuzzy Modeling, Fusion of Musical Rules, and Possible Error Detection

EURASIP Journal on Advances in Signal Processing volume 2007, Article number: 081541 (2006) Cite this article

Abstract

This paper describes a system for optical music recognition (OMR) in case of monophonic typeset scores. After clarifying the difficulties specific to this domain, we propose appropriate solutions at both image analysis level and high-level interpretation. Thus, a recognition and segmentation method is designed, that allows dealing with common printing defects and numerous symbol interconnections. Then, musical rules are modeled and integrated, in order to make a consistent decision. This high-level interpretation step relies on the fuzzy sets and possibility framework, since it allows dealing with symbol variability, flexibility, and imprecision of music rules, and merging all these heterogeneous pieces of information. Other innovative features are the indication of potential errors and the possibility of applying learning procedures, in order to gain in robustness. Experiments conducted on a large data base show that the proposed method constitutes an interesting contribution to OMR.

References

  1. Rossant F, Bloch I: A fuzzy model for optical recognition of musical scores. Fuzzy Sets and Systems 2004,141(2):165–201. 10.1016/S0165-0114(03)00094-0

    Article  MathSciNet  Google Scholar 

  2. Blostein D, Baird H: A critical survey of music image analysis. In Structured Document Image Analysis. Edited by: Baird HS, Bunke H, Yamamoto K. Springer, Berlin, Germany; 1992:405–434.

    Chapter  Google Scholar 

  3. Carter N, Bacon R, Messenger T: The acquisition, representation and reconstruction of printed music by computer: a review. Computer and the Humanities 1988,22(2):117–136. 10.1007/BF00057651

    Article  Google Scholar 

  4. SmartScore 3.2 Pro Demo. https://doi.org/www.musitek.com

  5. Bainbridge D, Bell TC: Dealing with superimposed objects in optical music recognition. Proceedings of 6th International Conference on Image Processing and Its Applications, July 1997, Dublin, Ireland 2: 756–760.

    Article  Google Scholar 

  6. Bellini P, Bruno I, Nesi P: Optical music sheet segmentation. Proceedings of 1st International Conference on Web Delivering of Music (WEDELMUSIC '01), November 2001, Florence, Italy 183–190.

    Google Scholar 

  7. Coüasnon B, Camillerapp J: Using grammars to segment and recognize music scores. International Association for Pattern Recognition Workshop on Document Analysis Systems (DAS '94), October 1994, Kaiserslautern, Germany 15–27.

    Google Scholar 

  8. Ng KC, Boyle RD: Recognition and reconstruction of primitives in music scores. Image and Vision Computing 1996,14(1):39–46. 10.1016/0262-8856(95)01038-6

    Article  Google Scholar 

  9. Bainbridge D, Bell T: An extensible optical music recognition system. Proceedings of the 19th Australasian Computer Science Conference (ACSC '96), January-February 1996, Melbourne, Australia 308–317.

    Google Scholar 

  10. Fujinaga I: Adaptive optical music recognition, Ph. D. dissertation. McGill University, Montreal, Calif, USA, 1997.

    Google Scholar 

  11. Carter N, Bacon R: Automatic recognition of printed music. In Structured Document Image Analysis. Edited by: Baird HS, Bunke H, Yamamoto K. Springer, Berlin, Germany; 1992:456–465.

    Chapter  Google Scholar 

  12. Bainbridge D, Bell T: A music notation construction engine for optical music recognition. Software: Practice and Experience 2003,33(2):173–200. 10.1002/spe.502

    MATH  Google Scholar 

  13. Droettboom M, Fujinaga I, MacMillan K: Optical music interpretation. Proceedings of the International Workshops on the Statistical, Structural and Syntactic Pattern Recognition Conference (SSPR '02), August 2002, Windsor, Canada 378–386.

    Chapter  Google Scholar 

  14. Fahmy H, Blostein D: A graph-rewriting paradigm for discrete relaxation: application to sheet-music recognition. International Journal of Pattern Recognition and Artificial Intelligence 1998,12(6):763–799. 10.1142/S0218001498000439

    Article  Google Scholar 

  15. Kato H, Inokuchi S: The recognition system of printed piano using musical knowledge and constraints. Proceedings of IAPR Workshop on Syntactic and Structured Pattern Recognition, June 1990, Murray Hill, NJ, USA 231–248.

    Google Scholar 

  16. Blostein D, Haken L: Using diagram generation software to improve diagram recognition: a case study of music notation. IEEE Transactions on Pattern Analysis and Machine Intelligence 1999,21(11):1121–1136. 10.1109/34.809106

    Article  Google Scholar 

  17. Coüasnon B, Rétif B: Using a grammar for a reliable full score recognition system. Proceedings of International Computer Music Conference (ICMC '95), September 1995, Banff, Canada 187–194.

    Google Scholar 

  18. Ferrand M, Leite JA, Cardoso A: Improving optical music recognition by means of abductive constraint logic programming. Proceedings of the 9th Portuguese Conference on Artificial Intelligence (EPIA '99), September 1999, Évora, Portugal 342–356.

    Google Scholar 

  19. Su M-C, Tew C-Y, Chen H-H: Musical symbol recognition using SOM-based fuzzy systems. Proceedings of 20th International Conference of the North American Fuzzy Information Processing Society and the International Fuzzy Systems Association, July 2001, Vancouver, BC, Canada 4: 2150–2153.

    Google Scholar 

  20. Watkins G: The use of fuzzy graph grammars for recognising noisy two-dimensional images. Proceedings of Biennial Conference of the North American Fuzzy Information Processing Society (NAFIPS '96), June 1996, Berkeley, Calif, USA 415–419.

    Chapter  Google Scholar 

  21. Bloch I: Information combination operators for data fusion: a comparative review with classification. IEEE Transactions on Systems, Man, and Cybernetics, Part A 1996,26(1):52–67. 10.1109/3468.477860

    Article  Google Scholar 

  22. Bloch I, Maître H: Fusion of image information under imprecision. In Aggregation and Fusion of Imperfect Information, Studies in Fuzziness and Soft Computing. Volume 12. Edited by: Bouchon-Meunier B. Springer, Berlin, Germany; 1997:189–213.

    Chapter  Google Scholar 

  23. Dubois D, Prade H: Fuzzy Sets and Systems: Theory and Applications. Academic Press, New York, NY, USA; 1980.

    MATH  Google Scholar 

  24. Dubois D, Prade H, Yager RR: Merging fuzzy information. In Approximate Reasoning and Information Systems, Handbook of Fuzzy Sets. Edited by: Bezdek JC, Dubois D, Prade H. Kluwer Academic, Norwell, Mass, USA; 1999:335–401. chapter 6

    Chapter  Google Scholar 

  25. Rossant F: A global method for music symbol recognition in typeset music sheets. Pattern Recognition Letters 2002,23(10):1129–1141. 10.1016/S0167-8655(02)00036-3

    Article  Google Scholar 

  26. Rossant F, Bloch I: Optical music recognition based on a fuzzy modeling of symbol classes and music writing rules. Proceedings of IEEE International Conference on Image Processing (ICIP '05), September 2005, Genova, Italy 2: 538–541.

    Google Scholar 

  27. d' Andecy VP, Camillerapp J, Leplumey I: Kalman filtering for segment detection: application to music scores analysis. Proceedings of the 12th International Conference on Pattern Recognition (ICPR '94), October 1994, Jerusalem, Israel 1: 301–305.

    Article  Google Scholar 

  28. Fujinaga I, Moore S, Sullivan DS: Implementation of exemplar-based learning model for music cognition. Proceedings of the 5th International Conference on Music Perception and Cognition (ICMPC '98), August 1998, Seoul, Korea 171–179.

    Google Scholar 

  29. Martin P, Bellissant C: Low-level analysis of music drawings images. Proceedings of the 1st International Conference on Document Analysis and Recognition (ICDAR '91), 1991, Saint-Malo, France 417–425.

    Google Scholar 

  30. Armand J-P: Musical score recognition: a hierarchical and recursive approach. Proceedings of the 2nd International Conference on Document Analysis and Recognition (ICDAR '93), October 1993, Tsukuba Science City, Japan 906–909.

    Chapter  Google Scholar 

  31. Fujinaga I: Optical music recognition using projections, M.S. thesis. McGill University, Montreal, Calif, USA; 1988.

    Google Scholar 

  32. Reed KT, Parker JR: Automatic computer recognition of printed music. Proceedings of the 13th International Conference on Pattern Recognition (ICPR '96), August 1996, Vienna, Austria 3: 803–807.

    Article  Google Scholar 

  33. Randriamahefa R, Cocquerez JP, Fluhr C, Pépin F, Philipp S: Printed music recognition. Proceedings of the 2nd International Conference on Document Analysis and Recognition (ICDAR '93), October 1993, Tsukuba Science City, Japan 898–901.

    Chapter  Google Scholar 

  34. McPherson JR, Bainbridge D: Coordinating knowledge within an optical music recognition system. The 4th New Zealand Computer Science Research Students' Conference (NZCSRSC '01), April 2001, Christchurch, New Zealand 50–58.

    Google Scholar 

  35. https://doi.org/www.interactivemusicnetwork.org/wg_imaging/upload/assessingopticalmusicrecognition_v1.0.doc

Download references

Author information

Authors and Affiliations

  1. Telecom, Signal, and Image Department, Institut Supérieur d’Electronique de Paris (ISEP), 21 Rue d'Assas, Paris, 75006, France

    Florence Rossant

  2. Signal and Image Processing Department, ENST, CNRS UMR 5141, 46 Rue Barrault, Paris Cedex 13, 75634, France

    Isabelle Bloch

Authors
  1. Florence Rossant
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Isabelle Bloch
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Florence Rossant.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Rossant, F., Bloch, I. Robust and Adaptive OMR System Including Fuzzy Modeling, Fusion of Musical Rules, and Possible Error Detection. EURASIP J. Adv. Signal Process. 2007, 081541 (2006). https://doi.org/10.1155/2007/81541

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1155/2007/81541

Keywords