Skip to main content

A Layered Learning Approach to 3D Multimodal People Detection Using Low-Cost Sensors in a Mobile Robot

  • Conference paper
Ambient Intelligence - Software and Applications

Abstract

In this paper we propose a novel approach for low cost multimodal detection of humans with mobile service robots. Detecting people is a key capability for robots that operate in populated environments. The main objective of this article is to illustrate the implementation of machine learning paradigms with computer vision techniques to improve human detection using 3D vision and a thermal sensor. Experimental results carried out in a manufacturing shop-floor show that the percentage of wrong classified using only Kinect is drastically reduced with the classification algorithms and with the combination of the three information sources.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Heimann sensor, http://www.heimannsensor.com/index.php

  2. Kinect sensor, http://en.wikipedia.org/wiki/Kinect

  3. Bellotto, N., Hu, H.: Multisensor data fusion for joint people tracking and identification with a service robot. In: 2007 IEEE International Conference on Robotics and Biomimetics ROBIO, pp. 1494–1499 (2007)

    Google Scholar 

  4. Cielniak, G.: People tracking by mobile robots using thermal and colour vision. Ph.D. thesis, Department of Technology Orebro University (2007)

    Google Scholar 

  5. Gundimada, S., Asari, V.K., Gudur, N.: Face recognition in multi-sensor images based on a novel modular feature selection technique. Inf. Fusion 11, 124–132 (2010)

    Article  Google Scholar 

  6. Hofmann, M., Kaiser, M., Aliakbarpour, H., Rigoll, G.: Fusion of multi-modal sensors in a voxel occupancy grid for tracking and behaviour analysis. In: Proc. 12th Intern. Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), Delft, The Netherlands (2011)

    Google Scholar 

  7. Martinez-Otzeta, J.M., Ibarguren, A., Ansuategui, A., Susperregi, L.: Laser Based People Following Behaviour in an Emergency Environment. In: Xie, M., Xiong, Y., Xiong, C., Liu, H., Hu, Z. (eds.) ICIRA 2009. LNCS, vol. 5928, pp. 33–42. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  8. Mozos, O.M., Kurazume, R., Hasegawa, T.: Multi-part people detection using 2D range data. International Journal of Social Robotics 2(1), 31–40 (2010)

    Article  Google Scholar 

  9. Schiele: Visual People Detection - Different Models, Comparison and Discussion. In: IEEE International Conference on Robotics and Automation (ICRA) (2009)

    Google Scholar 

  10. Sierra, B., Serrano, N., Larrañaga, P., Plasencia, E.J., Inza, I., Jiménez, J.J., Revuelta, P., Mora, M.L.: Using bayesian networks in the construction of a bi-level multi-classifier. A case study using intensive care unit patients data. Artificial Intelligence in Medicine 22(3), 233–248 (2001)

    Article  Google Scholar 

  11. Treptow, A., Cielniak, G., Duckett, T.: Active people recognition using thermal and grey images on a mobile security robot. In: Proceedings of the 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2005), Edmonton, Canada (2005)

    Google Scholar 

  12. Zin, T.T., Takahashi, H., Toriu, T., Hama, H.: Fusion of infrared and visible images for robust person detection. Image Fusion (2011), InTech http://www.intechopen.com/articles/show/title/fusion-of-infrared-and-visible-images-for-robust-person-detection

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Loreto Susperregi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Susperregi, L., Sierra, B., Martínez-Otzeta, J.M., Lazkano, E., Ansuategui, A. (2012). A Layered Learning Approach to 3D Multimodal People Detection Using Low-Cost Sensors in a Mobile Robot. In: Novais, P., Hallenborg, K., Tapia, D., Rodríguez, J. (eds) Ambient Intelligence - Software and Applications. Advances in Intelligent and Soft Computing, vol 153. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28783-1_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-28783-1_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-28782-4

  • Online ISBN: 978-3-642-28783-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics