PROVIDING ADITTIONAL COTENT TO PRINT MEDIA USING AUGMENTED REALITY

Authors

  • Julien Letellier
  • Jens Reinhardt
  • Peter Scholl
  • Jürgen Sieck
  • Michael Thiele-Maas

DOI:

https://doi.org/10.47839/ijc.17.3.1038

Keywords:

Augmented Reality, Mobile Augmented Reality, Printed Media, Natural Feature Tracking.

Abstract

While not a new concept, Augmented Reality (AR) has gained increasing momentum in the last few years through the widespread propagation of high-performance mobile devices. These powerful handheld devices allow users to see the real world enhanced with computer-generated content anywhere at anytime. This has led to a massive rise of AR technology; large companies and start-ups are adding affordable AR accessories to their product portfolios. In this paper we describe a joint project between our research group and the Konzerthaus Berlin to use AR to enrich the Konzerthaus’ printed media. With the aid of AR, the readers of the seasonal brochure of the Konzerthaus Berlin are given the opportunity to access additional content complementing the brochure. These contents include images, illustrations, audio, video, simple 2D and 3D animations, interactive media as well as 3D objects. The application was implemented using Vuforia and Unity. This is an extended version of the paper presented at the Conference on Culture and Computer Science 2017 [17].

References

C. Perey, “Print and publishing and the future of augmented reality,” Inf. Services and Use, Vol. 31, No. 1-2, pp. 31-38, 2011.

R.T. Azuma, “A survey of augmented reality,” Presence Teleoperators and Virtual Environments, Vol. 6, Issue 4, pp. 355-385, 1997.

D. van Krevelen, R. Poelman, “A survey of augmented reality technologies, applications and limitations,” The International Journal of Virtual Reality, Vol. 9, Issue 2, 2010.

R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, B. MacIntyre, “Recent advances in augmented reality,” IEEE Computer Graphics and Applications, Vol. 21, Issue 6, pp. 34-47, 2001.

Y. Pang, M.L. Yuan, A.Y.C. Nee, S.-K. Ong, K. Youcef-Toumi, “A markerless registration method for augmented reality based on affine properties,” Proceedings of the 7th Australasian User Interface Conference, 50, 2006.

J. Li, M. Slembrouck, F. Deboeverie, “A hybrid pose tracking approach for handheld augmented reality,” Proceedings of the 9th International Conference on Distributed Smart Camera, ICDSC’15, 2015.

T.C. Young, S. Smith, “An interactive augmented reality furniture customization system,” Proceedings of the International Conference on Virtual, Augmented and Mixed Reality, 2016, pp. 662-668.

I. Barandiaran, C. Paloc, M. Graña, “Real-time optical markerless tracking for augmented reality applications,” Journal of Real-Time Image Processing, Vol. 5, Issue 2, pp. 129-138, 2009.

T.W. Kao, H.C. Shih, “A study on the markerless augmented reality for picture books,” Proceedings of the IEEE International Symposium on Consumer Electronics (ISCE), 2013, pp. 197-198.

X. Yang, K.-T.T. Cheng, “Accelerating SURF detector on mobile devices,” Proceedings of the ACM International Conference on Multimedia, 2012, pp. 569-578.

T. Tanikawa, H. Uzuka, T. Narumi, M. Hirose, “Integrated view-input AR interaction for virtual object manipulation using tablets and smartphones,” Proceedings of the 12th International Conference on Advances in Computer Entertainment Technology, ACE’15, 2015.

M. Kovalenko, S. Antoshchuk, J. Sieck, “Visual hand tracking and gesture recognition for human-computer interaction,” Proceedings of the International Conference on Culture & Computer Science, ICCCS’16, 2016.

K. Terajima, T. Komuro, M. Ishikawa, “Fast finger tracking system for in-air typing interface,” Proceedings of the “Extended Abstracts on Human Factors in Computing Systems” CHI EA’09, ACM, April 4-9’2009, pp. 3739-3744.

N. Hagbi, O. Bergig, J. El-Sana, M. Billinghurst, “Shape recognition and pose estimation for mobile augmented reality,” Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality, 2009.

W. Hürst, C. Van Wezel, “Gesture-based interaction via finger tracking for mobile augmented reality,” Multimedia Tools and Applications, Vol. 62, Issue 1, pp. 233-258, 2013.

A. Henrysson, M. Billinghurst, M. Ollila, “Virtual object manipulation using a mobile phone,” Proceedings of the International Conference on Augmented Tele-Existence, 2005, pp. 164-171.

J. Letellier, F. Pfeiffer, J. Reinhardt, P. Scholl, J. Sieck, M. Thiele-Maas, “Enhancement of printed content using augmented reality,” Proceedings of the International Conference “Kultur und Informatik: Mixed Reality”, 2017, pp. 209-226.

M. Billinghurst, A. Clark, G. Lee, “A survey of augmented reality,” Foundations and trends® in Human-Computer Interaction, Vol. 8, Issue 2-3), pp. 73-272, 2015.

M. Fiala, “ARTag, a fiducial marker system using digital techniques,” Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), 2005, vol. 2, pp. 590-596.

E. Peters, B. Heijligers, J. de Kievith, X. Razafindrakoto, R. van Oosterhout, C. Santos, et al., “Design for collaboration in mixed reality: technical challenges and solutions,” Proceedings of the 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES, IEEE), 2016, pp. 1–7. http://doi.org/10.1109/VS-GAMES.2016.7590343

R. Dörner, W. Broll, P. Grimm, B. Jung, Virtual und Augmented Reality (VR/AR): Grundlagen und Methoden der Virtuellen und Augmentierten Realität, Springer Vieweg, 2014.

Downloads

Published

2018-09-30

How to Cite

Letellier, J., Reinhardt, J., Scholl, P., Sieck, J., & Thiele-Maas, M. (2018). PROVIDING ADITTIONAL COTENT TO PRINT MEDIA USING AUGMENTED REALITY. International Journal of Computing, 17(3), 180-189. https://doi.org/10.47839/ijc.17.3.1038

Issue

2018, Volume 17, Issue 3

Section

Articles

License

International Journal of Computing is an open access journal. Authors who publish with this journal agree to the following terms:
•    Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
•    Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
•    Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.