4th International Conference

Digital Culture & AudioVisual Challenges

Interdisciplinary Creativity in Arts and Technology

Hybrid - Corfu/Online, May 13-14, 2022

Social Media
Videogrammetry for cultural applications
Date and Time: 14/05/2022 (15:30-17:00)
Location: Ionian Academy
Marinos Pavlidis, Leonidas Koufalis, Ioannis Deliyannis, Athanasios Koutsouridis

In this work we present various issues that arise when 3D modeling is used for cultural representation. We discuss the optimisation of the digitization process and the wide array of possible uses of the produced models, including the development of 3D assets for use within metaverse applications and virtual environments including holographic displays, their use as real-life objects through 3D printing, and the cultural preservation and restoration aspects. In addition, videogrammetry is proposed as an optimized version of photogrammetry, via the use of programmable drone plans, a process that presents various advantages.

Summary

The use of videogrammetry today offers a wide range of advantages discussed within this paper and can produce high-quality captures that can be later be used for multiple purposes. We present the videogrammetry process for large and small scale captures. This includes the introduction of automated flight paths when using drones that simplify and can automate the capturing process for large scale areas such as archaeological sites and open spaces. Then the modeling optimization process is presented, the difficulties that arise and the solutions that can be applied. Finally, the integration of the 3D objects into virtual environments and as holograms is presented as a process, while their 3D printed reconstruction is also discussed that enables the application of innovative uses and applications in the fields of entertainment, learning and tourism. More specifically, we propose a methodology where 3D learning activities can be implemented, souvenirs and wearable cosmetics can be produced using sustainable methods, 3D printing and recycled materials.


Objectives

The objectives of the work are summarized below and will be elaborated in the final document and presentation.

The paper begins by discussing the need for cultural representation using 3D modeling methods. The technical aspects of the process are presented next, focusing on the optimization of the generic photogrammetry process applied widely today, using videogrammetry. The advantages of this approach are shown through real-life examples where a 14-minute aerial video is sufficient to create a fully-featured 3D model of a specific point of cultural interest using only 3 frames per second. Simply by storing the original video one may reconstruct the model at any time, and if further sampling is required, then a further extraction can be performed effortlessly. We also discuss the specific lighting and weather condition settings that can aid the modeling process.

The next objective focuses on use-case scenarios of the produced models. Integration of 3D models as digital assets into virtual or augmented environments is important for the process. Games, virtual worlds, mixed-reality or augmented reality application domains are ideal environments that can be benefitted by the use of digitized assets. Although in general, model optimization needs to be performed in order to use them efficiently, the evolution in game-engine technology allows their direct inclusion, a development that is highly desirable and shortens further the workflow process.

The third objective focuses on the creation of digital-to-analog representations of edited models, and the development of products, experiences and sustainable processes.

Method

The method used to describe the processes combines literature review and the discussion of practical research methods. We present how the two already-established processes for 3D modeling can be combined in order to cover different developmental requirements that arise later in the process:
a) by using multiple photographs and combining them through software (aka: photogrammetry/videogrammetry) the result is a photorealistic 3D model of the object made by a computer, that can form a solid and accurate basis of representation. Alternative modeling methods include the combination of the above approach with LiDAR sensors which enhance the representation performance, as the combination of image and topologic information enables the minimization of visual errors.

b) the photogrammetry/videogrammetry model can then be used to “fit” the original architectural files/photos of a building enabling Augmented/Virtual scenarios to be implemented.

c) the photogrammetry/videogrammetry model can be simplified in order to enable 3D printing and other digital to analog features to be added such as the development of wearable souvenirs, educational 3D puzzles and game items.

Conclusion

We are confident that modeling of monuments of historical importance can be used and be useful in numerous scenarios that extend at the complete range of representation technologies and methods. Hence the optimisation processes described here can drastically optimize the developmental workflow.

Marinos Pavlidis
Marinos Pavlidis is an MSc student focused on visual arts and specially works in drone oriented projects. He currently works as a photographer/videographer in Corfu while he continues his studies in audio and visual arts. His work is mostly aerial visual content that is used in different case scenarios from cinematic and aesthetic art work to complete automation of the process of recording any subject. He was born in Kavala, in 1996, has graduated from the Department of Audio and Visual Arts from Ionian University, Corfu, Greece.
Leonidas Koufalis
Leonidas Koufalis is a Media Artist working on experimental research projects. His work involves the development of virtual and mixed reality worlds, video games and pixel/voxel art. His work is application specific and can be experienced in audiovisual productions, games, virtual worlds, cultural and architectural projects. He was employed as the principal 3D modeler within the “Hologrammatic Corfu” project realised within the inArts Research Laboratory, Department of Audiovisual Arts, Ionian University, Corfu, Greece.
Ioannis Deliyannis
Dr. Ioannis Deliyannis is an Associate Professor at Ionian University in Corfu. He is a member of the Faculty of the Department of Audio and Visual Arts and a founding member of the inArts research laboratory. He has created various interactive multimedia systems ranging from experimental television stations featuring multiple modes of delivery to educational and multi-sensory games. He is the author of a series of journal and conference publications in the above field and a series of books targeting the experimental and creative aspects of the technologies involved. He is involved in the design of user-centred software products and services, focusing on the use of mobile sensory systems to create intelligent interactive systems, entertainment education systems, games, gamified systems, educational applications for people with disabilities, multimedia adapters, holograms, interactive navigation narrative applications, augmented and virtual reality systems.
Athanasios Koutsouridis
Mr. Athanasios Koutsouridis has been a scientific advisor in Honeybee Productions since 2009. He was one of the founding members of Forthnet S.A., a company that was established by “FORTH, Foundation for research and Technology-Hellas” (ITE) and was the first that introduced the internet in Greece. Mr. Koutsouridis since 1996, nearly for 24 consecutive years, obtained an extended experience in the business of telecommunications, Mass Media (production of information and home entertainment programmes), while the last years of his career he is engaged, at a research level, in production of transmedia and gamified application content, as well as Subscription TV content (OTT TV, HBBTV streaming services). He was born in Thessaloniki, in 1972, has graduated from Department of Information Technology of Alexander Technological Institution of Thessaloniki (ΑΤΕΙ) and owns a Master’s Degree from The Department of Information Technology of Ionian University, Corfu, Greece.

Back
   
Text To SpeechText To Speech Text ReadabilityText Readability Color ContrastColor Contrast
Accessibility Options