Color in motion Using photogrammetry to study dynamic displays in virtual environments


SOCIETY FOR INTEGRATIVE AND COMPARATIVE BIOLOGY
2021 VIRTUAL ANNUAL MEETING (VAM)
January 3 – Febuary 28, 2021

Meeting Abstract


8-2  Sat Jan 2  Color in motion: Using photogrammetry to study dynamic displays in virtual environments Miller, AE*; Hogan, BG; Stoddard, MC; Princeton University, Ecology and Evolutionary Biology Department, Princeton, NJ; Princeton University, Ecology and Evolutionary Biology Department, Princeton, NJ; Princeton University, Ecology and Evolutionary Biology Department, Princeton, NJ audreyem@princeton.edu

Animal signals are often complex and dynamic, but it can be challenging to measure all aspects of a signal simultaneously. Recent advances in imaging technologies, along with increased integration of behavioral ecology and computer science, provide new opportunities to analyze and interpret the color, pattern, and motion of animal displays in a more comprehensive way. By combining multispectral imaging with photogrammetry and 3D animation, we have devised a pipeline for analyzing colorful animal displays in a virtual environment. This type of approach has two major benefits. First, it adds extra dimensions, space and time, to traditional analyses of color and pattern. Second, it allows us to manipulate the conditions under which a signal is being observed. To accomplish this, we used a modified camera to capture UV and human visible color information from a mounted specimen of a colorful bird, the Hooded Pitta ( Pitta sordida ). Using the photogrammetric technique Structure from Motion, we generated a 3D model embedded with the UV and visible color information. We then animated the model in 3ds Max based on known behaviors exhibited by P. sordida . Renders of the animation were then used to analyze plumage color in the context of motion and the perspective of the intended observer. By developing cross-disciplinary methods that combine the measurement of color, pattern and motion, we will be better positioned to investigate dynamic displays and to understand the evolutionary forces that shape these signals as a whole.

the Society for
Integrative &
Comparative
Biology