Utilizing augmented reality for reconstruction of fractured, fragmented and damaged craniofacial remains in forensic anthropology

Abstract

Forensic anthropologists are often confronted with human remains that have been damaged due to trauma, fire, or postmortem taphonomic alteration, frequently resulting in the fracture and fragmentation of skeletal elements. The augmented reality (AR) technology introduced in this paper builds on familiar 3D visualization methods and utilizes them to make three dimensional holographic meshes of skeletal fragments that can be manipulated, tagged, and examined by the user. Here, CT scans, neural radiance fields (NeRF) artificial intelligence software, and Unreal Engine production software are utilized to construct a three-dimensional holographic image that can be manipulated with HoloLens™ technology to analyze the fracture margin and reconstruct craniofacial elements without causing damage to fragile remains via excessive handling. This allows forensic anthropologists a means of assessing aspects of the biological profile and traumatic injuries without risking further damage to the skeleton. It can also be utilized by students and professional anthropologists to practice refitting before reconstructing craniofacial fragments if refitting is necessary. Additionally, the holographic images can be used to explain complicated concepts in a courtroom without the emotional response related to using bony elements as courtroom exhibits.