Augmented Vision Workshop at Acadia 2022
Augmented Vision was a 3 day design build workshop exploring mixed reality applications for design and fabrication using Fologram and the HoloLens 2. The workshop was an opportunity to test experimental features (depth camera streaming) on the HoloLens 2 and implement a method for fast and approximate forming of surfaces with arbitrarily complex topology and geometry by hand in augmented reality. This was achieved by streaming depth camera data from the HoloLens to mixed reality applications running on the HoloLens that can compare physical geometry represented by pointclouds to target geometry represented as mesh models. This comparison was then used to describe changes necessary for fabricators to better approximate digital mesh models using physical material, and assisted in particular with complex forming tasks that required multiple bends or twists in sheets of fragile and malleable material.
The idea of comparing existing physical conditions to target conditions in real-time generalizes to a range of other applications within design and construction, for instance in performing real-time clash detection or quality assurance checks. Point cloud models of as-built conditions are useful for generating digital twins on the fly, or using as the input to other computer vision tools such as automatic object detection. Other fabrication approaches might also be imagined and invented that use point cloud data to guide during subtractive fabrication processes such as clay forming or foam carving. The goal of the workshop was to demonstrate the effectiveness of real-time feedback in the fabrication of a large prototype from light-weight strips of material. This prototype was completed by workshop participants over the course of two days.
For more information, take a look at the video above or read the conference paper.
