{"id":372,"date":"2018-03-12T12:13:18","date_gmt":"2018-03-12T12:13:18","guid":{"rendered":"https:\/\/antonyhallphd.wordpress.com\/?p=372"},"modified":"2019-03-08T17:27:56","modified_gmt":"2019-03-08T17:27:56","slug":"mechanically-augmented-reality","status":"publish","type":"post","link":"https:\/\/antonyhall.net\/blog\/mechanically-augmented-reality\/","title":{"rendered":"Mechanically Augmented Reality"},"content":{"rendered":"

When I first learned about the Rubber hand illusion<\/a> [RHI] I immediately began to think about ways in which the process could be automated to create an artwork, in which the experimenter’s presence was removed. This could be done using sensors and a microcontroller to articulate solenoids to tap fingers for example. That thought train was on a back burner until discovered the work of fellow MMU PGR Lin Charlston. As part of her PhD research [See her profile here ‘The Multimodal book as organism, artefact and assemblage: non-human agency in processes of growing and making’<\/a>] She invented a beautifully simple, entirely mechanical device just to do exactly this.<\/p>\n

Drawing of Lin Charlstons device ‘Meshy’<\/figcaption><\/figure>\n

Your hand is placed inside a box, while the other hand turns a crank. On top of the box, another rubber hand is placed. This is where Lin’s experiment takes on its own twist; on top of the rubber hand is a piece of moss. Fixating on this, and turning the crank, a copper disk rotates.  A delicate metal bead curtain brushes over the moss, and over the fingers of the false hand. Simultaneously the hidden real hand receives the same treatment. If the illusion works for you, ownership begins to drift from your real hand to the fake hand. Specifically, the moss begins to feel like it is part of your own hand. [if you are not familiar with the Rubber Hand Illusion check this<\/a> post<\/a>]\n

Although Lin has not settled on a name for the device yet, I couldn’t help trying to think of what one might call such a device and came up with the term ‘Propriosope’ [or Propioscope as I noted] a device for shifting bodily ownership from a body to another body or object [see my post on Unfeaseable objects here…<\/a>] One could imagine autonomous devices made based on any number of experiments related to the RHI [See my post on Illusions of Invisible, alien hands, 3 arms, and shrinking bodies<\/a> ]\n

Experiments with cranks<\/figcaption><\/figure>\n

This has made me reflect on the use of the crank as a convenient mechanism of ‘interaction’. For example; In the RHI synchronous tapping and stroking is essential to generate the illusion. A direct and tangible relationship between what is seen and felt.<\/p>\n

It’s difficult for the experimenter to replicate this manually, thus a system that can deliver this automatically could useful. It could also be useful in terms of ‘Augmented Virtuality’ interacting with real-world objects in virtual space.
\nThe crank ensures the participant has their hands arm and body in a certain position. And they probably know how to operate the crank intuitively. \"img_1811\"                    <\/p>\n

The above sketch shows an idea for an experiment:<\/strong> A version of Lin Charlstons device scaled up to resemble a version of body swap illusion [ Henrik Ehrsson and Olaf Blanke http:\/\/www.eurekalert.org\/pub_releases\/2007-08\/ucl-foe081407.php<\/span><\/a>]. In which a VR headset was linked to a live camera feed whereby the participant can view their own body, but from a few meters behind themselves. The experimenter taps their back with a stick. In this crank operated version:<\/p>\n