Follow this link for the project page
ART
Carsten Holler / Olafur Eliasson
Carsten Holler is a key example within this study, often re- appropriating science for the purposes of art. Staging ‘Quasi-scientific’ experiments (Windsor, 2018) which transform the gallery into a laboratory. Often disorientating the viewer, or more appropriately, the participant. As well as the large-scale installations smaller performative works such as ‘Kit for Exploration of the Self’ (Carsten. Holler, 1995) take the form of durational perception changing instruments such as ‘Upside Down Glasses’ (Carsten Holler, 1994-2018). These both directly re-appropriate methods from experimental psychology (Stratton, 1896). Many of the works require the participant to travel through them or offer the opportunity to make decisions of which there are no return or unknown outcomes, further reinforcing this active notion of experience as
Augmented hands
‘Augmented hand series’ by Golan Levin, Chris Sugrue, and Kyle McDonald, 2013-2015) ‘MIRAGE Illusion Box’ (Roger Newport, 2008) These are two very similar projects which both transform the image of a hand in real time using Augmented Virtuality (AV, the digital manipulation of real-world objects). Both take the form of a black box, into which the hand is placed. When inside the participant can see their hand as if looking through a window into the box. Inside the box, a system of mirrors and motion tracking is used. An augmented or distorted digital image of the hand is relayed to a screen on the top of the box. Despite the technical similarities, both works stem from entirely different motivations. The ‘MIRAGE Illusion Box’ (Newport, 2018)
Be Another Lab
This International group interdisciplinary group adopt mechanisms employed in the cognitive sciences, such as the work of Mel Slater, and the arts. Their project ‘The Machine to Be Another’ allows anyone to experience a perspective from the body of an-other. The group speak of ‘expanding subjective experience’ and ‘understanding the relationship between identity and empathy from an embodied perspective’ (http://beanotherlab.org/) Using HMDs and live video, they have developed a number of critical applications. Investigating a wide range of issues including gender and disability. The group study the impact this work can have on people’s lives, employing methods of action research and co-creation. Be Another Lab embraces an open source approach. Sharing and developing their project through workshops, making the tools and
Labyrinth Psychotica
Labyrinth Psychotica is an artistic research project that aims to simulate the experience of psychosis. It uses multisensory [tactile and sonic] elements in combination with the maze environment, to create a fully immersive experience. The maze mechanism also serves as a metaphor for attempting to get inside the mind of another. The investigation aimed to not only portray an experience of psychosis but one that was ‘artistic’. It further asks if such an endeavour could prove ‘useful’. Though I can only speak from my experience of the work [1], it did seem effective in conveying elements of this experience, such as; loss of personal boundaries, and blurred borders between the body and space. Another element which resonates with Action Lab is the
Tactile Anchoring Device prototype 2
The first film of the Tactile Anchoring Device in progress, showing the use of brushes and fans to generate the illusion of an invisible hand... https://youtu.be/vHaB6HBbQrs The system is based on an Arduino controls two sets of identical stimuli which move in synchronisation with each other [ servo motor, articulating solenoids, fans, lamps etc] Once the participant is experiencing the illusion, the operator or autonomous systems can trigger a ‘shock’ or threat stimuli. This is currently in the form of a solenoid which releases a heaved plum line weight which drops into the empty space. See the project page here. http://antonyhall.net/blogtactile-anchoring-device/
Seeing with the tongue – Paul Bach-y-Rita –
"You don't see with the eyes. You see with the brain" Paul Bach-y-Rita, Science News Online 1 Sept, 2001; vol. 169, no. 9 Paul Bach-y-Rita was one of the first neuroscientists to study the idea of Neuroplasticity. He did a number of experiments on sensory substitution, developed the idea of "Brain Port" in 1998. This interface uses a camera to feed an image to an electrode array placed on the tongue. Blind patients were able to see using the tongue. And a chair, the back of which is packed with solenoids, the camera feeds an image to these. After time and with training the user is able to sense images, at first basic shapes, and with more time can sense more detail such
Aperture navigation
From the field research trip to the Middlewood Trust, I developed a set of goggles with a small hole and slot apertures. Participants report different perceptions of time and space, and of sound and distances. I thought I had walked for a great distance, only to find I had only moved a few meters. One participant spoke of having 'microscope eyes' and how 'the closer you get to things, the less you can see of them' focussing and depth of field also become more apparent. Here is the extract from my experience: "Seeing through the small aperture also had the effect of making things seem like an old movie [grainy and soft-edged]. After wearing these for a while, I could hear others
Navigations
The Ganzfeld [ 'total field' ] experiment is a form of perceptual deprivation, giving an experience of a uniform field of light [More information here] . has become a staple activity in my workshops. Rather than sitting still and listening to sounds I have been opening this up as a mobile activity, or 'navigation' as I have started to call it. It serves as an icebreaker, often requiring people to work in pairs to move through spaces, following ropes or sonic stimuli. The purpose is to heighten the participant's awareness through altering their perceptual experience of space. Participants become aware of new structures of light or start using the body in a different way in order to move, becoming more
Lenticular goggles
Speaking with an artist while making plans for a future Action Lab, I came up with the idea of making these lenticular glasses [Above], which use a lenticular lens [textured with lines or ridges] which have the effect of dividing the visual field into lines. In an urban or interior space, vertical and horizontal lines are common. These become enhance or reduced depending on the orientation of the lens. Using the lens in a vertical alignment, steps become invisible, but when the lens is rotated they become enhanced. Using a combination of both things get even stranger. Point light sources create strong bright lines. I have yet these in a natural environment.
Phantom Presence
This experiment induces the sensation of a phantom presence in the room. The participant blindfolded is asked to use a stylus to prod an empty space in front of them. Using a tactile feedback system and a robot arm, the participant feels as if they are prodding themselves in the back. As the experiment progresses the system adds a delay to this prodding. At this stage, the participants become freaked out believing that someone else if prodding them... https://youtu.be/GnusbO8QjbE Link to the paper... Neurological and Robot-Controlled Induction of an Apparition https://www.cell.com/current-biology/abstract/S0960-9822(14)01212-3
Augmented senses
In this experiment, they created a simple device [Hearspace App] incorporating a compass and headphones. It "allows users to reliably hear the direction of magnetic North as a stable sound object in external space on a headphone. They found that "long-lasting integration into the perception of self-rotation. Short training with amplified or reduced rotation gain in the magnetic signal can expand or compress the perceived extent of vestibular self-rotation, even with the magnetic signal absent in the test" I was struck by this statement "sensory substitution and augmentation research has aimed to restore sensory functionality from non-invasive afferent signals of artificial sensors...there has been little concrete evidence that truly perceptual experiences have ever been obtained via this approach" Sensory augmentation: integration of an auditory
Simulation of touch
https://www.youtube.com/watch?v=LKMndCEr4Mw
VR technology
Some notes and links, reflecting on the VR mask. The absurdity of the interface is both clumsy and undignified technology orientated experience.... https://www.youtube.com/watch?v=NtwZXGprxag The Sword of Damocles 1968 was the first HMD unit, invented by Ivan Sutherland. https://www.youtube.com/watch?v=gWLHIusLWOc "The intention of Birdly® is to fulfil people’s ancient dream of flying. With virtual reality (VR) and robotics technology, SOMNIACS creates an extremely vivid full-body experience that makes you instantly forget the mechanics and computer codes behind this spectacular apparatus. The immersive and interactive nature of Birdly® serves one goal: to enjoy the ultimate freedom of a bird and intuitively explore the skies." http://www.somniacs.co/ https://www.youtube.com/watch?v=qh2UdRKNqH4
Experimental Psychology Lab
I have been considering what an Experimental Psychology lab looks like. What objects might these contain? Typically these consist of office like rooms, chairs and tables, perhaps an observation room. These days a computer, sensors for eye tracking and biometric measurement would be commonplace. Headphones, and VR equipment. EEG and MRI image may also be used in more advanced studies. Ultimately Experimental Psychology is an interdisciplinary subject and experiments could cross over to neurosciences, AI and robotics. But a google search of Experimental Psychology laboratory yields some interesting results. I'd be interested to know what other instruments and devices I should look at when thinking about this field of research. Please let me know if you know what any of these items might
Clay Hand Experiment – Whitworth Art Gallery
This was the first of the public workshops performed specifically for my research. My experiments so far have taken place as 1-1 sessions in artists studios or at the university. In a more open drop-in format, the participants were invited to experiment on themselves. Opening up the environment to one of play rather than pure participation. Breaking the experimenter/participant loop, creating a flexible relationship between myself and the participants. This was more in keeping with the idea of a phenomenological investigation allowing the experience to ‘unfold’. This had a dual effect of actively involving and empowering the participants while being able to observe the process from the outside. This meant notes and make recordings could be taken more effectively. Further reading:Read more
Proprioceptive drift visualisation
[wpvideo VartTqKO ] My experiments show a strong ‘drift’ in the perceived location of the hand before and after the experiment. This is known as proprioceptive drift. I asked people to locate the position of their index finger under a platform before and after embodying a clay object. And also draw their hand without looking before and afterwards. This animation shows these superimposed, illustrating the drift away from the real location of the hand.
Radiona workshop, Zagreb
I'm doing a workshop related to my research, perceptual illusions and altering perception through experiments, Clay hand illusion and other activities based on sound and light and taste, at Radiona Zagreb, 21-22/04/2018 https://radiona.org/ check out the web Re-mapping the senses workshop page and resources here...
Fish-brain-machine
As part of my Enki exhibition at Kapellica Gallery in Ljubljana 2012, I developed a related perceptual illusions and brain hacks workshop with Marc Dusseiller [Hackteria], as part of the gallery’s Biotech program. We came up with the idea to make a special issue circuit for the workshop and we set to work designing a circuit the encapsulated the Enki project in miniature. After a couple late nights, we came up with this super cool PCB design. Marc worked hard to create a fully functional efficient design, which was also aesthetically pleasing. The outline of the fish is also the ground in the circuit. This has to be the most ultra minimal brain-machine available to build. 6 components. We spent further
Illusions of Invisible, alien hands, 3 arms, and shrinking bodies…
I have previously posted about the original 'rubber hand illusion' in which participants are convinced a fake rubber hand is their own. A classic low tech experiment that can help us "understand how sight, touch and “proprioception” the sense of body position, combine to create a convincing feeling of body ownership, one of the foundations of self-consciousness (Nature 1998, vol 391, p 756 )” Further to this research recent studies have gone on to experimentally induct of out of body experiences or create body swap illusions. [ Henrik Ehrsson and Olaf Blanke http://www.eurekalert.org/pub_releases/2007-08/ucl-foe081407.php ] Between these two experiments, several interesting versions of hand-related experiments also exist which demonstrate the plasticity of our body perception... The Alien Hand Experiment first created in the 1960s predates the Rubber hand experiment, seems more 'trick'
Blind drawing of hand
Blind drawing of hand starting from the left and using a continuous line, before and after experiments. Could this exercise be used as a measure of "proprioceptive drift" before and after 'Rubber hand illusion' type experiments? I will be exploring this idea soon with the research group at BEAM lab...
Clay hand drawings
Here are are a selection of drawn outlines of clay hands created by workshop participants aged 6 to 12 for the original clay hand experiment (see posts tagged rubber hand or clay hand) Participants of all ages were asked to create a hand and use it in place of a replica rubber hand, the idea was to test if a self-created hand was easier to connect with. The hands were then taken and worked on further, sometimes becoming more distorted and abstract.
Face as Interface
Trying to create a simple motion tracking patch using PD_extended and Gem, I came across this project by Elektro Moon Vision http://elektromoon.co.nr/ the mini App provides OSC data from movements such as eyebrows, nose, mouth, orientation scale etc. This is massively useful for an experiment I have in mind related to the "strange face in the mirror illusion" The data can be captured and used to control a 3D model in virtual space for example. Matching rotation, scale and orientation to the model and the movement of my head... This is a simple motion detection patch that tracks the difference between two frames creating ghostly outlines of momentarily disembodied features. It's sensitive enough to pick up facial expressions such as the movement of muscles and
Rubber hands ‘feel’ touch that eyes see
The first report on the Rubber Hand illusion. Published in Nature in 1998 by Matthew Botvinick, and Jonathan Cohen of the Department of Psychiatry, University of Pittsburgh... "We report here an illusion in which tactile sensations are referred to an alien limb. The effect reveals a three-way interaction between vision, touch and proprioception, and may supply evidence concerning the basis of bodily self-identification." "It has been proposed that the body is distinguished from other objects as belonging to the self by its participation in specific forms of intermodal perceptual correlation7,8. Subjects in our first experiment who referred their tactile sensations to the rubber hand also consistently reported, in both sections of the questionnaire, experiencing the rubber hand as belonging to themselves. Indeed,
James Turrel – Light Reignfall
[vimeo 75419053 w=640 h=360] James Turrell's Light Reignfall @LACMA - Andrew van Baal James Turrell's Light Reignfall Light Reignfall is a work from his series of perceptual cells, inside the participant is exposed to a uniform homogenous field of modulated light. A combination of sensory overstimulation, yet deprived of recognisable forms or space, hallucinatory effects are experienced. “Assisted by an attendant, an individual viewer enters a spherical chamber on a sliding bed. A program of saturated light (operated by a technician) surrounds the viewer for twelve minutes, allowing the visitor to experience the intense, multi-dimensional power of light and the complex seeing instrument of the human eye.” "James Turrell (b. 1943, Los Angeles), a key artist in the Southern California Light and Space movement
Notes on olfactory art
Olfactory art or Scent art has been growing over recent years, And I would agree with the premise, that 'it has been long disregarded as one of the lower senses' [scentart.net] I remember turning up for the opening of my own exhibition and discovering that along with the beverages, a selection of delicious snacks had been presented on tables placed inside the gallery space. The smell of the food filled the gallery and I felt at the time that this took away from the work. The smells that would have accompanied the work would have been, hot electronics and detergent. perhaps a hind of coffee from another experiment. Here are a few links to useful sites/research on the subject: "The sense of smell has long been
What is Somaesthetics?
The work of Olafur Eliasson and Carsten Höller are prime examples of artists working with perceptual systems in which the viewers become active participants. This could be called 'Perceptual Art' but this term is not widely used, and it has been in a limited sense referring to artwork using optical illusion. In light of this, searching for an umbrella term for artwork that uses experiential and multisensory elements, I stumbled across the term 'Somaesthetics' "an interdisciplinary field whose roots are in philosophical theory, somaesthetics offers an integrative conceptual framework and a menu of methodologies not only for better understanding our somatic experience but also for improving the quality of our bodily perception, performance, and presentation " [1] first coined by Richard Shusterman in 1996 There is
God Helmet
Neurologist Michael Persinger created the God Helmet, an actual helmet modified with electrical coils that can create electromagnetic fields in the wearer's temporal lobes that induces "religious" experiences in the people who put it on. "This is a device to investigate whether religious, spiritual, and mystical experiences had a natural rather than a supernatural source. He speculates that we are somehow programmed so that they can generate religious experiences via our brain's internal processes." I was interested in this experiment because of its use of sensory deprivation and the fact it would be relatively easy to recreate [see my DIY neurostimulation attempt 2009] for my Enki project. My plan was to drive it with frequencies generated by my electric fish [a low
Auditory illusion
Diana Deutsch developed some fascinating auditory illusions. These include the phenomenon of 'speech to song' whereby repeating loops of spoken word suddenly begin to sound like a song. In another illusion, 'phantom words' new words emerge from repeating fragments of words. To experience these all you need are headphones as the a stereo effect is essential, here is the link to her work.… Speech to song http://deutsch.ucsd.edu/psychology/pages.php?i=212 Phantom Words http://deutsch.ucsd.edu/psychology/pages.php?i=211 https://www.youtube.com/watch?v=EWzt1bI8AZ0 A nice example of sine wave speech from Joe Banks [Disinformation] has written about psychoacoustics in his book https://rorschachaudio.com/ I was lucky to meet him at The Sensorium of Animals workshop. "The McGurk effect" is a perceptual illusion that mixes a sound with the visual cue of a different sound, We see the mouth move and hear/see a mismatched sound, check out what happens... https://www.youtube.com/watch?v=aFPtc8BVdJk https://www.youtube.com/watch?v=7uHDMc4TEU8 This
Acupuncture, brainwaves, and electric fish
Some documentation from a day working with Greg Byatt developing a system to work with the IBVA [Brainwave visulisation] interface. Such as attaching the Electric signal discharge output from the Electric Fish to acupuncture pads placed on our arms, to see if we could perceive the signal and also seeing how the fish behaved. No conclusive results. More time needed! In preparation for the next Enki event, we spent the day testing the neuro-graphic interface; as an experiment, we patched a strong frequency via MIDI to a MAX patch so our brains were modulating all kinds of strange sounds. Later this will combine with the Enki interface as a form of feedback. In this image you can see the graphics of the brain activity and