These workshops took place at the School of Digital Arts (SODA) as part of the 'Co-Lab' unit, which is intended to get students working collaboratively across disciplines (Game design/sound/future media/film/photography). The 'messy interface' brief asked students to address the complex interface between real and unreal. My workshop was designed to get students working together and thinking about how our senses interact and how we can hack, or creatively disrupt the sensory interface. We looked at the long history of perception-changing technologies; from the microscope to early VR experiments, and the many strategies both artists and scientists have used to disrupt these technologies. After exploring some perceptual illusions and discussing our experiences, participants designed their own multisensory experiments that restricted, augmented,
Tag: perception
Plinth with unseeable object
I was honoured to be invited to contribute to WEDDING RITUAL an amazing curatorial project by Wes White / Wes Viola. I wrote about something Old [Plinth with unseeable object] Did something new [See the obscurist edition], proposed something borrowed and invented something blue [sort of]. "...Antony Hall is an extraordinary artist, experimentalist and thinker. His work frequently plays with our perception of reality, sometimes presenting as everlasting magic tricks (for example, his Perpetual Coffee Vortex and Continual Slow Drip). Hall is also one part of Owl Project, the sound-art collective responsible for the iLog, at least one incarnation of which Bjork is rumoured to have added to her collection of instruments. The ENKi project explored the limits of human interaction with electric fish. I was fortunate to study at Strode College with Tony (on the course now led by Duncan Cameron, then our sculpture tutor), and have followed his artistic
Alfons Schilling
"Schilling's work is a discourse on the anatomy of illusion. a return to the physical experience of perception. this work locates the visual experience in the brain by completing its visual text there. The art of Schilling opens up a critical dialogue between the arts. This view of art as a sense experience, as the convergence of the work and the perceiver, which brings the work into existence, establishes the basis of that experience as a means of deconstructing reality and constructing through that experience a path toward a renewal, and the opening up of the perceptual (sense) experience." John G. Hanhardt, Curator of Film and Video, Whitney Museum of American Art, New York 1977. Random Dot stereo works https://www.alfonsschilling.net/werke/randomdot-stereo/ http://www.vasulka.org/archive/Artists6/Schilling,Alphons/SchillingPoster2.pdf http://www.vasulka.org/archive/Artists6/Schilling,Alphons/ElectronicSpaces,etc.pdf An article discussing the
Carsten Holler / Olafur Eliasson
Carsten Holler is a key example within this study, often re- appropriating science for the purposes of art. Staging ‘Quasi-scientific’ experiments (Windsor, 2018) which transform the gallery into a laboratory. Often disorientating the viewer, or more appropriately, the participant. As well as the large-scale installations smaller performative works such as ‘Kit for Exploration of the Self’ (Carsten. Holler, 1995) take the form of durational perception changing instruments such as ‘Upside Down Glasses’ (Carsten Holler, 1994-2018). These both directly re-appropriate methods from experimental psychology (Stratton, 1896). Many of the works require the participant to travel through them or offer the opportunity to make decisions of which there are no return or unknown outcomes, further reinforcing this active notion of experience as
Augmented hands
‘Augmented hand series’ by Golan Levin, Chris Sugrue, and Kyle McDonald, 2013-2015) ‘MIRAGE Illusion Box’ (Roger Newport, 2008) These are two very similar projects which both transform the image of a hand in real time using Augmented Virtuality (AV, the digital manipulation of real-world objects). Both take the form of a black box, into which the hand is placed. When inside the participant can see their hand as if looking through a window into the box. Inside the box, a system of mirrors and motion tracking is used. An augmented or distorted digital image of the hand is relayed to a screen on the top of the box. Despite the technical similarities, both works stem from entirely different motivations. The ‘MIRAGE Illusion Box’ (Newport, 2018)
Be Another Lab
This International group interdisciplinary group adopt mechanisms employed in the cognitive sciences, such as the work of Mel Slater, and the arts. Their project ‘The Machine to Be Another’ allows anyone to experience a perspective from the body of an-other. The group speak of ‘expanding subjective experience’ and ‘understanding the relationship between identity and empathy from an embodied perspective’ (http://beanotherlab.org/) Using HMDs and live video, they have developed a number of critical applications. Investigating a wide range of issues including gender and disability. The group study the impact this work can have on people’s lives, employing methods of action research and co-creation. Be Another Lab embraces an open source approach. Sharing and developing their project through workshops, making the tools and
Meeting With Sally Linkenauger
Notes from a meeting With Sally Linkenauger Lancaster University Psychology Dept. After discovering Sally's research at the BRnet conference I wanted to experience her experiments, so I asked if I could visit her lab. The VR lab looks like a normal office space, PCs scattered around the outside, and loads of VR tech hanging around. On closer inspection, a network of cameras is installed around the space to enable complex motion capture and augmented reality experiments to be undertaken. There is a treadmill in the corner. In the experiment I tried, a leap motion sensor captures the movements of your real hand, allowing you to articulate a virtual hand. The experiment requires some time to become used to the VR environment. At first,
Fieldwork / Night walk
I teamed up with artist Annie Carpenter to pull together a small group of artists and friends for a night of ‘fieldwork’. We organised an overnighter to do some experiments and have discussions together in the relaxed atmosphere of Middlewood Trust study centre; an off-grid permaculture farm. I had worked here before with [Annie and Sam Illingworth] doing some workshops with their students on a previous 'field research' style project. The concept captured my interest. We wanted to create a situation where we could work as well as have time and space to chat about ideas with others. My equipment consisted of my laptop, Arduino, [with a relay shield for experiments] and some electronics, GoPro, 360-degree camera. Also a heavy rechargeable
Poster – BRnet Conference 2018
Electronic Taste Perception Workshop – Radiona
[Here is some documentation from one of the activities for the 're-mapping the senses workshop earlier this year...] Our sense of taste is directly affected by the colour and smell of the food. Experiments prove that the colour of a drink affects our perception of its sweetness for example. Altering the sound of the food, say adjusting the high-end frequencies while eating crisps can also affect our perception of the crunchiness of those crisps [see the paper here. Playing with these assumptions and expectations can create heightened food experiences. There have been a number of studies that suggest it is possible to simulate Sweetness, bitterness, sourness. Specifically, we test these settings as claimed by the Vocktail project [see below] to simulate the following sensations... Sour: magnitude of current: 180
Proprioceptive drift visualisation
[wpvideo VartTqKO ] My experiments show a strong ‘drift’ in the perceived location of the hand before and after the experiment. This is known as proprioceptive drift. I asked people to locate the position of their index finger under a platform before and after embodying a clay object. And also draw their hand without looking before and afterwards. This animation shows these superimposed, illustrating the drift away from the real location of the hand.
Fish-brain-machine / Radiona workshop
After constructing the Fish-brain-machine PCB circuits we spent some time experimenting and describing the hallucinogenic visuals created by the stroboscopic light. The ping pong balls over the eyes diffuse the LED light, making for a more intense effect - and enabling use with eyes open. Here they describe some of the effects including seeing colours and 'a strange experience' of seeing with only one eye - I get this exact same feeling when using it. It is also hard to know if your eyes are open or closed. [See also Re-mapping the senses workshop ] https://www.youtube.com/watch?v=Lwne5xICLkI
Spontaneous sensations
Possibly one of the simplest experiments possible to conduct, requiring no special equipment. Simply stare at your hand for 5 mins. The experiment is described in the paper “the tickly homunculus and the origins of spontaneous sensations arising on the hands" in which you focus on your hand while staring at it (convergent focusing) or divergent focusing (staring at red marker next to the hand you are focussing on) for just 10 seconds and report the sensations. Here are the outcomes superimposed from 8 participants. In this experiment, many of the bemused participants described a tingling where the hand made contact with the table. They were bemused because I did this experiment in the context of our methods and methodologies discussion group - where I was
Radiona workshop, Zagreb
I'm doing a workshop related to my research, perceptual illusions and altering perception through experiments, Clay hand illusion and other activities based on sound and light and taste, at Radiona Zagreb, 21-22/04/2018 https://radiona.org/ check out the web Re-mapping the senses workshop page and resources here...
Fish-brain-machine
As part of my Enki exhibition at Kapellica Gallery in Ljubljana 2012, I developed a related perceptual illusions and brain hacks workshop with Marc Dusseiller [Hackteria], as part of the gallery’s Biotech program. We came up with the idea to make a special issue circuit for the workshop and we set to work designing a circuit the encapsulated the Enki project in miniature. After a couple late nights, we came up with this super cool PCB design. Marc worked hard to create a fully functional efficient design, which was also aesthetically pleasing. The outline of the fish is also the ground in the circuit. This has to be the most ultra minimal brain-machine available to build. 6 components. We spent further
Strange face illusion with two-way Mirror feedback
“… a quiet room dimly lit by a 25 W incandescent light. The lamp was placed on the floor behind the observer so that it was not visible either directly or in the mirror. A relatively large mirror (0.5 m60.5 m) was placed about 0.4 m in front of the observer. The luminance of the reflected face image within the mirror was about 0.2 cd mÿ2 and this level allowed detailed perception of fine face traits but attenuated colour perception…The task of the observer was to gaze at his/her reflected face within the mirror. Usually, after less than a minute, the observer began to perceive the strange-face illusion…” Giovanni B Caputo, Perception, 2010, volume 39, pages 1007 – 1008 2010
Mechanically Augmented Reality
When I first learned about the Rubber hand illusion [RHI] I immediately began to think about ways in which the process could be automated to create an artwork, in which the experimenter's presence was removed. This could be done using sensors and a microcontroller to articulate solenoids to tap fingers for example. That thought train was on a back burner until discovered the work of fellow MMU PGR Lin Charlston. As part of her PhD research [See her profile here 'The Multimodal book as organism, artefact and assemblage: non-human agency in processes of growing and making'] She invented a beautifully simple, entirely mechanical device just to do exactly this. Your hand is placed inside a box, while the other hand turns a crank. On top of the box, another rubber hand
On the embodiment of unfeasible objects
Further to my last post detailing experiments relating to the embodiment of invisible and even third hands, here are some notes on my first 'Clay hand Illusion' experiments... The ‘Rubber hand illusion’ shows it is possible to convince participants that a rubber hand is their own by placing it in front of them while stroking it in the same way as their hidden real hand. The use of self-made clay hands, or objects [see below] in place of the rubber hand raises several interesting possibilities for exploration, which move away from the embodiment of replica body parts, and towards the possible embodiment of modified body parts, or completely 'unfeasible' objects.The clay allows for the gradual and immediate morphing of forms and for the
Illusions of Invisible, alien hands, 3 arms, and shrinking bodies…
I have previously posted about the original 'rubber hand illusion' in which participants are convinced a fake rubber hand is their own. A classic low tech experiment that can help us "understand how sight, touch and “proprioception” the sense of body position, combine to create a convincing feeling of body ownership, one of the foundations of self-consciousness (Nature 1998, vol 391, p 756 )” Further to this research recent studies have gone on to experimentally induct of out of body experiences or create body swap illusions. [ Henrik Ehrsson and Olaf Blanke http://www.eurekalert.org/pub_releases/2007-08/ucl-foe081407.php ] Between these two experiments, several interesting versions of hand-related experiments also exist which demonstrate the plasticity of our body perception... The Alien Hand Experiment first created in the 1960s predates the Rubber hand experiment, seems more 'trick'
Blind drawing of hand
Blind drawing of hand starting from the left and using a continuous line, before and after experiments. Could this exercise be used as a measure of "proprioceptive drift" before and after 'Rubber hand illusion' type experiments? I will be exploring this idea soon with the research group at BEAM lab...
Clay hand drawings
Here are are a selection of drawn outlines of clay hands created by workshop participants aged 6 to 12 for the original clay hand experiment (see posts tagged rubber hand or clay hand) Participants of all ages were asked to create a hand and use it in place of a replica rubber hand, the idea was to test if a self-created hand was easier to connect with. The hands were then taken and worked on further, sometimes becoming more distorted and abstract.
Drawing a strange face in the dark
Shortly after my experience of the "Strange face in the mirror experiment" I made these drawings in low light conditions as a way of recording the perceivable elements of my face and shape of the head. The particles of carbon and graphite reflect well the visual noise, like static, one experiences in the experiment. These drawings don't illustrate the hallucinations I experienced [these will follow] "staring at one's own reflection in a mirror in a darkened room for some time can induce vivid hallucinations. For purposes of research, I had to try it" My experience of the ‘strange face illusion’... For my description of my experience of the 'strange face', illusion see here... "staring at one's own reflection in a mirror in a darkened room for
Rubber hands ‘feel’ touch that eyes see
The first report on the Rubber Hand illusion. Published in Nature in 1998 by Matthew Botvinick, and Jonathan Cohen of the Department of Psychiatry, University of Pittsburgh... "We report here an illusion in which tactile sensations are referred to an alien limb. The effect reveals a three-way interaction between vision, touch and proprioception, and may supply evidence concerning the basis of bodily self-identification." "It has been proposed that the body is distinguished from other objects as belonging to the self by its participation in specific forms of intermodal perceptual correlation7,8. Subjects in our first experiment who referred their tactile sensations to the rubber hand also consistently reported, in both sections of the questionnaire, experiencing the rubber hand as belonging to themselves. Indeed,
James Turrel – Light Reignfall
[vimeo 75419053 w=640 h=360] James Turrell's Light Reignfall @LACMA - Andrew van Baal James Turrell's Light Reignfall Light Reignfall is a work from his series of perceptual cells, inside the participant is exposed to a uniform homogenous field of modulated light. A combination of sensory overstimulation, yet deprived of recognisable forms or space, hallucinatory effects are experienced. “Assisted by an attendant, an individual viewer enters a spherical chamber on a sliding bed. A program of saturated light (operated by a technician) surrounds the viewer for twelve minutes, allowing the visitor to experience the intense, multi-dimensional power of light and the complex seeing instrument of the human eye.” "James Turrell (b. 1943, Los Angeles), a key artist in the Southern California Light and Space movement
Notes on olfactory art
Olfactory art or Scent art has been growing over recent years, And I would agree with the premise, that 'it has been long disregarded as one of the lower senses' [scentart.net] I remember turning up for the opening of my own exhibition and discovering that along with the beverages, a selection of delicious snacks had been presented on tables placed inside the gallery space. The smell of the food filled the gallery and I felt at the time that this took away from the work. The smells that would have accompanied the work would have been, hot electronics and detergent. perhaps a hind of coffee from another experiment. Here are a few links to useful sites/research on the subject: "The sense of smell has long been
What is Somaesthetics?
The work of Olafur Eliasson and Carsten Höller are prime examples of artists working with perceptual systems in which the viewers become active participants. This could be called 'Perceptual Art' but this term is not widely used, and it has been in a limited sense referring to artwork using optical illusion. In light of this, searching for an umbrella term for artwork that uses experiential and multisensory elements, I stumbled across the term 'Somaesthetics' "an interdisciplinary field whose roots are in philosophical theory, somaesthetics offers an integrative conceptual framework and a menu of methodologies not only for better understanding our somatic experience but also for improving the quality of our bodily perception, performance, and presentation " [1] first coined by Richard Shusterman in 1996 There is
God Helmet
Neurologist Michael Persinger created the God Helmet, an actual helmet modified with electrical coils that can create electromagnetic fields in the wearer's temporal lobes that induces "religious" experiences in the people who put it on. "This is a device to investigate whether religious, spiritual, and mystical experiences had a natural rather than a supernatural source. He speculates that we are somehow programmed so that they can generate religious experiences via our brain's internal processes." I was interested in this experiment because of its use of sensory deprivation and the fact it would be relatively easy to recreate [see my DIY neurostimulation attempt 2009] for my Enki project. My plan was to drive it with frequencies generated by my electric fish [a low
Auditory illusion
Diana Deutsch developed some fascinating auditory illusions. These include the phenomenon of 'speech to song' whereby repeating loops of spoken word suddenly begin to sound like a song. In another illusion, 'phantom words' new words emerge from repeating fragments of words. To experience these all you need are headphones as the a stereo effect is essential, here is the link to her work.… Speech to song http://deutsch.ucsd.edu/psychology/pages.php?i=212 Phantom Words http://deutsch.ucsd.edu/psychology/pages.php?i=211 https://www.youtube.com/watch?v=EWzt1bI8AZ0 A nice example of sine wave speech from Joe Banks [Disinformation] has written about psychoacoustics in his book https://rorschachaudio.com/ I was lucky to meet him at The Sensorium of Animals workshop. "The McGurk effect" is a perceptual illusion that mixes a sound with the visual cue of a different sound, We see the mouth move and hear/see a mismatched sound, check out what happens... https://www.youtube.com/watch?v=aFPtc8BVdJk https://www.youtube.com/watch?v=7uHDMc4TEU8 This
Acupuncture, brainwaves, and electric fish
Some documentation from a day working with Greg Byatt developing a system to work with the IBVA [Brainwave visulisation] interface. Such as attaching the Electric signal discharge output from the Electric Fish to acupuncture pads placed on our arms, to see if we could perceive the signal and also seeing how the fish behaved. No conclusive results. More time needed! In preparation for the next Enki event, we spent the day testing the neuro-graphic interface; as an experiment, we patched a strong frequency via MIDI to a MAX patch so our brains were modulating all kinds of strange sounds. Later this will combine with the Enki interface as a form of feedback. In this image you can see the graphics of the brain activity and
Enki Manchester Science Museum
Some of the early experiments for the Enki project at Museum of Science and Technology Manchester 2007... We recorded brainwave data and monitored the behaviour of the electric fish during the experiment. The electrical activity of the fish is experienced as sound and light via ENKI (a stroboscopic high frequency led placed close to eyelid) and the natural binaural frequencies produced by the interaction and communication between Black Ghost Knife fish. The participant's bio-electric field was connected to the aquarium allowing the fish to sense a human (bio)electric image or presence. Museum of Science and Industry Manchester, 7th October 2006