Perspectives from neuroscience, clinical & experimental social psychology and new technologies Notes from the Body up Conference UoM 13th June 2019 https://bodyupmanchester.wixsite.com/uomconference Our behaviour and self-perception effect the way in which we see others. We read others body language in order to make judgements on their thoughts and feelings. New research suggests Autistic individuals move their bodies differently, and that in a way, are speaking a different body language. Understanding this helps explain why they have difficulties reading our intentions and emotions. Jennifer Cooks research on movement kinematics showed how gait point models, captured through motion capture, could convey different emotions through their walking style. For example, most people can notice someone one walking style as ‘angry' or ‘sad’. However - the
Author: antonyhall
Artist, educator, and researcher working between the fields of science and art.
6 finger and shrunken Finger illusions
Roger Newport gave a talk on his research at the Body Up conference last week. [See work with the MIRAGE box here Augmented Hands] Speaking to him afterwards, he asked if I had ever experienced the 6 finger Illusion? He reached into his bag and revealed a mirror which he placed on the table. Placing my hand one side of the mirror, he skilfully performed the illusion. Looking into the mirror I watched as each finger was stroked predictably in series, moving from thumb to the little finger, but then continuing to apparently stroke an invisible 6th finger. This worked perfectly for me. What is really interesting is that apparently a very small amount of people have reported seeing this
Autoscope testing at studio
Autoscope prototype
Autoscope builds on laboratory-based simulations of out of body experiences; the portable device allows the participant to freely navigate the world, experiencing themselves in 3rd person, as part of the landscape via a live video feed to a head-mounted display. The visual mechanisms are important in this illusion, but tactile and sonic stimuli further strengthen the effects. Autoscopy can be described as the disembodied perception of seeing one own body from an elevated or distanced location outside the body. The phenomena of the ‘out of body experience’ during heightened states of heightened consciousness or near-death experience tend to have spiritual or shamanistic connotations, but in recent times science has done much to demystify this phenomenon, identifying the neural mechanisms responsible.
Action Intention Paradox
In this experiment, which is now renamed the 'Alien Hands Experiment' one participant [A] places their hands under a flat-screen monitor. They then see what seems to be their own hands under the screen when in fact these are someone else's hands [B] who is mirroring their actions. The effect can be quite uncanny especially if the appearance of the hand contrast with their own [in scale, age or colour. Participants work together to lead or mirror the movements of what appears to be their own hands under a screen. After a short time, participants experience strange sensations which oscillate between a loss of agency over their own hands and feeling agency over someone else's hands. Action Intention Paradox uses a
Ganzfeld and Mirror Gaze
1-1 experiment sessions in the studio I invited participants to come to my studio to take part in phase 2 of my research. This opens up to using the Ganzfeld and the Strange Face in the Mirror Illusion. Both use white noise connected to a system of biofeedback, using Galvanic skin response signals to subtly modulate the noise. Through this, I have been developing my interview technique and also the working questions that I ask. This has resulted in a new artwork which is taking the form of a questionnaire. Currently, I'm referring to it as the "Hall Anomalous Perception scale" a tongue in cheek reference to the Cardiff scale designed to asses experiences of anomalous perceptions in daily life. A participant
Clay Hand Experiments
Workshops at Manchester City Art Gallery The aim was to deliver an engaging fun activity for all the family which related to the theme of the body and ideas around perception illusion referencing the Leonardo show as well as the Bridget Riley drawings in the Gallery. The workshop was open as a drop-in open to the general public and over the 8 days, we had around 800 people take part in total. The workshop served as an introduction to the idea of ‘perceptual and multisensory illusions’ and was based around my Clay Hand Experiment. I asked participants to work collaboratively to create their own hands and 'unfeasible objects 'with which to perform their own experiments on each other. It provided a
[Re]Mapping perception
Documentation from the [Re]Mapping perception workshop at LJMU 2 May 2019 Here is the original invitation... A workshop for artists/researchers engaging in a wide range of practice-based and artistic research methodologies. It aims to explore interdisciplinary methods through a series of provocations in embodied multisensory experience, designed to enhance our perception and self-awareness. The workshop provides an open space for participants from different fields to meet, communicate findings, share paradigms, and explore the value of sensory perception and awareness in our research. It also offers an opportunity to meet Madeline Schwartzman and gain insight into the works discussed in her new book See Yourself X: Human Futures Expanded. Her public lecture follows the workshop [ Places can be booked here https://www.eventbrite.com/o/antony-hall-19862154602 ] [Re]Action Lab is an
Mirror Gaze Box
A rapidly prototyped blackout box for the mirror gaze box, this is to create a dark space for the Mirror Gaze Experiment. Inside is an Infra Red LED spotlight and modified web camera. The camera films the participant in real time from behind a two-way mirror, as they experience the illusory effect of sensory deprivation. Mirror Gaze Box - prototype
IR Camera hack
For the Mirror Gaze experiment, I need a camera that works in darkness and can pick up Infrared light. Most webcams have an IR filter. Many such as this Logitech HD webcam have instruction online. Turns out mine was a slightly different model to this and meant that the entire thing needed dismantling and the camera module had to be unsoldered to get to the filter.
Experience in progress
EXPERIENCE IN PROGRESS, 35x50mm badge in 60×80 Foil printed box, text insert and authenticity statement / signed edition of 100. [buy it here] I made this badge to celebrate a chance occurrence that has had a lasting effect on my work ever since. Back in 2006, I was working with electro-genic fish at the Centre des neuroscience [CNRS] near Paris. Frustrated and stuck, I went for a walk, aimlessly wandering the corridors. I noticed a sign on a laboratory door saying “Experience en cours” ( ‘experiment in progress’). I took this photo. Moments later on the way back, I found the door was ajar. I knocked on it and peeped in. I ended up having a fascinating conversation with a scientist
Accelerometer experiments
Stereoscopic camera experiments
Meta-Perceptual Rail
The meta-perceptual rail is a linear track along which mount mirror apertures and other props and stimuli can be mounted. It is used for meta-perceptual experiments, testing the limits of visual and meta-perceptual experience. It can be used as an introspective device to explore metaphysical and somaesthetic questions of our experiences and location self in relation to the physical body. 'Such rails are typically made of wood and designed to be very stiff. The rail normally begins with a chin rest followed by a graduated grove extending from this point. This allows other features such as holders for perceptual stimuli, filters, apertures, mirrors and cameras to be bolted down and precisely shifted along the length of the rail.'
Marina Abramović – An Artist’s Life MANIFESTO
Thinking about manifestos, this seems to resonate somehow with both life and art. https://www.youtube.com/results?search_query=Art+Meets+Science+and+Spirituality+in+a+Changing+Economy https://hirshhorn.si.edu/wp-content/uploads/2012/04/An-Artists-Life-Manifesto.pdf
Autoscope backpack
My alloy backpack arrived and has proved perfect for the job of supporting a laptop and a 2m long boom. As an object, It certainly has a vintage feel and a clear aesthetic reference to Roman Signer. this seems entirely appropriate, something about the strangeness of the endeavour as well as the metaphorical notions of escape and travelling through the imagination.
Synanet workshop: Disrupt Encode Consolidate
Notes for the collaborative Art & Bio-science Workshop at Lancaster University, UK on Monday 17th to Wednesday 19th December 2018I had a very interesting 3 days at Lancaster University participating in the Synanet workshop. The idea was to bring together interdisciplinary practice across the sciences and arts, to explore ideas in neuroscience research and BioArt. The workshop “aimed to DISRUPT dogmatic thinking across these disciplines, ENCODE new approaches and insights through shared interactions and CONSOLIDATE these ideas through artistic expression” https://cheapjack.github.io/DisruptEncodeConsolidate/ It consisted of scientific demonstrations and hands-on activity was to provide insight into the theory and practice of neuroscience research. FMRI [functional brain imaging] behavioural analysis in mice and Fruit Fly’s and Sand Fly’s, And some presentations about the “gut-micro-biome-brain interface”. Most interestingly “ …The workshop aimed to
Psychometric tests
I took part in a study at BEAM LAB as a 'neurotypical control subject. This was my first experience in experimental psychology as a participant. I found this deeply significant for my research; actually experiencing the full process of an experiment in the context of a lab. There were a number of questionnaires and tasks. Psychometric tests are concerned with the measurement of mental abilities, personality traits, intelligence. Typically these will be questionnaires and other puzzles 'tasks'. I found the activity to be deeply relaxing. also the format, in my opinion, ripe for creative subversion. It generated a lot of new ideas which I will write about this experience in more detail soon.
Constructing a sense of self
"He felt dizzy, stood up, turned around, and saw himself still lying in bed. He was aware that the person in bed was him, and was not willing to get up and would thus make himself late for work. Furious at the prone self, the man shouted at it, shook it, and even jumped on it, all to no avail..." This article encapsulates some of the most important ideas, concepts and developments which lead towards the experiments on the simulation of out of body experiences. The article mentions Peter Brugger, Olaf Blanke and Thomas Metzinger, as well as some details of patient experiences, and the story of how this experiment came about. As well as the illusion of seeing one's self"autoscopy' There
Alfons Schilling
"Schilling's work is a discourse on the anatomy of illusion. a return to the physical experience of perception. this work locates the visual experience in the brain by completing its visual text there. The art of Schilling opens up a critical dialogue between the arts. This view of art as a sense experience, as the convergence of the work and the perceiver, which brings the work into existence, establishes the basis of that experience as a means of deconstructing reality and constructing through that experience a path toward a renewal, and the opening up of the perceptual (sense) experience." John G. Hanhardt, Curator of Film and Video, Whitney Museum of American Art, New York 1977. Random Dot stereo works https://www.alfonsschilling.net/werke/randomdot-stereo/ http://www.vasulka.org/archive/Artists6/Schilling,Alphons/SchillingPoster2.pdf http://www.vasulka.org/archive/Artists6/Schilling,Alphons/ElectronicSpaces,etc.pdf An article discussing the
Rubber/clay Hand experiment UoM
I supported some seminars on the Rubber Hand Experiment with undergraduate psychology students, presenting some of my research ideas [unfeasable objects and the Clay Hand Experiment] The idea was they experience the experiment for themselves before designing their own.
Fieldwork under the ‘Darkest sky’
I was invited by Annie Carpenter and Nicola Ellis to Allenhead Arts for a few days of art and science during the night of the Orionids meteor shower, hoping for clear yet dark skies. They had been resident artists there over the last few months https://www.acart.org.uk/ . In a continuing effort to make my activities more sustainable and portable, I decided to cycle from Penrith to a remote location in the heart of the North Pennines which boasts the darkest skies in the UK. I was one of the most hellish bike rides I have ever endured. And I am no stranger to big hilly bike rides. One of my typical problems when taking part in this kind of open-ended participatory creative
Eye tracking experiment planning
Inspired by last weeks conference and some examples of how artists are working with Eye Tracking, I went back to BEAM Lab the following week to start the process of learning how to set up my own experiment using Eye-tracking. My plan is to incorporate this with the strange face in the mirror experiment. My main problem is how do I calibrate the sensor - if I am to measure how they look at a reflection how do I map this precisely to the sensors. Normally the experiment has the participant looking directly at a screen surface, but how would this work with a reflected image? So I need to get a two-way mirror and perhaps get the participants to draw the
Eye tracking in arts research
Notes from the Digital Humanities, Human Technologies / AHRC NWCDTP Postgraduate Conference 2018 / part 1 https://nwcdtpconference2018.wordpress.com/home/ John Merrill [MMU] presented his project; Portrait as Landscape: Rendering the Unseen surface of the face. He explained some ideas behind visual perception and the evolution of the eye, and its flaws which were a great introduction to the project. Merrill creates digitally processed high contrast, large-scale photographs. Sharpening and enhancing the surface topography and textures of the face. The idea is that attention is taken away from thinking about the character of the person pictured, and moving away from the stereotypes associated with how we recognise faces and make judgments about character. The idea is that we are left to think about the more
Tactile Anchoring Device [Images]
Carsten Holler / Olafur Eliasson
Carsten Holler is a key example within this study, often re- appropriating science for the purposes of art. Staging ‘Quasi-scientific’ experiments (Windsor, 2018) which transform the gallery into a laboratory. Often disorientating the viewer, or more appropriately, the participant. As well as the large-scale installations smaller performative works such as ‘Kit for Exploration of the Self’ (Carsten. Holler, 1995) take the form of durational perception changing instruments such as ‘Upside Down Glasses’ (Carsten Holler, 1994-2018). These both directly re-appropriate methods from experimental psychology (Stratton, 1896). Many of the works require the participant to travel through them or offer the opportunity to make decisions of which there are no return or unknown outcomes, further reinforcing this active notion of experience as
Augmented hands
‘Augmented hand series’ by Golan Levin, Chris Sugrue, and Kyle McDonald, 2013-2015) ‘MIRAGE Illusion Box’ (Roger Newport, 2008) These are two very similar projects which both transform the image of a hand in real time using Augmented Virtuality (AV, the digital manipulation of real-world objects). Both take the form of a black box, into which the hand is placed. When inside the participant can see their hand as if looking through a window into the box. Inside the box, a system of mirrors and motion tracking is used. An augmented or distorted digital image of the hand is relayed to a screen on the top of the box. Despite the technical similarities, both works stem from entirely different motivations. The ‘MIRAGE Illusion Box’ (Newport, 2018)
Be Another Lab
This International group interdisciplinary group adopt mechanisms employed in the cognitive sciences, such as the work of Mel Slater, and the arts. Their project ‘The Machine to Be Another’ allows anyone to experience a perspective from the body of an-other. The group speak of ‘expanding subjective experience’ and ‘understanding the relationship between identity and empathy from an embodied perspective’ (http://beanotherlab.org/) Using HMDs and live video, they have developed a number of critical applications. Investigating a wide range of issues including gender and disability. The group study the impact this work can have on people’s lives, employing methods of action research and co-creation. Be Another Lab embraces an open source approach. Sharing and developing their project through workshops, making the tools and
Labyrinth Psychotica
Labyrinth Psychotica is an artistic research project that aims to simulate the experience of psychosis. It uses multisensory [tactile and sonic] elements in combination with the maze environment, to create a fully immersive experience. The maze mechanism also serves as a metaphor for attempting to get inside the mind of another. The investigation aimed to not only portray an experience of psychosis but one that was ‘artistic’. It further asks if such an endeavour could prove ‘useful’. Though I can only speak from my experience of the work [1], it did seem effective in conveying elements of this experience, such as; loss of personal boundaries, and blurred borders between the body and space. Another element which resonates with Action Lab is the
Tactile Anchoring Device prototype 2
The first film of the Tactile Anchoring Device in progress, showing the use of brushes and fans to generate the illusion of an invisible hand... https://youtu.be/vHaB6HBbQrs The system is based on an Arduino controls two sets of identical stimuli which move in synchronisation with each other [ servo motor, articulating solenoids, fans, lamps etc] Once the participant is experiencing the illusion, the operator or autonomous systems can trigger a ‘shock’ or threat stimuli. This is currently in the form of a solenoid which releases a heaved plum line weight which drops into the empty space. See the project page here. http://antonyhall.net/blogtactile-anchoring-device/