Circuit-bending the different strobe lights enabling them to be triggered by the signal from the CV gate

The idea was to have an analog eurorack kick module triggering the strobe light so their rhythm pattern matches on the go during the live performance. Firstly I was researching how to achieve such an effect digitally but in the end I have chosen an analog approach which appeared to be the most simple, straight forward and cheap.

I have used the relay to trigger the light with the gate signal. The most of relays require voltage at least 5V in order to open circuit but I found relay which opens with 3V. Trigger is set as ‘NO’ (normally open) so it switches only temporarily in the similar way like pressing a button.

Battery powered strobe light trigged by gate from Arturia Beatstep Pro. Arduino here is used only as 3.3V power supply.
Arturia Beatstep Pro gate triggers Kick module together with strobe light via signal splitter
Sketch of the schematics
Application of the relay to another strobe light powered by 240V. The discharge lamp is peaking at 400V.
Application of the gate triggered strobe light in the performance – I have positioned the strobe within a coffin chamber of the crypt under the church in St Pancras where I performed live on 29th October 2023.

Thoughts on the podcast ‘Sounding History – Data in the Anthropocene: Carbon Footprint & the Environmental Endgame’

Music historians Chris Smith and Tom Irvine are in their podcast bringing their points of view on environmental impact of the digital media and streaming services in comparison to other musical media of ‘post-consumption era’ as well as ‘pre-consumption era’. Those were marked by transition from purely acoustic music to electronically recorded and reproduced to recording media like shellac records, vinyls, CDs etc.

“Every system of inscription is tied to a system of extraction. Every discourse network is a resource network.” (Devine, 2019)

Chris’s and Tom’s main outcome, based on Kyle Devine’s conclusion, is that every single type of record media which emerged in capitalistic consumer society is somehow linked to extraction of natural resources as well as contributing to environmental problems as many other human activities. An interesting point is highlighting the fact that apparent current streaming services aren’t less damaging than for example CDs, vinyls or shellac records in the past. Behind every streaming service stand huge servers consuming enormous amounts of electric energy so they can continuously work.

They also came with in my opinion very interesting historical analogy comparing this invisible impact or toll to the invisibility of sugar cane business prosperity being inherently rooted and dependent on trans-Atlantic slave trade. There has been happening an apparent progress in British cities like Bristol or Southhampton in 18th century but not many people could actually see that this ‘progress’ has been built on exploitation and enslavement of a large part of humanity. Similarly people cannot see the invisible impact of many many data servers on the carbon imprint and the climate change.

Another interesting topic which Chris and Tom touched is AI generated music, particularly AI Jazz. Is AI Jazz problematic? They came to the conclusion that people who make AI algorithms don’t know that algorithms are working and ‘risk reducers’, in this case reducing risk of ‘wrong’ musical decision, thus they are influencing the composition into something which is less creative and basically getting stuck at the same sounding composition over and over again. The human element of improvisational base of the jazz encompasses remembering what other people had done and picking up what works for the musician and not what note to play at the certain time, which is what the machine does – quickly calculating musical decisions.

Personally I see a problems in other parts of AI music too. I am not fearing of musicians being replaced. AI can be utilised as a part of the performance and compositions but the fully generated AI music might mis-place the historical background of music genres or sort of erasing those backgrounds. This could be extended to the whole ‘genre’ or approach of AI music. AI algorithm doesn’t know where for example jazz comes from and doesn’t know its historical background.

https://www.soundinghistorypodcast.com/episodes/episode-8

Devine, K. (2019). Decomposed : the political ecology of music. Cambridge, Ma: The Mit Press.

‘A Quiet Place’ – sound design research

Directed by: John Krasinski

Composer: Marco Beltrami

Sound Design: Brandon Jones

Supervising Sound Editors: Erik Aadahl, Ethan Van der Ryn

The big part of ‘A Quiet place’ narration through the sound consisted from the foley recording and the score. Both very specifically executed in since the movie is based on groundbreaking lack of sound which of course doesn’t mean the complete absence of it.

Sound designers who participated in creation of sound design for the film are Erik Aadahl and Ethan Van der Ryn. They mentioned that the sound was actually written into the script and played very significant role int the whole story telling, which doesn’t seem to be the usual practice.

Aadahl and Van der Ryn admitted the difficulty of a challenge to work on a movie with this much absolute silence. With barely any spoken dialogue or loud sound effects therefore “the quiet becomes loud and the loud becomes ear-piercing” (Alkhulaifi, 2022). They are mentioning that very interesting part of the post production was really scaling back and be more minimalistic with the use of the sound.

The lack of sound in the movie tells the story in a way that any loud sound inherently means death. This is John Krasinski’s main premise in the building the constant underlying tension. Classical horror movies are often based on ‘jump scares’ which can be criticised that they aren’t in fact scary but only startling and the tension from the scene dissolves quickly since the physiological response of the body doesn’t recognise ‘jump scare’ as an actual threat. You will not find many jump scares in ‘A Quiet Place’. Any causally louder sound either happening suddenly or brought up slowly and building with tension creates different physiological response which can prolong the feeling of the thrill of even the fear because viewer sympathise with characters knowing that the mere existence of the sound means danger.

The story telling with the sound in ‘A Quiet Place doesn’t end only with the building a thrill and tension by utilising the silence. Focus on quiet sounds play big role in the narrative, too, for example checking the hearth beat of unborn child with a stethoscope or romantic moment of sharing the earphone from the walkman whilst mother and father of the family are dancing together or masking quieter sounds by louder by ones when father and son freely talking whilst they are hidden behind the waterfall.

One of the main characters, the daughter, is deaf and played by deaf actress Millicent Simmonds. Film has several scenes which are nearly quiet or totally soundless to highlight her point of view. ‘A Quiet Place’ has been praised for its representation of the Deaf community, its use of American Sign Language (ASL), and being one of the first films to showcase the cochlear implant (Mendoza, 2021). In spite of the positive aspects of featuring deaf community ‘A Quiet Place’ overcomes ableism in the film industry only until certain extend and received also critiques. I will talk about those more in the reflective writing.

https://www.vox.com/2018/5/26/17396174/a-quiet-place-sound-design-loud

https://www.motionpictures.org/2018/04/the-a-quiet-place-sound-design-that-makes-audiences-afraid-of-their-own-noise/

https://digitalcommons.butler.edu/cgi/viewcontent.cgi?article=1419&context=the-mall

Mendoza, A. (2021). How a Quiet Place is Harmful to Those in Quiet Worlds. The Mall, [online] 5(1). Available at: https://digitalcommons.butler.edu/the-mall/vol5/iss1/11 [Accessed 22 Nov. 2023].

sites.northwestern.edu. (n.d.). Analysis of a Sound Design Piece — A Quiet Place 2018 – Mariam Alkhulaifi. [online] Available at: https://sites.northwestern.edu/mariamalkhulaifi/analysis-of-a-sound-design-piece-a-quiet-place-2018/

Foley plan for the clip from the movie ‘A Quiet Place’ – scene breakdown / script extraction

This is the plan for brainstorming initial ideas about the sound design and eventually making a more systematic plan for recording the foley. I have watched the clip with no sound, thinking about possibilities of sound design only based on my brief knowledge of the film without seeing the film before or approaching to the research. I broke down scene by scene describing events and actions happening considering also the movement of the camera. Next step will be to compare my initial thoughts with the vision of the director and how close (or far) I was from his ideas. This plan will be additionally and continuously updated by adding sound design, production and recording ideas.

0:00 – 0:05 (Camera static)
– Wind blowing into the dry grass

0:05 – 0:10 (Camera static)
– Leaves dancing on the quiet empty road when wind blowing

0:10 – 0:15 (Camera static)
– Quiet wind, paper posters on the wall (on the left) quietly rustling

0:15 – 0:19 (Camera static)
– Paper posters still rustling quietly but more loud than in the previous scene

0:19 – 0:23 (Camera static)
– Dark empty store ambience – silence

0:23 – 0:28 (Camera static)
– Dark empty store ambience – silence interrupted by eerie crackling nosies in the far

0:28 – 0:34 (Camera static)
– Kid run quietly tip-toeing from the left to the right in the store’s ambience [use of the phaser within the quiet ambience to create sense of movement by someone’s quiet physical presence]

0:34 – 0:41 (Camera static)
– Teenager walks slowly tip-toeing and looking around from the left to the right in the store’s ambience [use of the phaser…]

0:41 – 1:01 (Camera is slowly moving from the left to the right)
– Slow tip-toeing from the left to the right very close [use of the phaser…]
– Quiet run from behind to the front [use of the phaser…]
– Slow tip-toeing from the left to the right and then approaching closer from the far in the store [use of the phaser…]

1:01 – 1:11 (Camera is slowly moving from the left to the right)
– Quiet slow steps from the left to the right [use of the binaural microphone to capture ‘sensation’ of the person wearing hearing aid; use of the phaser…]

1:12 – 1:13 (Camera is slowly moving from the left to the right)
– Kid runs very fast but quietly from the left to the right [use of the phaser…]

1:13 – 1:18 (Camera is slowly moving from the left to the right)
– Kid runs moderately fast but quietly from the left to the right [use of the phaser…]

1:18 – 1:33 (Camera is slowly moving from the bottom to the top)
– Adult woman is quietly approaching from the back of the store and turning to her right and searching through shelves for the medicine.
Kid is sitting on the floor and quietly sobbing.

1:34 – 1:37 (Camera static)
– Kid quietly sobbing on the floor
Ambience of the store

1:37 – 02:10 (Camera is slowly moving from the top to the right bottom)
– Handling plastic medicine bottles
– Taking one and bringing it to the child walking away from the shelf to the the back
– Administrating a pill to the child
– Opening the bottle of water

02:10 – 02:22 (Camera static)
– Child quietly flushing the pill by water
– Closing the bottle of water
– Person quietly approaching from the right behind the shelf observing quietly woman and child
– Woman is turning around and using the sign language to communicate

02:22 – 02:31 (Camera goes slightly down)
– Walk behind the shelf slightly in the back walks away to the right

02:31 – 02:55 (Camera slowly zooming in)
– Little boy on the floor is drawing something on the floor in the middle of the corridor
– Teenage girl is slowly approaching to him and leaning on her knees to see the drawing
– Girl is asking boy in sign language about the drawing

02:55 – 02:56 (Camera going up following the hand)
– Boy is expressing a rocket in sign language

02:57 – 03:00 (Camera static)
– Girl is responding to boy in the sign language

03:00 – 03:06 (Camera static)
– Boy is responding in sign language

03:06 – 03:12 (Camera static)
– Girl is quietly sitting being concerned and not responding

03:12 – 03:14 (Camera slightly moving to the right)
– Boy is standing up and walking away to the right

03:14 – 03:18 (Camera slightly zooming in)
– Boy walking away to the left not visible, girl is observing sitting in the spot

03:18 – 03:32 (Camera slowly go to the right bottom towards the drawing on the floor)
– Boy quickly turns left behind the the shelf in the back
– Girl stands up and tip-toeing follows the boy to the back

03:33- 03:37 (Camera slowly going up)
– Boy is balancing on the plastic box trying to reach something in the shelf

03:37 – 03:41 (Camera slowly going to the right)
– Boy is awkwardly trying to reach a space shuttle toy in the shelf

03:41 – 03:42 (Camera slowly going up to the right)
– Boy is pulling the shuttle toy from the shelf and it is about to fall on the floor

03:42 – 03:44 (Camera moves shortly but swiftly to the right)
– Girl swiftly but quietly run towards the boy and catches falling shuttle toy landing on the floor with her knees
– Person is bringing basket towards in the very back of the corridor

03:44 – 03:47 (Camera slowly going up)
– Girl is nervously gasping but staying quiet

03:48 – 03:52 (Camera slowly going up)
– Girl is nervously gasping but staying quiet looking up towards the boy and then to the back of the corridor


Making an analog Arduino MIDI controller and testing the flex sensor

I have assembled the controller according to instructions in the video below.

It is a very simple four knob analog controller which can be connected with the Ableton Live via Connection Kit from Max For Live.

The purpose of this exercise is to find out how the flex sensor behaves when it replaces potentiometer. A flex sensor or bend sensor is a sensor that measures the amount of deflection or bending. Usually, the sensor is stuck to the surface, and resistance of sensor element is varied by bending the surface. Flex sensor therefore behaves in the similar way how does the potentiometer. By changing its resistance it changes the amount of electric current in the circuit which changes parameters mapped within Connetion Kit.

Flex sensor
Testing flex sensor replacing potentiometer

Flex sensor reacts however not in the same way how the potentiometer. I mapped the parameter Dry/Wet of the reverb. It only starts at about 30% and reaches up to 60% when bent. Next step will be to figure out how to calibrate flex sensor so it reacts fluently from 0 to 100% of the Dry/Wet parameter.

Sound for the clip from the movie ‘A Quiet Place’

A family struggles for survival in a world where most humans have been killed by blind but noise-sensitive creatures. They are forced to communicate in sign language to keep the creatures at bay.

In a devastated Earth overrun by invincible predators of a possible extraterrestrial origin, the Abbotts are struggling to survive in the desolate urban jungle of New York City: a death trap defined by a new era of utter silence. Indeed, as noise attracts this new type of invader, even the slightest of sounds can be deadly. However, even though it’s already been twelve months since the powerful monsters’ first sightings, the resilient Abbott family still stands strong. In this muted dystopia, learning the rules of survival is crucial. And now, more than ever, the Abbotts must not make a sound. —Nick Riganas (IMDb)

The clip from the film with no sound

I have chosen to make sound for this film from several reasons. 1) I like sci-fi movies with haunting eerie atmosphere 2) Considering the narration of the film, there is a lot of potential on creating tension with the silence and creative use of sound effects to play with psychoacoustics with not necessarily having a loud sounds or any sound at all – for example the phaser – it can create sense of presence and movement without actually hearing it.

Foley Recording

Foley recording for the scene from ‘We need to talk about Kevin’ with a focus on different types of sounds for footsteps

This Foley recording was created by Baria Qureshi, Dani Dasero and Vit Trojanovsky.

For the recording, we have used a large condenser diaphragm microphone AKG C414. First, we used two to capture possible stereo image but then we decided that for the purpose of this exercise, there is no need for that and used only one. All of us tried every role during the recording – performing foley artist and monitoring with recording in the studio.

We have performed folly sounds in the real time while watching the action on the screen. It didn’t always match 100% therefore we were adjusting recorded clips on the grid.

Placement of the microphone AKG C414

Recording outdoor environments

Parabolic Microphone

The parabolic microphone is highly directional and suitable for capturing sounds from very specific directions. A dish-shaped reflector focuses sound waves onto a small microphone located at the focal point of the dish. They are known for their ability to capture sounds from a relatively long distance.

Sound of the busy street – parabolic microphone
Sound of the plane – parabolic microphone
Sound of the plane 2 – parabolic microphone
Truck on the crossroad – parabolic microphone
Cranes of the construction site in Elephant and Castle
Shotgun Microphone

A shotgun microphone is a directional microphone but not as much as a parabolic mic. They are good for capturing sounds from a specific direction whilst also allowing to capture some of the ambience.

Swing in the playground – shotgun microphone
Wheels of the luggage – shotgun microphone
Van approaching on the street – shotgun microphone
Aquarian hydrophone

A hydrophone is a contact microphone specialised for recording under the water. With a special cup, it can be used as a classic contact microphone.

Electric transformer on the street – hydrophone/contact microphone
Fountain on the street

Moushumi Bhowmik 

Moushumi Bhowmik is a singer, writer and practice-led researcher based in Kolkata, India. She collects sounds and recordings outside of the periphery of our listening orbit, sounds unheard, left behind and hard to listen to, featuring questions of borders and displacement. She is drawn to sounds from the area of South Asia, like Nepal and Bengal. As ‘Bengal’ she refers to West Bengal Indian and Bangladesh. In her research and practice of collecting songs she highlights the importance of similarity in between for example of sounds songs from Nepal and Bangladesh. Even if she couldn’t understand Nepalese, she looked for the familiar in there, by this emphasising to look for what is connecting rather than dividing and different but also acknowledging point of view and own perspective.

She participated in the exhibition A Slightly Curving Place at Haus der Kulturen der Welt in Berlin in 2020, exploring acoustic archaeology practice. It was about recording in ‘pre-recording time’ before the recent recording machines came. The practice was based on visiting archaeological sites and trying to listen to them. Uncovering layers of soil on the sites is the analogy for uncovering layers of sounds in the record by constant listening. The technique is, as Moushumi points out, based on speculation and imagination. I very agree with that because I have been very struggling to understand such concept (if I got to understand the actual meaning correctly at all).

Moushumi did a workshop on the sound of memory. She said that people often bringing up memories from childhood based on sounds. She recorded a story of a girl Apple working in the gallery, originally from Philippines, who manages the kitchen. She mentioned how the sounds of the kitchen and cooking instantly remind her of her parents, and then, when she sees or hears planes, it reminds her that she cannot go back because they died. This story brings thoughts back to idea of displacement and it instantly reminded me the piece I was delighted to work on last year. I was scoring the short film based on childhood memories of my friend Lucie Trinephi who as five year old escaped with her parents the war in Vietnam. Lucie got a flashback based on the sound of helicopter many decades later and it was the actual sound memory, which opened the whole chain of many other visual as well as sonic memories.

Even if I could not entirely understand all the concepts Moushumi was talking about, I really appreciated her lecture because it was carried out in a very poetic way, and due to her determination to amplify the sounds and voices of people often coming from the place of struggle as was, for example, the story of my friend Lucie as well.

Industrial Violin (work in progress)

The other week I got myself very cheap violin for beginners. My friend asked me “oh, so are you going to learn how to play a violin now?”, I answered them “No, I will destroy it!”. Of course, I was joking. That would be horrendous thing to do! Although some aspects of what I am going to do with it could be considered destruction but actually I will be reframing the original instrument and using the beautiful resonance of violin’s wooden body for something else.

Project is inspired by the Instagram feed of musician Denis Davydov @davdenmusic. It’s a classical violin with a contact microphone attached inside of the body. I will be attaching various metallic objects like springs, kalimba or reassembled music box to the body of the violin. Some objects haven’t been found or decided yet. It is a fluid work in progress with many variables coming in and out whilst crafting this instrument.

Industrial violin will eventually become a part of my live performance and sound design practice.

Preparing the audio paper – The Chronic Illness of Mysterious Origin and Polymorphous Pan

I have decided to create an audio paper about the underground art event called The Chronic Illness (previously The Chronic Illness of Mysterious Origin) and its venue ‘The Dungeon of Polymorphous Pan’. It will be an interview with the curator Piotr Bockowski aka Fung Neo about the event and the venue in the context of his research about the fungi, post-internet performance art and squatting.

Some possible questions to be asked:

What is The Chronic Illness of Mysterious Origin, when and why it started?

Who or what is Polymorphous Pan?

Where The Dungeon of Polymorphous Pan sits in wider context of squatting in London?

https://research.gold.ac.uk/id/eprint/31708/

https://libsearch.arts.ac.uk/cgi-bin/koha/opac-detail.pl?biblionumber=1450625&shelfbrowse_itemnumber=1774022#shelfbrowser

https://libsearch.arts.ac.uk/cgi-bin/koha/opac-detail.pl?biblionumber=1535659&query_desc=kw%2Cwrdl%3A%20squatting%20in%20london

Wireless Data Streaming Using BNO055 and Bluetooth and Estimating Orientation Using Sensor Fusion

The very first way of translating movement into sound via motion capture which I decided to experiment with is using the Adafruit BNO055 absolute orientation sensor. The sensor fusion algorithms and blend accelerometer, magnetometer and gyroscope data into stable three-axis orientation output processed in Arduino and send them to Ableton Live via Bluetooth.

Bosch Adafruit BNO055

During the programming and calibration, I have encountered several problems. Programming and calibration are done in software MATLAB which at first didn’t allow me to upload the code into the Arduino so it could work standalone. Bluetooth module which I ordered was not supported therefore I ordered different one so programming Arduino and calibration were executed via USB cable. Programming and calibration were somewhat successful and I managed to connect the device with Ableton Live via Max fro Live plugin Arduino although after I disconnected USB I had to write the whole code again and keep the device connected to the laptop. Later the device stopped reacting and after enabling Arduino plugin in Ableton Live, the program from MATLAB started showing an error. At this point I need to figure out how to upload the program from MATLAB into the Arduino chip.

From the top: Bluetooth Module (unsupported type – will be replaced by HC-05), Arduino Uno, BNO055
Simple wireless motion capture data streaming device assembled
Programming and calibration of the device in MATLAB
Various positioning of the device reacts to the Arduino plugin in Ableton Live and changes the parameters of the mapped Low Pass Filter in quite a simple way.

Loading the code to an Arduino chip from MATLAB appeared to me as a very complicated process therefore I decided to try a different route – loading code from the original Arduino software IDE. I managed to load the code and run the calibration test of the program via Chrome browser extension, still connected via USB. Next step will be to figure out how to connect BNO055 and make its principles work with Ableton Live either via existing Connection Kit or by finding or creating a device from Max For Live and figuring out the connection via Bluetooth instead of USB cable.