At my end I have started to build the ‘Core Station’ which will process data from all sensors and transmit them via WiFi. It will be attached to the back of the performer. Based on the research I did, I have decided to upgrade the micro-controller from the previous prototype based on ESP32 to Teensy 4.1. ESP32s are still being used but only for the WiFi connection. Teensy 4.1 contains microprocessor ARM Cortex-M7 clocking at 600 MHz which is in comparison to ESP32’s microprocessor Tensilica Xtensa LX6 clocking at 240MHz significant improvement allowing fast and real-time data transfer from multiple sensors in the same time.

Teensy will be gathering data from two accelerometer sensors GY-521 (MPU6050) attached to the feet, two elbow and two knee stretch sensors and BNO055 (9-DOF absolute orientation sensor) which will be situated in the headpiece. Data from sensors are going to be sent via UART connection into ESP32 WROOM-32U Access Point. I have been considering SPI connection but I struggled to find appropriate libraries at Arduino IDE and learnt that it will require to learn different IDE. I have tested UART which I am familiar with and it proved itself sufficient enough, however I still consider sorting out SPI connection in the future.

On the receiving end there is another ESP32 WROOM-32U which is connected to the computer and sends raw numerical data to the Max MSP. ESP32 WROOM-32U has a specific feature – possibility to attach external WiFi antenna. This significantly improved the data transmission and range.

I have been seeking for a while a fashion designer or maker, someone with appreciation of similar aesthetics as I do therefore the result could become a common effort rather than an order.

After discovering the conductive rubber I realised that it could be efficiently combined with the latex. I approached a friend of a friend, latex maker and designer Ella Powell @exlatex.

Ella Powell have been working with creating latex clothes and sheeting for the past two years. She studied a short course in latex making at Central Saint Martins over the summer 2022. Currently she is studying a master’s degree in computer science and AI.

After initial meeting we have drafted some ideas about creating latex based organic-like futuristic looking sensors which will efficiently collect data from the bending knees and elbows. Below you can see AI generated idea of the direction in which the piece might be evolving.

Other artists which are joining the team are @Elixir31012. Elixir31012 is a multimedia artist duo formed by digital artist Jing Xu @abadteeth and sound artist Jiyun Xia @xiaji2tsunagi2 in 2023. Both graduated from the Royal College of Art with a degree in Fashion in 2023. Elixir31012 creates an otherworldly landscape of non-linear time through digital animation, experimental music making, wearable technology, and performance. Cyborg study, myth, ritual, and feminist narratives are intertwined in their work. Elixir31012 takes its name from the Chinese Taoist vocabulary for “elixir”. 3 represent “Synthesis”, 10 for the “Sacred”, and 12 for the “Eternal Return”. Their sound art performance at the the event Chronic Illness XX very intrigued me and we started talking. The idea to collaborate emerged very soon and organically based on similar interests in creative technology, cyborg art and sound art. Elixir31012 proposed that they will make a headpiece which would carry the motion sensor for the Sonokinesis performance.

Declan Agrippa @hiyahelix, student of the second year of Sound Arts at University of the Arts London, London College of Communication, is going to create a sound design using the virtual wavetable synthesiser Serum.

Below you can see the work in progress sketches of the sensor headpiece in Zbrush.

Multi-disciplinary and kinaesthetic artist Ona Tzar @ona.tzar is joining the team as a performer. Her creative input is being very important for developing the whole system because we would like to have the garments as ‘user friendly’ as possible. We have been actively discussing materials, positions of sensors, shape of garments and the headpiece trying to find the right balance between ‘experimentalist aesthetics’ whilst keeping the usability of all pieces for performance comfortable, functional and reliable.

Last term I have introduced foundations of the project Sonokinesis – the idea of controlling the sound by the movement and other aspects of human body. I have made a pair of wireless interactive Arduino based gloves which allows to control the sound in visual programming language Max MSP and map them into Ableton Live via Max For Live. The piece has been performed so far on two occasions, at the Gallery 46 in Whitechapel and at the underground event featuring performance art and experimental sound Chronic Illness XXI. During those performances I have revealed many flaws which occurred and started to troubleshoot and upgrade the project – mainly unstable Bluetooth connection and the significant fragility of assembled pieces.

The idea of Sonokinesis certainly doesn’t stop at the pair of Arduino gloves and I aim to develop more stable and durable version of gloves followed by other garments allowing to the performer to encompass other parts of their body.

I have been experimenting with flexible pads for knees and elbows and created simple accelerometer based headpiece triggering MIDI notes or samples. All those are connected to the central mini-computer attached to the lower back with the belt. Central mini-computer is this time based on different micro-controller ESP32 Wroom-32 and wireless connectivity is sorted with WiFi connection which proved itself more stable and faster than Bluetooth.

For knees and elbows I firstly assembled wearable pads based on the same flex sensors which I used for fingers of gloves. Unfortunately they appeared to be highly un-efficient when it comes to durability. Their function was limited by fragility and sensors started to break and rip after even single use which needs to be avoided at any cost since the piece must remain stable during performance and reusable. Also the cost of flex sensors is quite high considering its fragility (about £15 for one sensor).

Not long ago I have discovered conductive rubber which changes its conductive properties based on the stretch. I have tested a strip cut from the sheet attached to the knee pad and it proved itself very efficient, durable and in comparison to flex sensors also way more cheaper.