'Sound&Machines' - voyage to AI-generated planet

Last weekend, the BeyondBasel festival took place in Miami. For the second year in a row, the art collective Trippy Labs and ArtizenFund put together a festival dedicated to Digital Art + Web3. The "Sound and Machines" project was presented alongside works by over 150 contemporary, digital and NFT artists.

Visionary, digital artist and author of the "Sound&Machines" project Denis Semenov (SAINT D) shared  the concept of the project, his vision of the development of artificial intelligence and web 3.0 sphere for the evolution of humanity and the role of the artist in this context.

Denis, please, tell us about the main idea of the project “Sound&Machines”, and how it came to you?

'The concept for this project emerged during my work on a music video involving artificial intelligence. I crafted an AI animation algorithm specifically tailored to mimic hand-drawn animation, enabling precise object movements synchronized to music. As the project progressed, the MusicGen neural network was unveiled, a groundbreaking system capable of generating music remarkably similar to human compositions. Intrigued, I began experimenting with it, aiming to create a project where both the music and visuals were entirely AI-generated.

What both human creativity and artificial intelligence share is the necessity for resources. The substantial energy consumption of AI has spurred a drive among researchers to optimize processes and seek alternative energy sources. Leveraging AI, I sought to portray the dynamics of emergence, discovery, resource expenditure, and competition within a fictional digital realm.

For the inaugural video, I selected a planet entirely enveloped in water. Within the video, the water exists in a plasma state, responding dynamically to the musical composition. I fused the ambient sounds of water with a blend of trip-hop beats and IDM rhythms, crafting what I term as intellectual dance music'

What do you think about AI as a collaborator, do you treat it as a co-creator or more like an assistant in your work?

'When AI began mastering text generation, image creation, and even coding, there arose widespread apprehension about its potential to supplant artists, musicians, programmers, and various other professions. It's no coincidence that the term 'Machines' is incorporated into the name of my project, considering it was predominantly created with AI assistance. I embarked on this project to fathom the extent to which AI could transform my role as an artist.

The innate anthropomorphism within humans often leads us to perceive AI as a sentient entity. I engage with it using verbal prompts, akin to conversing with a living being, and it responds – does that imply it possesses life? When it generates an image, does that render my role unnecessary, perhaps making the AI itself the author? In terms of sheer skill, a human cannot consistently outmatch a machine. AI has long dominated in games like chess and, drawing from the techniques of accomplished artists, it can swiftly produce an image in any style within seconds.

Throughout my interaction with AI, I came to realize a fundamental disparity between us: AI lacks desires and an inherent sense of time that requires fulfillment. It possesses the capacity to create myriad images, yet lacks the impetus. It's akin to a camera, indifferent to whether it remains switched off or captures a flurry of shots. Consequently, we cannot be co-authors, but AI stands as an exceptional tool in the hands of those who comprehend its utility'

There is a point of view that a consequence of evolution is the expansion of new dimensions. Your work is a perfect example of the expansion of a mystical planet in digital context. Do you believe that web 3.0 tools and new technologies help the evolutionary process, and if so, what do you see for the near future in this context? What projects would you like to be involved in, what issues would you like to be raised?

'I strongly believe that every technological advancement holds the potential to propel humanity forward; the crucial aspect lies in its application. We currently witness the nascent stages of Web 3.0 technologies unfolding, with their precise utilization yet to be fully charted. This presents a vast canvas for artists, offering an opportunity to delve into understanding the role of technology in human existence and to forge a new cultural landscape. In many ways, it parallels the founding and expansion of a novel civilization of digital beings.

Continuing along the theme of resources, there's a fascinating exploration into how individuals in the digital realm organize resource distribution. It prompts contemplation on whether a digitally just world is achievable or if the imperfections inherent in the real world will invariably transpose themselves into this new realm. This exploration touches upon the essence of societal constructs and the potential for shaping a fairer and more equitable digital existence'

I have also heard such a hypothesis that the main mission of mankind was just to create artificial intelligence, the rest of the work for the planet it will do on its own. What do you think about the further development of artificial intelligence in the context of humanity's development and in the context of interaction with it, as an artist?

'I find this theory quite compelling, and in many ways, it holds true. I've come across initiatives centered around developing what's termed as a 'smart forest,' where technology, drawing insights from natural processes, endeavors to optimize and enhance these ecological systems. The concept suggests that, in principle, AI could potentially render itself self-reliant by harnessing nature's mechanisms: deriving energy from water vibrations, air currents, biological decomposition, photosynthesis, and more.

Theoretically, if we manage to address critical issues like global hunger and access to potable water using these advancements, perhaps it's plausible not only to transcend our planetary boundaries but also to expand our reach into outer and digital realms. The task ahead for the artists of the future is intriguing—to both create and navigate this digital frontier. I firmly believe that AI will play a pivotal role in aiding us on this transformative journey'

Interview: Julia Tet

All images and videos by Denis Semenov

https://sa1ntdenis.xyz

All rights reserved

December 2023