Apparatus Solitaire

audiovisual site-specific installation

The installation aims to create sensorially perceivable intersections between real-manifested and virtual-latent anthropogenic environments. A machine learning algorithm, trained with concepts of industrial architecture, is slightly transforming the architecture of the venue by merging it with morphing three-dimenisonal audiovisual content, created by the artificial machinery.

Data rasta 1
GAN rasta 1
Data rasta 2
GAN rasta 2
Data rasta 3
GAN rasta 3

devaults are determing the machines' destiny

Either projection surfaces placed above the audience or a projection mapping (picking up characteristics of the venues‘ construction), inherently reacting with the architecture, are displaying the visual processes of the algorithm. 3D Models derived from scans of the original fittings and architectural selections of the building and surroundings are additionally merged into the visual composition - a composition yielding an immersive conflation between the artistic and the functional concepts of the building. Light will be arranged as a bridge between the digital output and the physical space.

On-site sound recordings, manipulated by the system and distributed via a 20 channel 3rd order ambisonic sound system, are creating a stunning 3 dimensional sound perception. The auditive experience is emphasized by physical reflective elements and by the reflectivity of the space itself.

P1001463

The core of the technical apparatus consists of a deep neural network (DCGAN model) and a 20 Channel 3rd order ambisonc 3D sound distribution concept. The neural network is trained to see and interpret industrial architecture. It continuously produces visualisations of industrial environments in a binary picturesque manner. 3D objects that resemble individual rooms and corpuses of the building complex complement the flow of abstract images from the machine learning process. New corners and angles are revealed. The purely computer-generated outcome stimulates the associative imagination of the audience, captivating it with painterly-aesthetic qualities.

Object within the "Verdampferturm" of the Saline Hallein

Kesselobj2 1920x1080

"Kesselraum" of the Saline Hallein

Kessel down 1920x1080

Object within the "Kesselraum" of the Saline Hallein

12controlobj01 141 1920x1080

Both machine learning and photogrammetry are ubiquitous imaging techniques of our time. Higher order ambisonic sound concepts can be realized in (and adoptet to) specific given spacious dimensions. The above-mentioned setup is specifically configured as a research tool, to explore and further illustrate phenomenological relevance of the audiovisual augmentation in the architectural context.

Sound, light and space together are transforming the characteristics of the environment in realtime.

P1001422
Vertikal apparatus
P1001470

Performance 2 vertikal
PR horizontal 2

links

Dataset 4x46
Dataset 4x45
Dataset 4x44
Dataset 4x43
Dataset 4x42
Dataset 4x4