Robotic Orchestra
IAAC connected live music with robotic fabrication: during a concert at the Auditori de Granollers, two collaborative robots interpreted the orchestra in real time and drew on seven large clay panels, together with Ceràmica Cumella. The panels are now part of the auditorium’s façade.
The Challenge
Can we materialise music? Can technology create a dialogue between matter and music, and connect the art of music with the craft of ceramics? The challenge was to interpret a classical concert live and translate it, at the same time, into robotic movements working on clay.
Our Solution
IAAC developed custom algorithms and a pipeline that links sound analysis, artistic programming, computational drawing and robotic control. Two robots “listened” to the orchestra and worked the clay live, on stage, during the concert.
An art performance and permanent ceramic façade created in 2019 for the Auditori de Granollers, combining robotics, music, ceramics and computational design, developed with a ceramics workshop, a robotics integrator and a robot manufacturer.
A live performance in which the robots interpreted the music of more than 30 musicians in front of an audience of more than 200, and seven large ceramic pieces now installed permanently on the façade of the Auditori de Granollers.
The Project
The intervention took place during the concert Els Elements (The Elements), part of the season of the Orquestra de Cambra de Granollers, which performed Joseph Haydn’s Symphony No. 59, Fire. On stage, next to the musicians, two robots took inspiration from the music to draw on seven large pieces of clay, which became part of the façade of the same auditorium.
The project builds on the experience of the Musical Robotic Façade (Isern Associats, Ceràmica Cumella and IAAC, 2017) and takes the connection between music and robotics one step further: in Barcelona a recorded piece was carved into the bricks, while in Granollers the music is interpreted live and the robots perform at the same time as the musicians.
After months of development and experimentation, the robots performed live at the Auditori de Granollers. The project was well received by the public and covered by local television, radio and press. It was developed with the support of IAAC’s Master in Robotics and Advanced Construction.
Design Approach
Interpreting music in real time meant connecting technologies from different disciplines into a single pipeline. The sound of the orchestra was analysed with a Fast Fourier Transform, which breaks it down into its frequencies; an artistic programming system (VVVV) and a computational drawing system (Grasshopper 3D) turned that analysis into lines and gestures; and a robotic control system (Robot Operating System) sent them to two six-axis collaborative robots by Universal Robots.
Ceràmica Cumella prepared the clay panels and led the artistic direction, so that the marks left by the robots could be fired and installed as a permanent ceramic façade.
Our Contribution
IAAC’s Advanced Architecture Lab developed the process and implemented the project: the custom algorithms and the pipeline that translate live music into robotic movement, from sound analysis to the control of the robots, working with Toni Cumella as art director and with Vicosystems as robotics integrator.
Who is it for?
Robotic Orchestra speaks to architects, designers, musicians, ceramicists and digital fabrication experts interested in how robotics and real-time data can work with traditional materials and live art. For the public, it turns a concert into a permanent part of the building where it was played.
Partners
Ceràmica Cumella (ceramist Toni Cumella)
Auditori de Granollers
Orquestra de Cambra de Granollers
Universal Robots
Vicosystems
Credits
Design team and collaborators
Art director: Toni Cumella
Project development, IAAC: Alexandre Dubor, Kunal Chadha, Cristian Rizzuti, Hazal Yilmaz
Robotics integrator: Vicosystems
Video editing: Daniela Figueroa
Frequently asked questions
Robotic Orchestra
Robotic Orchestra is an art performance created by IAAC in 2019 for the Auditori de Granollers. During a concert, two collaborative robots interpreted the orchestra’s music live and drew on seven large clay panels that are now part of the auditorium’s façade.
The robots interpreted the concert Els Elements by the Orquestra de Cambra de Granollers, including Joseph Haydn’s Symphony No. 59, Fire, played live by more than 30 musicians.
The sound was analysed with a Fast Fourier Transform and processed with VVVV and Grasshopper 3D, which turned it into drawings that the Robot Operating System sent to two six-axis Universal Robots working the clay.
It is a collaboration between IAAC’s Advanced Architecture Lab (Alexandre Dubor, Kunal Chadha, Cristian Rizzuti and Hazal Yilmaz), ceramist Toni Cumella as art director, Ceràmica Cumella, the Auditori de Granollers, the Orquestra de Cambra de Granollers, Universal Robots and Vicosystems.
Companies and institutions can work with IAAC on robotic fabrication and digital craftsmanship through applied research, prototyping and innovation projects. The Innovation page explains how IAAC collaborates with industry; to discuss a project, write to [email protected].