• 收藏 1
  • 下载
  • 分享
AI PIANIST 人工智能钢琴家

原创 临时 2022-06-23

Role
Direction & Design

Type
Immersive Experience

Date
2019 / 2021

Commissioned By

Daejeon Museum of Art

Premiered at the “Ways of Seeing” exhibition in Daejeon Museum of Art in 2019, NOS Visuals collaborated with VirtuosoNet, the AI pianist developed in Korea Advanced Institute of Science and Technology [KAIST-CT].

A selected repertoire from contemporary composers [Philip Glass, Olivier Messiaen, Sergei Prokofiev, Dmitri Shostakovich] is interpreted and played by the AI Pianist VirtuosoNet on an automatic grand piano, and each visual environment surrounding the performance is responsive to sound, and generated in real-time.

NOS Visuals is originally a collaborative platform named after the custom NOS visual engine, developed by Nohlab and Osman Koç. Based on Processing infrastructure, NOS analyzes the sound in the performance in real-time and uses this data as a parameter in the calculations for the visuals, which melts the sound and visuals into a single entity.

For this unique collaboration, Dr. Jeong Dasaem trained an AI pianist, VirtuosoNet, using data from 16 composers and 226 performers, by a “Hierarchical Attention Network [HAN]”. Integrating several parameters of score and performance, VirtuosoNet not only interprets the score, but also plays with emotion as it adjusts the beat and rhythm, and the tone and touch in order to capture the musical expression of the original performers.

The performance since has been a part of Beyoglu Culture Road exhibition in the opening of AKM, the biggest and most symbolic art exhibition center is Istanbul, and was supported by Turkish Ministry of Culture.

CREDITS

Location
Daejeon Museum of Art, S. Korea
AKM, İstanbul

Art Direction & Visual Design
Nohlab

Creative Coding & Visual Design
Osman Koç

AI Training & Research
Dr. Jeong Dasaem

Pianist
VirtuosoNet

Real-time Visualization Engine
NOS Visual Engine

作品参与

* 内容为作者独立观点,不代表数艺网立场转载须知

本内容由数艺网主动采集收录,信息来源为 “Nohlab” 公开网络发布内容。第三方如需转载本内容,必须完整标注原作者信息及 “来源:数艺网”,严禁擅自篡改、删减或未标注来源转载。 并附上本页链接: 若您的内容不希望被数艺网收录,或认为此举侵犯了您的合法权益,敬请通过微信 ID:d-arts-cn 联系数艺网。我们将致以诚挚歉意,并第一时间为您办理下架或删除处理。

沉浸式体验 大田美术馆 钢琴 AI 钢琴家

28722 举报
登录| 注册 后参与评论
Nohlab

Nohlab

土耳其

分包方 · 「Lab」系列