Publications

Publication Details

Poems as musical instruments: an AI music performance interface based on the concepts of chinese qin songs - Cover
Poems as musical instruments: an AI music performance interface based on the concepts of chinese qin songs - Detail 1
Poems as musical instruments: an AI music performance interface based on the concepts of chinese qin songs - Detail 2

Poems as musical instruments: an AI music performance interface based on the concepts of chinese qin songs

Music

Venue

Leonardo

Abstracts

The author has designed a new interface of musical expression called Poem-Qin, which reveals the relationship between text and music, supporting self-accompanied singing and cross-media musical practices. Drawing inspiration from Chinese qin songs and movable-type printing, the author creatively integrates Chinese characters into the interface, controlling music with tone inflections and linguistic rhythms. Moreover, they have developed an AI model for text-to-melody composing to assist in creating new music content. User and audience testing has demonstrated that it offers a positive experience and effective creative results.

Appendix

PDF|Code|Demo|Video