AI reinvents classic song ‘Pearl of the East’ with unimagined artistic charm

Share This Post

Featuring lyrics "the meandering stream flows southward, running to Hong Kong to have a look," the song "Pearl of the East" has been chanted across generations for over three decades, bringing a sense of belonging to many Hong Kongers.

At a recent concert in the city, the song was once again played to celebrate the 25th anniversary of Hong Kong's return to the motherland. The performance was exceptional this time: it was sung by a choir of artificial intelligence (AI) musicians.

Accompanied by an orchestra from the Hong Kong Baptist University (HKBU), the AI choir consisting of 320 virtual singers followed the gestures of the conductor in presenting the classic, with AI-generated 3D animation as background.

"This should be the world's very first human-machine collaborative performance," said Guo Yike, vice president of HKBU and an AI expert.

The AI-powered performance was part of the latest progress of a research project that Guo led. The project aims to explore new opportunities that AI-based art technology could bring to Hong Kong and has landed government funding of over 52 million Hong Kong dollars (about 6.6 million U.S. dollars) for a period of five years.

For the AI singers, it was quite a learning process. At the very beginning, the virtual musicians had trouble singing high notes or even went out of tune from time to time.

"Sound is about frequency. It is not difficult to teach them to sing as long as the frequency is adjusted constantly," Guo said.

The bigger challenge is that the AI singers could be supposed to understand the gestures of the conductor. The communication was made possible by sensors tied to the waist, shoulders and wrists of the conductor, who repeatedly practiced with the AI singers to better the teamwork.

After almost six months of training, the AI singers were able to understand the language of the conductor well and present the music with a perfect tempo.

But what really amazed Guo and his team was the creation by AI itself. Accompanying the choral piece was the 3D visual narrative generated by the AI based on the lyrics and the music. The machine needs to first understand the meaning of the song before generating nearly 3,000 images and connecting them with natural transition.

For instance, when the lyrics say "flowing to 'fragrant river' to have a look," the machine needs to understand that "fragrant river" stands for Hong Kong and then create relevant images.

What the AI really achieved was beyond Guo and his team's imagination. When presenting the lyrics, the AI first drew a pearl, which then blossomed in layers to become the petals of bauhinia, an emblem of Hong Kong.

"We were all stunned at the moment. The concept of 'fragrant river' was presented in such an unexpected way. This was the creativity of the machine itself." Guo said.

For Guo, what AI can create goes far beyond mere imitation of human behavior. With the help of inputs from human beings, machines can create art that is distinct from human creation, he said.

"Perception is very important to scientific breakthroughs. We changed our perception, and here comes the breakthroughs," he said.

Guo said that his team would continue the study to empower art with technology. In the future, they could present new AI-powered art forms, such as opera.

"There is no end to exploration, and nothing is impossible," he said.

Follow Chinafolk on Twitter and Facebook to join the conversation.
ChinaNews App Download

Related Posts

Starry nights on stage

From popular children's choir to Peking Opera, cultural carnival promises a surge of nostalgia as the People's Republic of China celebrates its anniversary.

Upcoming documentary show presents a rich 'Bouquet' of Chinese civilization

Within just five minutes, the extent and scope of Chinese culture is given a vivid presentation in China Bouquet, a bilingual documentary which will be for viewing on several online platforms.

Tasty tradition is sweet success for culture

Seen from afar, they are decorative polychromatic flowers, placed front and center at dining tables to feast the eyes.

High tech and art merge in Nanjing exhibition

The ongoing exhibition In the Line of Flight, for Possible Worlds at Deji Art Museum in Nanjing, Jiangsu province, has attracted lots of visitors by offering them a cool experience by mixing art and technology.

​Exhibition reviews development of ancient Chinese paintings

Editor's note: A collection of more than 1,700 copies of Chinese paintings and related calligraphy works from the Han Dynasty (202 B.C.- A.D. 220) to the Qing Dynasty (1636-1912) are currently on display at the National Museum of China in Beijing. 

Billboard expands its coverage in China’s market

As Billboard expands in Asia, Billboard China, a new edition, has been launched.Mike Van, who was named the new president of Billboard this May, said in an interview with China Daily that, "Billboard is further expanding its coverage in one of the biggest music markets in the world" and the move will be "bringing global pop music to Chinese fans and expose Chinese artists and music to an international audience".
- Advertisement -spot_img