Music and artificial intelligence don’t really go together. Or do they? As part of the VietAI Summit 2019, Bao-Dai, NLP Research Scientist at Knorex and Senior Lecturer at VietAI, introduced the audience to a tool used by artists writing new songs. As a musician, Bao-Dai is very interested in music generation using AI and shares an attention-based encoder/decoder solution whose goal is to create a full melody based solely on a short input melody.
The short priming melody is provided to demonstrate the style of the song they hope the model can output. All inputs and outputs are in MIDI format and every MIDI file is converted into a vector including 3 types of events:
- Note-on to play a note and to turn off any other note that might be playing
- No-event which sustains a note that is playing or otherwise continues the silence
- Note-off which turns off any currently playing note
Of course, machine composers need to generate melodies that sound like a pop song -- they must generate a catchy melody. It must also be able to create a long-term structure, which is natural to people but difficult for machines to do. They also have to be aware of patterns in the song.
To meet all of these requirements, Bao-Dai built an encoder/decoder using LSTM (long short-term memory) architecture. Using just 4 input notes, the machine composer created an original melody of several bars. It was really good, especially when fully arranged and played by a human band. The next step will be to write lyrics for his “AI Love Song.” Bao-Dai is researching whether he can use an AI-based language model to help generate lyrics as well.
Learn more about the science of music composition and listen to Bao-Dai’s original track, click here.
To access presentations and slides from VietAI Summit 2019, head over to Kambria’s Resource Library. The Resource Library can be accessed for free by community members who own KAT tokens. Simply register for the Kambria platform by clicking “Login/Register” in the top right-hand side of the screen. Then choose “Library” to access materials from the Summit.
About VietAI Summit 2019
More than 450 people attended VietAI Summit 2019, “AI for The Future,” organized by VietAI and Kambria. With a program featuring many reputable guest speakers from big tech companies such as Google Brain, Toyota Research Institute, Kambria, NVIDIA, VinAI Research, Vinbrain, Deakin University, and Vietnam National University HCMC, we received many fresh insights into the exciting state of AI research and application, not just in Vietnam, but also around the world. To receive an invitation to VietAI Summit 2020, Like the VietAI Facebook page and Like the Kambria Facebook page.
To read more articles about artificial intelligence, click here.
