Alibaba launches EMO, an AI that creates singing videos from portraits, hoping t

[APune]

Alibaba launches EMO, an AI that creates singing videos from portraits, hoping to fight the GenAI battle.

The Gen. AI battlefield continues to rage. Following the launch of OpenAI's Sora, many tech companies have plans to create their own AI creators. One of them is Alibaba, a technology giant from China.

Alibaba's Intelligent Computing research unit revealed that Preparing to create “EMO” AI video creation Using just one portrait, you can create characters that sing, talk, move their faces, and display various facial expressions.

EMO's video rendition uses portraits along with audio files that require the characters to talk. which can create a maximum length of 1 minute 30 seconds. The expression of a person's facial expression is accompanied by emotion and the sound that comes out. It's not just about moving your mouth.

For the function for the character to sing Can be adjusted according to the language of the song As well as moving quickly to the rhythm of the music, the AI can also distinguish between English and Korean sounds.

EMO is supposedly short for Emotive Portrait Alive, but in this case, why not EPO? The play on the word “EMO (emo)” is a unique feature of its AI: characters in videos created by EMO will be able to talk. and can sing But rival Sora couldn't talk.



     “Instead of just creating characters - the actors look at each other back and forth. Why not create one where they can talk to each other? EMO is therefore the future of AI that can create virtual worlds. with characters that can interact with each other in a lively way,” said the EMO creators.

EMO offers a more advanced video example: A clip of a Japanese woman walking down the street is based on Sora, but EMO makes the woman sing. Dua Lipa's Don't Start Now is the song she sings.

However, the EMO model is still in the development stage. And must go through the same ethical process as Sora. In the sample clips that EMO has created, most of the characters do not show strong emotions, such as being very angry or crying a lot.

Alibaba is committed to becoming the world's leader in AI technology. The goal is to use AI to drive business growth. Create new innovations and improve people's quality of life The past innovation is Development of WuDao 2.0 large-scale language model with OpenAI's GPT-3 equivalent; launch of Alibaba AI Academy, an AI training institute; and joint investments with leading universities around the world to develop AI technology.