A new artificial intelligence has been created to make amateur dancers professionals by manipulating video of their routines.
Developed by a team researcher from UC Berkeley – and described in this document, called All Dance Now – the Software is first watched by a professional dancer. It then mapping the person's movements by turning the body into an animated stick figure.
Then AI watches an amateur dancer's recording and transforms it into a spellfigurtine and switches it to one of the professionals. The resulting recording is then smoothed to make the movement look natural, and the subject's facial expressions are being worked to make them in shape with the movements of the dance.
The end result is a relatively accurate picture of an amateur dancer performing as a professional. An example below even shows the faculty's reflections in a window behind them ̵
We say "pretty accurate" because more than a casual look at the recorded recording reveals how the dancer's movements are not perfect. Lemmer sometimes moves in unnatural ways, and AI struggles to map smaller movements, such as when a hand is turned back and forth. The subjects also have to wear tight clothing, when AI is fighting to accurately reproduce the movement of loose matter, the researchers explained.
That said, AI's ability to do this from just a few minutes of learning is still very impressive, with the team behind it describing its results as "convincing." The research document explains how AI requires about 20 minutes of real-time professional dancer shooting at 120 frames per second. The system also uses its own neural network to produce realistic facial expressions for the amateur.
It is easy to see how such artificial intelligence can be transformed into a fun smartphone application, where images of the friend's terrible dance can be converted to nail a professional routine.
However, as with the recent use of "deepfake" technology, which used similar AI to put celebrities in pornographic videos, the software increases privacy and ethical concerns. For example, the technology can be used to produce the recording of someone who apparently does something that never actually happened.