Talk

---

The presenter utilized multiple lights to make the green screen more effective and an app to help edit the video. They also experimented with virtual production, a technique used in movies like The Mandalorian, to make the background adapt to the presenter's movements. A projector was used to create the background and a 360 camera was used to scan the room. A VR headset was used to track the camera position and a concept called Nerves Instant was used to take six pictures and create a 3D image. Finally, a LiDAR scanner on a phone was used to scan the person and create a 3D model of them. Professional help may be needed for detailed cleanup of the scan. This article discusses the use of technology to create realistic 3D models of humans. It explains that with the help of AI and scanning, it is possible to create an avatar using only a few pictures, and then use puppeteering to record the movement of the model. To make the models even more realistic, inverse kinetic models are used to understand how bones are connected so that if one thing moves, other parts of the body will also move. This talk discusses the various methods of creating realistic digital avatars that can be used in films or on the internet. It covers body motion tracking, facial expression tracking, and voice cloning. It also covers the use of motion capture suits, cameras, and puppeteering to capture realistic movement. Finally, it discusses the use of text-to-speech and voice cloning technologies to create realistic audio. Text-to-speech technology is being used to automate parts of dialogue recording, such as when Darth Vader's voice was bought because the actor couldn't maintain it in the future. Overdub is a video editor that can be used to record audio and select text to create parts between recordings. Audio-to-lip technology can be used to predict how lips should move based on text, and synthetic media, such as deep fakes, can be used to generate unique photos and videos. Deep fakes have been used to con people out of money, but they can also be used for more positive applications such as lip syncing and live translation. Deepfake technology has been used for a variety of purposes, from creating virtual bands and influencers to helping people grieve for lost relatives. It can also be used to enhance 3D models and create realistic images for games like FIFA. There is also software like Dali that can create images from text, and open source software like Stable Diffusion that can be used to generate models. All of these technologies have the potential to create interesting and creative content. Open source technology has become more available, surpassing open API which was not open source. It can be used to generate images from datasets, and even search what images are used in the dataset, for copyright reasons. It can be used for creative art and even medical images. It can be used for storyboarding and game engines, and even for creating realistic Lego models. It can also be used to create images from stories, and to view images from different angles. This new job prompt engineering involves using text to magically generate images and videos. Instead of writing code, it is a way of expressing an intent and allowing the computer to generate the desired result. There are also search engines, newsletters, and meetups to help with this process. Additionally, Auto-completion and macros can be used to group images together. Google has also started to implement text-to-video capabilities, as well as creating static images from moving ones. 3D models can also be created from images and manipulated using text. This technology has the potential to create entire worlds from a single background image. This talk discussed the use of video editing software to create a 360 scan, and how it is changing the way manual labor is done. It also suggested using AI to make the process easier, and provided a list of books to learn more about it. Finally, the speaker announced plans to hold a conference in Belgium in March or April to explain the technology further. This talk provides an overview of how to create realistic digital avatars and how to use technology to create realistic 3D models of humans. It also suggests that open source technology and new job prompt engineering can be used to generate interesting and creative content.

---