PLASK.AI Review | Motion capture accessible for everyone

<p dir="auto"><h1>Hey everyone!<p> <p dir="auto">Today's post is a bit different of what I am used to post, because today we are going to review a tool. First of all I was not (of course) paid or even in contact with the team who developp this tool. I have just discovered it on youtube and as I'm using 3d software such as Blender in my life and that I am very interested in 3d moeling / animation I was interested by the project, <a href="https://plask.ai/" target="_blank" rel="noreferrer noopener" title="This link will take you away from hive.blog" class="external_link">Plask.ai <hr /> <h2> What is Plask ? <hr /> <p dir="auto">Plask is a tool developp by a team of the same based in Seoul, South Korea. <div class="pull-right"><img src="https://images.hive.blog/768x0/https://upload.wikimedia.org/wikipedia/commons/8/8b/Motion_Capture_with_Chad_Phantom.png" srcset="https://images.hive.blog/768x0/https://upload.wikimedia.org/wikipedia/commons/8/8b/Motion_Capture_with_Chad_Phantom.png 1x, https://images.hive.blog/1536x0/https://upload.wikimedia.org/wikipedia/commons/8/8b/Motion_Capture_with_Chad_Phantom.png 2x" /><sup><center>Motion capture <a href="https://commons.wikimedia.org/wiki/File:Motion_Capture_with_Chad_Phantom.png" target="_blank" rel="noreferrer noopener" title="This link will take you away from hive.blog" class="external_link">Source CC-BY SA 3.0 The goal of this tool is make "motion-capture" accessible to everyone, for those who don't know what motion capture is, it's the technology used in industries such as videogame's or movie's to recreate motion from a real object into digital software. Motion capture is known to be pretty expensive and not really easy to do, thus it was used only by big companies. The aim of Plask is to change tat and to make everyone able to use <strong>motion capture technology, that's why Plask is <strong><em>free (remember that nothing is really free) and is made to be <strong> easy to use. You just need a video of yourself, you can even shot it directly on the website using your webcam and then you movememt will be recreated by a character on their engine thanks to the power of <strong> artificial intelligence <hr /> <p dir="auto"><h2> How to use Plask ?<p> <hr /> <p dir="auto">The first things you are going to need in order to use Plask are the following: <li>A Video of a movement made by a human that you want to recreate in 3D (I don't know what formats are accepted but I guess the most commons are (MP4, AVI...)) <li>A 3D software, <a href="https://Blender.org" target="_blank" rel="noreferrer noopener" title="This link will take you away from hive.blog" class="external_link">Blender for exemple, is an open-source free to use and yet powerful software, a lot of tutorial are available on the web and it may be one of the software with the biggest community. And... That's all you really need in fact, the rest will be done by the software itself. <p dir="auto"><br /><br /> First step, create an account, it's easy to do I don't even know why I tell you to do it as it seems obvious<br /> <br /> Then you can get started and you will face this interface: <p dir="auto"><img src="https://images.hive.blog/768x0/https://files.peakd.com/file/peakd-hive/enzor/23swibVzEFu5fQTH1LFNgi9BrMy4Efs3tqnkwDjyym6jePHVxEp4p5B7ze48XvYMghyvM.png" alt="interface.png" srcset="https://images.hive.blog/768x0/https://files.peakd.com/file/peakd-hive/enzor/23swibVzEFu5fQTH1LFNgi9BrMy4Efs3tqnkwDjyym6jePHVxEp4p5B7ze48XvYMghyvM.png 1x, https://images.hive.blog/1536x0/https://files.peakd.com/file/peakd-hive/enzor/23swibVzEFu5fQTH1LFNgi9BrMy4Efs3tqnkwDjyym6jePHVxEp4p5B7ze48XvYMghyvM.png 2x" /> <p dir="auto"><strong> The panel on the right side represent the models that you can use my right clicking on them and click on Visualization you have a representation of them. <p dir="auto"><strong>The controls with the viewports are: <li>Arrow keys, control the camera <li>alt + right click: allow you to pan <li>alt + left click: orbit the camera (same as arrows) <li> mousewheel : zoom <li> alt + both click : zoom in / zoom out <p dir="auto">By right clicking anywhere you can also trigger special views. <p dir="auto"><strong> The panel on the left is about modifying the character in the viewport, for more details about this you can read the <a href="https://plasticmask.notion.site/User-guide-ac4bba1b75384c309e7a24e6542454ba" target="_blank" rel="noreferrer noopener" title="This link will take you away from hive.blog" class="external_link">documentation that is a good explanation of how it works <p dir="auto"><strong> Importing your video <p dir="auto">It is pretty simple alll you have to do is to drag and drop it on the website are click on the little + next to Library, then you can confirm that you want to extract motion out of the video, it will lead you to that interface: <p dir="auto"><img src="https://images.hive.blog/768x0/https://files.peakd.com/file/peakd-hive/enzor/23tbPAKNSPX5wg1FK9Com8NWDhKmPPRXKoerXfbM1AKzUj7E9NWYH8Zk6m9JrrgzVj9EY.png" alt="interface1.png" srcset="https://images.hive.blog/768x0/https://files.peakd.com/file/peakd-hive/enzor/23tbPAKNSPX5wg1FK9Com8NWDhKmPPRXKoerXfbM1AKzUj7E9NWYH8Zk6m9JrrgzVj9EY.png 1x, https://images.hive.blog/1536x0/https://files.peakd.com/file/peakd-hive/enzor/23tbPAKNSPX5wg1FK9Com8NWDhKmPPRXKoerXfbM1AKzUj7E9NWYH8Zk6m9JrrgzVj9EY.png 2x" /> <p dir="auto">(I am using an export here so that's not the best thing you want to use to extract motion out of it)<br /> On this interface you can select the fram from which you want to extract the motion and then click on <strong> Extract Motion to get the animation of your motion. That you can then easily apply to to one of the models that we saw just before.<br /> (Some videos are not rendered in this interface and I don't know why, maybe they are too heaving or too long I really don't know)<br /> To finally export your motion just right click on the model selected on the left panel and extract with th desired file format. <p dir="auto">You can finally import this file into the 3d software of your choice to recreate and animation with it.<br /> <code>In blender the fbx file format seems to be the best but I had some issues with the textures not showing properly <hr /> <h2> How good does it work ? <hr /> <p dir="auto">So I decided to test some things by myself, the first thing I tried was to record myself head to toe and to do some movements. I then imported the result on Plask.ai but infortunately the result was really bad and it was not matching my movement in the video so it was kind of a fail but I was pretty sure it won't work that good in the condition I was using it. <p dir="auto">I then decided to use some green screen videos from youtube to recreate the motion of the video in blender, for each of the following videos I rendered the 250 first frame of the movement using Plask : <p dir="auto"> <p dir="auto"> <hr /> <p dir="auto"> <p dir="auto"> <hr /> <p dir="auto">I was really amazed by the result considering the low effort I had to put on, I then tried doing the same with the video they provide on the website to see if it was legit, and I have to say that the results were really good : <p dir="auto"> <p dir="auto"><span><a href="https://plask.ai/mp4/motion.mp4" target="_blank" rel="noreferrer noopener" title="This link will take you away from hive.blog" class="external_link">https://plask.ai/mp4/motion.mp4 <hr /> <h2> Overall review <hr /> <p dir="auto">Plask is a great tool considering the fact that it is free and that it want to provide an access to motion-capture-based technology, the AI is really great and the results are good as long as you use really clean videos. So I think its main purpose is well done.<br /> Considering the user experience, the tool is really easy to use but it is still a bit buggy with some tools not working really well or some button that you have to click a several times in order for it to work as entended. <p dir="auto">I think this tool is more something that people will use in order create draft for their project as it will be a cheap and effective way to make simple motion in a fast way. Very few people will use it for a whole project but it is a good start to create motion and then tweak it a little to have clean results, but the Videos used need to be really good also which can be hard to achieve for everyone, a smartphone may not be enough to create good video for this tool, so it is not really accessible for everyone. <hr /> <p dir="auto">Thank you for reading that post, it was the first of this kind and I really wanted to show it to you because I think it is a good tool for everyone doing 3d aniamtion.