|
davide445
|
davide445
Posted 10 Years Ago
|
|
Group: Forum Members
Last Active: 3 Years Ago
Posts: 98,
Visits: 852
|
@Kamehana Noticed now this tread, interesting since me too was looking a couple of years ago to achieve the same goal. About your specific request: iClone is a 3d design tool, that use a game engine to render in realtime the scene. But AFAIK is made to produce the final videos not in realtime, computing effects and other elements. But there are indeed options to achieve what you want with a budget, that was what I miss to achieve it. You can use game engines such as Unity3D, Unreal Engine or CryEngine. This is the most used path since they are already realtime, created to deal with avatars and also in some way integrated with mocap tools (last time I checked Unity was the best in term of integration, not in term of visual quality unfortunately). You can also use realtime visual programming tools such as TouchDesigner, VVVV, Max/MSP, OpenFrameworks, Processing. These are more creative coding tools that need some different approach, since they are more general framework for realtime audio/video/3d assets processing than pure 3d engines. Visual quality, artistic settings, graphics effects and budget will define your path. About mocap in my case I was fighting in any way to avoid markers or body sensor, but probably this is the easier way to obtain clean and accurate realtime data.
|
|
Kamehana
|
Kamehana
Posted 10 Years Ago
|
|
Group: Forum Members
Last Active: 10 Years Ago
Posts: 2,
Visits: 10
|
Hello
Thank you for your thoughtful and in-depth reply . It is extremely helpful as I am a newbie.
Regards
|
|
Rampa
|
Rampa
Posted 11 Years Ago
|
|
Group: Forum Members
Last Active: Last Month
Posts: 8.2K,
Visits: 62.6K
|
The iClone plugin for capturing from the Neuron suit will only support a single character. It works by capturing the real-time BVH output streaming from the neuron suit. The basic neuron software (free) can handle 2 characters, and their pro software can handle 5. You will get a real-time preview of the body motion, but no face or interaction with the set. Actually, I don't know if the physics engine might be active during capture or not. So maybe you could knock down a wall or something in real-time, but don't count on it.
Your project is quite a bit beyond the scope of iClone's abilities as it stands currently.
|
|
Grimhilda
|
Grimhilda
Posted 11 Years Ago
|
|
Group: Forum Members
Last Active: Last Year
Posts: 426,
Visits: 886
|
Hi, welcome to the forum. Firstly, it's possible that your question may be largely unnoticed because this section of the forum is for newcomers to introduce themselves. It may help to ask again in the Iclone General area where those with experience of Motion Capture might give a better reply than mine.
Your goal is ambitious and you are preparing to invest a lot to achieve it but I don't see it as being possible to do so using Iclone at this time. Now, I need to stress that I have no experience of Motion Capture but I follow threads in a number of 3d forums and try to glean as much knowledge of all things 3d as I can. I'm hoping my reply will bring in someone with actual experience.
My understanding is that (in general - I think also for Perception Neuron) Motion Capture software will show a real-time avatar (or stick-man) echoing the movements of the actor while motions are being recorded. Obviously, the software visuals will vary from one motion capture solution to another. These recorded motions can then be imported into a range of 3d software packages and applied to avatars within a 3d scene. The scene will be rendered, frame by frame, into a video file. Again, I have no first-hand experience but I've often read that captured motions typically need to be 'cleaned up' - even from the best systems. (I suppose some movements are 'jittery' or whatever).
Reallusion's Iclone program allows characters/avatars to be animated within scenes that are built using the software. There is a plugin under development which will enable owners of Perception Neuron to apply captured motions to figures within Iclone scenes to bring about these animations. One person with one Perception Neuron system could create a whole collection of moves and apply them to his/her characters to make a video. The nice thing is that the same motions can be applied to characters large or small, fat or thin as long as they have the same underlying structure.
Unfortunately, it wouldn't be in real time as you envisage. Iclone's real time capabilities refer to the immediate feedback a user gets in the working window when a movie clip is being created. In many other software packages, if I want to show effects such as particles, I only get to see them properly after the video has been rendered frame by frame but in Iclone I get a real-time preview.
ON THE OTHER HAND ... it remains to be seen what Reallusion's forthcoming plugin for Iclone will consist of. Maybe someone wearing the Perception Neuron suit will be able to see his/her motions be echoed in real-time within the Iclone interface (in the way that motion capture software typically uses its own interface with its own stick-man) while motion recording is taking place. If so, the character could probably exist in a scene - depending on the scene size, many computers might struggle. But such a scene would only be Iclone's working area rather than the final rendered video with camera moves, etc. and possibly wouldn't look too spectacular when projected on stage. I definitely can't envisage multiple characters being catered for simultaneously.
Hope my ramblings are of some use.
|
|
Kamehana
|
Kamehana
Posted 11 Years Ago
|
|
Group: Forum Members
Last Active: 10 Years Ago
Posts: 2,
Visits: 10
|
Hello:
I am planning to purchase 5 Perception Neuron mocap suits. I would like to create a live theatrical dance performance that uses real-time motion capture to animate 5 characters/avatars in realtime. I envision 5 dancers each wearing a Perception Neuron suit. I would like to know what products I would need to purchase to do the following: 1: Capture each individual dancers' movement in realtime 2: Create an avatar of each dancer (clothes, facial expression, hair & skin) 3: Create a 3D environment(s) where the dance take place 4: Map the movement of each of the five dancers to their individual avatar(s) in realtime
The goal is to have both the real dancers performing live on stage while simultaneously projecting (on a 50' X 25' projection screen) the virtual dancers performing and interacting within the virtual 3D world.
Thanks for any suggestions.
|