30.10.2010, 10:43
*************************************************************************************************
VERSION 1.4 AVAILABLE:
http://facetracknoir.sourceforge.net/in ... wnload.htm
*************************************************************************************************
Hello Gents. In the "General discussion" area you can see this thread: viewtopic.php?f=1&t=29862
First of all, thanks a lot to Shardana for sharing the news (grati ti siamo, ahio'! :mrgreen: ). I was really curious about the possibility to track head movement without any special set, just using a simple webcam. The technology already existed, but now someone has made it accessible to everybody... and FREE!
I've downloaded the program and tried it out on IL-2. And, yes, it DOES work! So, should you be interested in it too, here's a little review. Download links are in the first posts of the discussion linked above.
I've never tried TrackIR nor any other tracking device, so I can't tell if there is any difference in performances.
**************
NOTE: initial review refers to 1.3 version, newer releases will be commented in later posts.
**************
TESTED ON: SONY Vaio, Intel I7 Quad core, 8 Gb RAM, Windows 7, integrated webcam. Game version: IL-2 1946 v4.09 + UP 2.01, modded 6DOF activated.
***** DOWNLOAD AND INSTALLATION ******
Not so hard. I downloaded version 1.30, which includes DLLs and other little Windows stuff required. Shouldn't that work (like in my case), you'll also have to download and install a free demo of a commercial facetracking program, which will add what you need to get it working. Then you can remove the demo without losing the needed files. (Complete installation guide is on the site).
***** GETTING STARTED *****
You have the possibility to save different configuration settings as .ini files.
The "Game protocol" slot gives a choice of which tracking program must be simulated. So far I've got it working only with "Fake TrackIR".
Once you start the engine, you will see on the bottom left corner a "virtual mask" appear on your face as soon as the program tracks it, while data about resources usage are displayed. For me, it is about 10%-20% CPU and 90 Mb RAM while scanning to find the face, and about 5%-10% CPU and 125 Mb RAM to keep tracking. At least with my default webcam: I couldn't tweak its options that much, but I find 30 fps to be acceptable.
Note that you will need good lighting conditions. If the room is too dark, or your face is not fully enlighted, or you have the sun on your back, the program won't be able to track your face.
Hotkeys selection is somewhat limited, but at least you can set the key to center visual (very helpful!)
***** IN FLIGHT *****
Even when testing missions with several planes, I didn't notice any significant drop in game performances.
If, like in my case, you've never tried TackIR or something like that, you'll need a little practice to "get the feeling" with this system.
Calibration is easy, because at any time you can minimize the game, adjust the cursors, and immediately see the results.
I feel comfortable with the settings shown in the image. 500 is the max valor, and I think this could be improved, because even with rotation sensitivity set to maximum you will have to turn your head almost 90° to obtain a 180° FOV rotation, and this makes it uncomfortable to keep looking at the screen.
On the contrary, XYZ axis movements tend to be excessive, so my advice is to keep it low.
There's also another reason to keep XYZ axis movement as low as possible, and this, IMO, is also currently the main drawback of face tracking technology: flickering.
It must be indeed harder for a computer to track movements from a human face instead than from a few definite points indicated by LEDs. The result is that, even if you keep absolutely still, your tracked position is never the same in two frames. In game, this causes a constant tremble of the visual. Luckily, the program has a filter for every axis (the "red. factor") which helps to reduce, but not eliminate, this problem. Plus, the higher the sensitivity, the more the visual trembles, expecially on XYZ movement, so go easy with that.
Nevertheless, I'm sure future versions will feature better filters, so this problem should be solved with time.
Oh, BTW: should the tracking be lost, the program will immediately start scanning, so just look straight at the camera and you should regain tracking in seconds.
Occasional bug: visual twisting and sticking to an absurd angle, even inverted. Usually, this is solved by stopping, closing and reloading the tracking program without the need to exit game. But I said USUALLY!
***** IN COMBAT *****
"Beware of what you wish... it might come true!" You want realism? You got it.
Face tracking actually puts your head INSIDE the cockpit! You will twist your neck looking for enemies, lean left and right to check your six behind that huge armour plate, crouch to check the instruments and align your eye with the sights to aim! If you like going realistic, this is just THE way to play.
The flickering problem can indeed be annoying when you try to spot enemies or to take precision shots, but after all it's not worse than flying through clouds in a thunderstorm. Once you've spotted a target (and you practiced a little), keeping your eyes on it feels surprisingly natural. Aiming becomes harder, but this way scoring a kill has an even sweeter taste. And a bandit on your six gets as scary as it should be!
Actually, I'm still practicing with a little help from dear old F6 key :roll:, because situational awareness becomes a really tough matter.
Of course, it also works in F2 and similar views. Haven't tested it with padlock, but it's just nonsense
If you switch to "gunsight view", you are aligned with the crosshair, but you lose XYZ axis movement (rotation only in this mode).
***** CONCLUSIONS *****
Rating 9/10 IMO. Totally free, requiring a simple webcam to give you all 6DOF performances. Can't wait to see future versions, hoping for an improvement in filters to eliminate flickering. At that point it will be 10+! 8)
VERSION 1.4 AVAILABLE:
http://facetracknoir.sourceforge.net/in ... wnload.htm
*************************************************************************************************
Hello Gents. In the "General discussion" area you can see this thread: viewtopic.php?f=1&t=29862
First of all, thanks a lot to Shardana for sharing the news (grati ti siamo, ahio'! :mrgreen: ). I was really curious about the possibility to track head movement without any special set, just using a simple webcam. The technology already existed, but now someone has made it accessible to everybody... and FREE!
I've downloaded the program and tried it out on IL-2. And, yes, it DOES work! So, should you be interested in it too, here's a little review. Download links are in the first posts of the discussion linked above.
I've never tried TrackIR nor any other tracking device, so I can't tell if there is any difference in performances.
**************
NOTE: initial review refers to 1.3 version, newer releases will be commented in later posts.
**************
TESTED ON: SONY Vaio, Intel I7 Quad core, 8 Gb RAM, Windows 7, integrated webcam. Game version: IL-2 1946 v4.09 + UP 2.01, modded 6DOF activated.
***** DOWNLOAD AND INSTALLATION ******
Not so hard. I downloaded version 1.30, which includes DLLs and other little Windows stuff required. Shouldn't that work (like in my case), you'll also have to download and install a free demo of a commercial facetracking program, which will add what you need to get it working. Then you can remove the demo without losing the needed files. (Complete installation guide is on the site).
***** GETTING STARTED *****
You have the possibility to save different configuration settings as .ini files.
The "Game protocol" slot gives a choice of which tracking program must be simulated. So far I've got it working only with "Fake TrackIR".
Once you start the engine, you will see on the bottom left corner a "virtual mask" appear on your face as soon as the program tracks it, while data about resources usage are displayed. For me, it is about 10%-20% CPU and 90 Mb RAM while scanning to find the face, and about 5%-10% CPU and 125 Mb RAM to keep tracking. At least with my default webcam: I couldn't tweak its options that much, but I find 30 fps to be acceptable.
Note that you will need good lighting conditions. If the room is too dark, or your face is not fully enlighted, or you have the sun on your back, the program won't be able to track your face.
Hotkeys selection is somewhat limited, but at least you can set the key to center visual (very helpful!)
***** IN FLIGHT *****
Even when testing missions with several planes, I didn't notice any significant drop in game performances.
If, like in my case, you've never tried TackIR or something like that, you'll need a little practice to "get the feeling" with this system.
Calibration is easy, because at any time you can minimize the game, adjust the cursors, and immediately see the results.
I feel comfortable with the settings shown in the image. 500 is the max valor, and I think this could be improved, because even with rotation sensitivity set to maximum you will have to turn your head almost 90° to obtain a 180° FOV rotation, and this makes it uncomfortable to keep looking at the screen.
On the contrary, XYZ axis movements tend to be excessive, so my advice is to keep it low.
There's also another reason to keep XYZ axis movement as low as possible, and this, IMO, is also currently the main drawback of face tracking technology: flickering.
It must be indeed harder for a computer to track movements from a human face instead than from a few definite points indicated by LEDs. The result is that, even if you keep absolutely still, your tracked position is never the same in two frames. In game, this causes a constant tremble of the visual. Luckily, the program has a filter for every axis (the "red. factor") which helps to reduce, but not eliminate, this problem. Plus, the higher the sensitivity, the more the visual trembles, expecially on XYZ movement, so go easy with that.
Nevertheless, I'm sure future versions will feature better filters, so this problem should be solved with time.
Oh, BTW: should the tracking be lost, the program will immediately start scanning, so just look straight at the camera and you should regain tracking in seconds.
Occasional bug: visual twisting and sticking to an absurd angle, even inverted. Usually, this is solved by stopping, closing and reloading the tracking program without the need to exit game. But I said USUALLY!
***** IN COMBAT *****
"Beware of what you wish... it might come true!" You want realism? You got it.
Face tracking actually puts your head INSIDE the cockpit! You will twist your neck looking for enemies, lean left and right to check your six behind that huge armour plate, crouch to check the instruments and align your eye with the sights to aim! If you like going realistic, this is just THE way to play.
The flickering problem can indeed be annoying when you try to spot enemies or to take precision shots, but after all it's not worse than flying through clouds in a thunderstorm. Once you've spotted a target (and you practiced a little), keeping your eyes on it feels surprisingly natural. Aiming becomes harder, but this way scoring a kill has an even sweeter taste. And a bandit on your six gets as scary as it should be!
Actually, I'm still practicing with a little help from dear old F6 key :roll:, because situational awareness becomes a really tough matter.
Of course, it also works in F2 and similar views. Haven't tested it with padlock, but it's just nonsense
If you switch to "gunsight view", you are aligned with the crosshair, but you lose XYZ axis movement (rotation only in this mode).
***** CONCLUSIONS *****
Rating 9/10 IMO. Totally free, requiring a simple webcam to give you all 6DOF performances. Can't wait to see future versions, hoping for an improvement in filters to eliminate flickering. At that point it will be 10+! 8)