By using this site, you agree to our Privacy Policy and our Terms of Use. Close

Forums - Microsoft Discussion - Kinect detects sign language.

Hmm, probably not coincidence that one of the Dr.'s on the microsoft team has a lot of research in sign language recognition from camera systems.  Having a depth sensor actually solves a lot of the complicated image processing problems, so it's not unlikely that MS decided to patent a lot of the offshoots of his research.



Around the Network
Mr Puggsly said:
papflesje said:

No offense, but no way in hell that it can detect movement that fast and delicate. I've seen plenty of programmes that can detect sign language, but that usually has to be slowed down so that the computer can actually keep up with it. It's like talking in slow motion...

I imagine the programs you're talking about used a standard webcam? The Kinect is far more capable so I'd imagine it would do it better.


Believe me, trying to keep up with the finesses of actual sign language is not something that just 'happens'. There's a reason why such specific programmes cost huge amounts...



If a game like this is made, I doubt that kinect will be able to pick up that many signs,   sorry



papflesje said:
Mr Puggsly said:
papflesje said:

No offense, but no way in hell that it can detect movement that fast and delicate. I've seen plenty of programmes that can detect sign language, but that usually has to be slowed down so that the computer can actually keep up with it. It's like talking in slow motion...

I imagine the programs you're talking about used a standard webcam? The Kinect is far more capable so I'd imagine it would do it better.


Believe me, trying to keep up with the finesses of actual sign language is not something that just 'happens'. There's a reason why such specific programmes cost huge amounts...

True, a sign language software just tries to make sense of what its looking at.

However, the Kinect is designed to recognize people and even make a skeletal structure of a person. Perhaps that simplifies tracking hand gestures and converting it to words.



Recently Completed
River City: Rival Showdown
for 3DS (3/5) - River City: Tokyo Rumble for 3DS (4/5) - Zelda: BotW for Wii U (5/5) - Zelda: BotW for Switch (5/5) - Zelda: Link's Awakening for Switch (4/5) - Rage 2 for X1X (4/5) - Rage for 360 (3/5) - Streets of Rage 4 for X1/PC (4/5) - Gears 5 for X1X (5/5) - Mortal Kombat 11 for X1X (5/5) - Doom 64 for N64 (emulator) (3/5) - Crackdown 3 for X1S/X1X (4/5) - Infinity Blade III - for iPad 4 (3/5) - Infinity Blade II - for iPad 4 (4/5) - Infinity Blade - for iPad 4 (4/5) - Wolfenstein: The Old Blood for X1 (3/5) - Assassin's Creed: Origins for X1 (3/5) - Uncharted: Lost Legacy for PS4 (4/5) - EA UFC 3 for X1 (4/5) - Doom for X1 (4/5) - Titanfall 2 for X1 (4/5) - Super Mario 3D World for Wii U (4/5) - South Park: The Stick of Truth for X1 BC (4/5) - Call of Duty: WWII for X1 (4/5) -Wolfenstein II for X1 - (4/5) - Dead or Alive: Dimensions for 3DS (4/5) - Marvel vs Capcom: Infinite for X1 (3/5) - Halo Wars 2 for X1/PC (4/5) - Halo Wars: DE for X1 (4/5) - Tekken 7 for X1 (4/5) - Injustice 2 for X1 (4/5) - Yakuza 5 for PS3 (3/5) - Battlefield 1 (Campaign) for X1 (3/5) - Assassin's Creed: Syndicate for X1 (4/5) - Call of Duty: Infinite Warfare for X1 (4/5) - Call of Duty: MW Remastered for X1 (4/5) - Donkey Kong Country Returns for 3DS (4/5) - Forza Horizon 3 for X1 (5/5)

I don't think this'll be used for Kinect, at least not in this gen. I can imagine it'd be too expensive to implement any time soon but MS are probably keeping their options open. Might even use it in a more specialised device intially before implementing it for a next-gen Kinect.



Around the Network
Mr Puggsly said:
papflesje said:
Mr Puggsly said:
papflesje said:

No offense, but no way in hell that it can detect movement that fast and delicate. I've seen plenty of programmes that can detect sign language, but that usually has to be slowed down so that the computer can actually keep up with it. It's like talking in slow motion...

I imagine the programs you're talking about used a standard webcam? The Kinect is far more capable so I'd imagine it would do it better.


Believe me, trying to keep up with the finesses of actual sign language is not something that just 'happens'. There's a reason why such specific programmes cost huge amounts...

True, a sign language software just tries to make sense of what its looking at.

However, the Kinect is designed to recognize people and even make a skeletal structure of a person. Perhaps that simplifies tracking hand gestures and converting it to words.


Skeletal structure is not seen by the hardware but added in by software. Put a IR lense on PSeye  then a strong IR light  and you got Kinect hardware. 

TrackIR, Wii-note, Kinect uses a IR lense to filter out normal light. PSeye  tracks with  normal light which can be a little more tricky but it can be done.



Smidlee said:
Mr Puggsly said:
papflesje said:
Mr Puggsly said:
papflesje said:

No offense, but no way in hell that it can detect movement that fast and delicate. I've seen plenty of programmes that can detect sign language, but that usually has to be slowed down so that the computer can actually keep up with it. It's like talking in slow motion...

I imagine the programs you're talking about used a standard webcam? The Kinect is far more capable so I'd imagine it would do it better.


Believe me, trying to keep up with the finesses of actual sign language is not something that just 'happens'. There's a reason why such specific programmes cost huge amounts...

True, a sign language software just tries to make sense of what its looking at.

However, the Kinect is designed to recognize people and even make a skeletal structure of a person. Perhaps that simplifies tracking hand gestures and converting it to words.


Skeletal structure is not seen by the hardware but software. Put a IR lense on PS eye  webcam then a strong IR light   and you got Kinect hardware.

Fixed.

Well its software working with more hardware than a simple webcam offers.



Recently Completed
River City: Rival Showdown
for 3DS (3/5) - River City: Tokyo Rumble for 3DS (4/5) - Zelda: BotW for Wii U (5/5) - Zelda: BotW for Switch (5/5) - Zelda: Link's Awakening for Switch (4/5) - Rage 2 for X1X (4/5) - Rage for 360 (3/5) - Streets of Rage 4 for X1/PC (4/5) - Gears 5 for X1X (5/5) - Mortal Kombat 11 for X1X (5/5) - Doom 64 for N64 (emulator) (3/5) - Crackdown 3 for X1S/X1X (4/5) - Infinity Blade III - for iPad 4 (3/5) - Infinity Blade II - for iPad 4 (4/5) - Infinity Blade - for iPad 4 (4/5) - Wolfenstein: The Old Blood for X1 (3/5) - Assassin's Creed: Origins for X1 (3/5) - Uncharted: Lost Legacy for PS4 (4/5) - EA UFC 3 for X1 (4/5) - Doom for X1 (4/5) - Titanfall 2 for X1 (4/5) - Super Mario 3D World for Wii U (4/5) - South Park: The Stick of Truth for X1 BC (4/5) - Call of Duty: WWII for X1 (4/5) -Wolfenstein II for X1 - (4/5) - Dead or Alive: Dimensions for 3DS (4/5) - Marvel vs Capcom: Infinite for X1 (3/5) - Halo Wars 2 for X1/PC (4/5) - Halo Wars: DE for X1 (4/5) - Tekken 7 for X1 (4/5) - Injustice 2 for X1 (4/5) - Yakuza 5 for PS3 (3/5) - Battlefield 1 (Campaign) for X1 (3/5) - Assassin's Creed: Syndicate for X1 (4/5) - Call of Duty: Infinite Warfare for X1 (4/5) - Call of Duty: MW Remastered for X1 (4/5) - Donkey Kong Country Returns for 3DS (4/5) - Forza Horizon 3 for X1 (5/5)

Mr Puggsly said:
Smidlee said:
Mr Puggsly said:


Skeletal structure is not seen by the hardware but software. Put a IR lense on PS eye  webcam then a strong IR light   and you got Kinect hardware.

Fixed.

Well its software working with more hardware than a simple webcam offers.

 Well the PS Eye has 4 mics.



Smidlee said:
Mr Puggsly said:
Smidlee said:
Mr Puggsly said:
papflesje said:
Mr Puggsly said:
papflesje said:

No offense, but no way in hell that it can detect movement that fast and delicate. I've seen plenty of programmes that can detect sign language, but that usually has to be slowed down so that the computer can actually keep up with it. It's like talking in slow motion...

I imagine the programs you're talking about used a standard webcam? The Kinect is far more capable so I'd imagine it would do it better.


Believe me, trying to keep up with the finesses of actual sign language is not something that just 'happens'. There's a reason why such specific programmes cost huge amounts...

True, a sign language software just tries to make sense of what its looking at.

However, the Kinect is designed to recognize people and even make a skeletal structure of a person. Perhaps that simplifies tracking hand gestures and converting it to words.


Skeletal structure is not seen by the hardware but software. Put a IR lense on PS eye  webcam then a strong IR light   and you got Kinect hardware.

Fixed.

Well its software working with more hardware than a simple webcam offers.

 Well the PS Eye has 4 mics.

They should have just put one really good mic.



Recently Completed
River City: Rival Showdown
for 3DS (3/5) - River City: Tokyo Rumble for 3DS (4/5) - Zelda: BotW for Wii U (5/5) - Zelda: BotW for Switch (5/5) - Zelda: Link's Awakening for Switch (4/5) - Rage 2 for X1X (4/5) - Rage for 360 (3/5) - Streets of Rage 4 for X1/PC (4/5) - Gears 5 for X1X (5/5) - Mortal Kombat 11 for X1X (5/5) - Doom 64 for N64 (emulator) (3/5) - Crackdown 3 for X1S/X1X (4/5) - Infinity Blade III - for iPad 4 (3/5) - Infinity Blade II - for iPad 4 (4/5) - Infinity Blade - for iPad 4 (4/5) - Wolfenstein: The Old Blood for X1 (3/5) - Assassin's Creed: Origins for X1 (3/5) - Uncharted: Lost Legacy for PS4 (4/5) - EA UFC 3 for X1 (4/5) - Doom for X1 (4/5) - Titanfall 2 for X1 (4/5) - Super Mario 3D World for Wii U (4/5) - South Park: The Stick of Truth for X1 BC (4/5) - Call of Duty: WWII for X1 (4/5) -Wolfenstein II for X1 - (4/5) - Dead or Alive: Dimensions for 3DS (4/5) - Marvel vs Capcom: Infinite for X1 (3/5) - Halo Wars 2 for X1/PC (4/5) - Halo Wars: DE for X1 (4/5) - Tekken 7 for X1 (4/5) - Injustice 2 for X1 (4/5) - Yakuza 5 for PS3 (3/5) - Battlefield 1 (Campaign) for X1 (3/5) - Assassin's Creed: Syndicate for X1 (4/5) - Call of Duty: Infinite Warfare for X1 (4/5) - Call of Duty: MW Remastered for X1 (4/5) - Donkey Kong Country Returns for 3DS (4/5) - Forza Horizon 3 for X1 (5/5)

Mr Puggsly said:
 

They should have just put one really good mic.


It's my understanding it helps to reduce  background noise.