I have developed a software for the management of the movements kinect (sdk 1.5) – kuka R850 robot. It has been made a kinect-kuka server c# (multithread) that generates input every 12ms.
The Kinect – kuka server contains the programming of a network connection to the robot controller in the programming language C#.
The program generates a second process which communicates with the robot controller, independently of the data generates by the sensor Kinect because a data packet received by the external system must be answered within approx. 12 ms.
The System developed has:
- Robot Kuka R850
- Robot controller
- Teach pendant (KCP)
- Connecting cables
- Kinect sensor
- PC Server C# on Windows 7
When the user raises his left hand and He says: “Record” , the system saves the starting position of the user.
If the user raises his left hand and he says “First or Second.. joint” the system selects the joint type, when the user lowers the left hand, he can move the right hand on y axes to move the robot.
If the user says “Traslation” or “Rotation” the user can move the right hand on x,y,z axes to move the robot .
Note: the system accepts the audio command if only the user raises his left hand.
You Can see my work:
Rosario Barbagallo ,computer science engineer.Catania (Sicily, Italy).