NCSI: Cognitive Sensing for Robot-human Interaction

Status	Completed
Mentor Name	Jiang Lu
Mentor's XSEDE Affiliation	Campus Champion
Mentor Has Been in XSEDE Community	Less than 1 year
Project Title	Cognitive Sensing for Robot-human Interaction
Summary	This is follow-up research of facial expression recognition and object tracking. Human-machine (Robot) interaction gains more and more interest recently thanks to the HPC. With face recognition and facial expression recognition, robots can 'feel' the emotions of human beings. In this project, we are investigating more resources (e.g. speech, environment) for improving the interaction between human being and robot. The integration of those resources will be tested in XSEDE HPC.
Job Description	The ongoing research develops speech recognition and integrates with face recognition and facial expression recognition for the purpose of human-robot interaction. The students will be responsible for working a full semester for 30 hours per week. The students will participate in weekly group meetings for the monitoring of the project. The students will research existing methods of natural language processing and artificial intelligence for speech recognition. The students will evaluate the methods and pick one for our robot-human interaction study. The students will implement the picked method in HPC for modeling. The students will have access to the center for robotic software at University of Houston Clear Lake. The students' final project will be used for a further research project in another semester.
Computational Resources	XSEDE training classes XSEDE supercomputing Clusters with Data Mining. AI/Deep learning software Data visualization software Additionally, the mentor can use the resources in the center for robotic software at University of Houston Clear Lake.
Contribution to Community
Position Type	Apprentice
Training Plan	The student will be supervised by the mentor and graduate students, who have experience in speech recognition and human-machine interaction. The student will learn the basics of deep learning using TensorFlow and Keras. The student will learn speech recognition. The student will be trained for the usage of XSEDE in University of Houston Clear Lake.
Student Prerequisites/Conditions/Qualifications	1. Interest and background in machine learning and artificial intelligence. 2. Thrive on the challenge in complex problem-solving. 3. Effective communication. 4. At least a strong background in one of the below, or a combination two having a solid background from the below list: Programming, Robotics, Mathematics, Deep Learning, Speech recognition, and Computer Vision.
Duration	Summer
Start Date	06/03/2019
End Date	08/09/2019