Syllabus
Introduction
Cognitive robotics and social robotics are related, but distinct fields within robotics. Cognitive robotics is focused on creating robots that can perform tasks that require advanced perception, reasoning, and decision-making abilities. These tasks may include recognizing objects, understanding natural language, learning from experience, and making predictions about the future. Cognitive robots are designed to be able to process and analyze large amounts of data, and to make decisions based on that data. Social robotics, on the other hand, is focused on creating robots that can interact and communicate with humans in a natural and effective way. Social robots are designed to be able to understand and respond to human emotions, social cues, and body language. They are also designed to be able to generate expressive and natural-sounding speech and gestures. Social robots are intended to be used in a variety of applications, such as customer service, education, and healthcare. Both cognitive and social robotics requires the use of advanced technologies such as machine learning, computer vision, and natural language processing. However, cognitive robotics is more focused on the robot’s ability to process information and make decisions, while social robotics is more focused on the robot’s ability to interact with humans.
Cognitive and social robotics enables the development of robots that can work in collaboration with human workers, improving the overall safety and performance of the workplace. Moreover, cognitive and social robotics enables the creation of robots that are able to interact with their environment and make decisions based on their perceptions, providing the opportunity for greater flexibility and autonomy in the production process. Cognitive and social robotics is becoming increasingly important in industrial production for several reasons. The ability to use robots in a way that leverages their cognitive and social capabilities can have a profound impact on industrial production. By enabling robots to work in a more collaborative and adaptive manner, it becomes possible to reduce the time and effort required to perform tasks, improve product quality and reliability, and minimize the impact of machine downtime and failure. For example, in a manufacturing setting, robots equipped with cognitive abilities can monitor production processes in real-time, identify potential problems, and make decisions to address those problems before they lead to equipment failures or production slowdowns. Additionally, social robots can interact with human workers in a production environment, providing assistance with tasks, monitoring worker safety, and collecting data that can be used to improve production processes.
Total Hours
This course unit covers 100 hours, from which 28 hours lectures, 14 hours lab work, and 58 hours individual study and work.
General Objective
The general objective of a course in cognitive and social robotics for industrial production is to equip students with the knowledge and skills necessary to design, develop, and integrate socially intelligent robots into various industrial settings. The course covers the principles of cognitive and social robotics, including human-robot interaction, machine learning, computer vision, and natural language processing. Students will learn how to design socially intelligent robots that can interact with human operators in a natural and intuitive way, and how to use these robots to enhance the efficiency, safety, and overall quality of industrial production processes. Through hands-on projects and case studies, students will gain practical experience in developing socially intelligent robots and integrating them into real-world industrial environments.
Specific Objectives / Learning Outcomes
The specific objectives or learning outcomes of this course unit are:
- Understanding the concepts and principles of cognitive and social robotics, and their applications in industrial production.
- Acquiring knowledge of the various sensing, perception, and decision-making capabilities of cognitive and social robots, and their impact on industrial production.
- Developing skills in programming, controlling, and integrating cognitive and social robots into industrial production processes.
- Familiarizing with the latest technologies and trends in cognitive and social robotics for industrial production, including IoT, cloud computing, and machine learning.
- Applying the knowledge and skills gained from the course to real-world industrial production problems, through hands-on laboratory work, projects, and case studies.
- Evaluating the potential benefits and challenges of integrating cognitive and social robots into industrial production processes, and proposing solutions to overcome these challenges.
- Developing a critical perspective on the ethical, social, and economic implications of cognitive and social robotics for industrial production.
Professional Competencies
The professional competencies that a student can gain from this course unit include:
- Knowledge and understanding of the basics of cognitive and social robotics and its applications in industrial production.
- Knowledge and understanding of the fundamental principles of human-robot interaction, including the design and implementation of interfaces, algorithms, and software for social robots.
- Knowledge and understanding of the ethical, legal, and societal implications of deploying social robots in industrial production, including data privacy, security, and other important considerations.
- Ability to develop, implement, and evaluate systems for integrating social robots into industrial production, including design and development of software and algorithms.
- Ability to work effectively with other professionals and stakeholders, including industrial engineers, technicians, and production managers, to design, develop, and integrate social robots into industrial production.
- Understanding of how to use data and analytics to optimize the deployment and performance of social robots in industrial production, including how to develop and implement predictive maintenance strategies.
- Ability to evaluate and interpret the results of experiments and case studies to inform decision-making and improve the performance of social robots in industrial production.
- Ability to communicate effectively with a wide range of stakeholders, including engineers, technicians, production managers, and customers, to explain the benefits and limitations of social robots in industrial production and to promote their effective integration into the workplace.
Cross Competencies
The course unit on Cognitive and Social Robotics for industrial production develops the following cross-competencies in students:
- Problem-Solving: Students will develop their problem-solving skills as they learn how to design, program, and integrate social robots into industrial production systems.
- Innovation: Students will learn how to identify new opportunities for using social robots in industrial production, and how to develop innovative solutions to improve production processes.
- Teamwork: Students will learn how to work in teams, collaborating with engineers and technicians from different disciplines to design and implement social robotics solutions for industrial production.
- Communication: Students will develop their communication skills as they work with stakeholders to explain the benefits and limitations of social robots, and how they can be used in industrial production.
- Adaptability: Students will learn how to work in an ever-changing environment, adapting to new technologies and changing business requirements as the use of social robots in industrial production evolves.
- Cross-cultural understanding: Students will gain an understanding of the cultural and ethical implications of using social robots in industrial production, and will learn how to work with stakeholders from diverse backgrounds.
- Ethical awareness: Students will develop their ethical awareness as they learn about the responsible use of social robots in industrial production, including data privacy and security, human-robot interaction, and ethical decision-making.
Alignment to Social and Economic Expectations
Evaluation
Assessment methods
For the lectures portion of the course unit on cognitive and social robotics in industrial production, the following assessment methods are used:
- Quizzes: In-class quizzes or online quizzes to test the students’ understanding of key concepts and theories covered in the lectures.
- Written assignments: Individual assignments that require students to apply their knowledge and skills to solve a real-world problem or case study.
- Midterm and Final Exams: These exams consist of multiple choice, short answer, and essay questions and assess the students’ overall understanding of the course material.
For the lab work portion of the course, the following assessment methods are used:
- Lab reports: Students are required to write lab reports documenting their experiments, results, and analysis. These reports are graded on the quality of their writing, methodology, results, and analysis.
- Oral presentations: Students are required to present their lab work to the class, which is assessed based on the quality of their presentation skills, content, and interaction with the audience.
Assessment criteria
For lectures, the assessment criteria for this course unit on ognitive and social robotics in industrial production are:
- Knowledge and Understanding: Assessment of the student’s ability to comprehend and apply the concepts, theories, and principles of ognitive and social robotics in industrial production.
- Analytical and Problem Solving Skills: Assessment of the student’s ability to analyze complex problems, evaluate different solutions, and make informed decisions related to ognitive and social robotics in industrial production.
- Communication Skills: Assessment of the student’s ability to communicate their ideas, designs, and solutions in a clear, concise, and effective manner.
- Teamwork and Collaboration Skills: Assessment of the student’s ability to work effectively in a team and collaborate with others to achieve a common goal.
- Application of Technology: Assessment of the student’s ability to apply appropriate technologies, tools, and software of cognitive and social robotics in industrial production.
For lab work, the assessment criteria could include:
- Technical Skills: Assessment of the student’s ability to use and apply the technical skills and knowledge acquired in the course to cognitive and social robotics solutions in industrial production.
- Quality of Work: Assessment of the student’s ability to produce high-quality work that meets the requirements and standards set for cognitive and social robotics in industrial production.
- Creativity and Innovation: Assessment of the student’s ability to think creatively and apply innovative solutions of cognitive and social robotics in industrial production.
- Attention to Detail: Assessment of the student’s ability to pay close attention to details and ensure that cognitive and social robotics solutions are accurate, complete, and well-documented.
- Time Management: Assessment of the student’s ability to manage their time effectively and deliver completed lab work within the specified timeframe.
Quantitative performance indicators to assess the minimum level of performance (mark 5 on a scale from 1 to 10)
Quantitative performance indicators to assess the minimum level of performance (mark 5 on a scale from 1 to 10) for the lectures:
- Attendance and participation in class discussions – The student should attend at least 80% of the lectures and actively participate in class discussions.
- Homework and Quizzes – The student should complete all homework assignments and quizzes with a minimum score of 60%.
- Midterm Exam – The student should achieve a minimum score of 50% on the midterm exam.
Quantitative performance indicators to assess the minimum level of performance (mark 5 on a scale from 1 to 10) for the lab works:
- Lab attendance and participation – The student should attend and participate in all scheduled lab sessions.
- Lab reports – The student should submit all lab reports on time, with a minimum score of 60% on each report.
- Lab assignments – The student should complete all lab assignments with a minimum score of 60%.
- Lab exams – The student should achieve a minimum score of 50% on the lab exams.
Quantitative performance indicators for the final exam to assess the minimum level of performance:
- Completion of a minimum number of lecture-related questions correctly – 70% of the total questions.
- The student should be able to demonstrate an understanding of the basic concepts and theories related to cognitive and social robotics and their applications in industrial production, with a minimum score of 50% on multiple-choice questions or short answer questions.
- The student should be able to explain and analyze real-life case studies and their results, with a minimum score of 50% on case study analysis questions.
- The student should be able to demonstrate a basic knowledge of the technologies, tools, and methodologies used in the design and implementation of cognitive and social robotics, with a minimum score of 50% on matching or labeling questions.
- The student should be able to apply the concepts and theories learned in the lectures to solve practical problems, with a minimum score of 50% on problem-solving questions.
- The student should be able to critically evaluate the benefits and challenges of using cognitive and social robotics in industrial production, with a minimum score of 50% on essay questions.
- Evidence of the ability to apply learned concepts and theories to practical scenarios, as demonstrated by the number of correctly answered application-based questions.
- Display of critical thinking skills, as evidenced by the number of correct answers to questions requiring analysis and synthesis of information.
- Overall exam performance, measured in terms of the total number of correct answers and expressed as a percentage of the total exam score. A minimum score of 50% or above is set as the benchmark for a mark of 5.
Lectures
Unit 1: Cognitive Robotics (2 hours)
- Definition and principles of cognitive robotics
- Techniques and algorithms used in cognitive robotics (e.g., machine learning, computer vision, natural language processing)
- Applications of cognitive robotics in industry
Unit 2: Social Robotics (2 hours)
- Definition and principles of social robotics
- Techniques used in social robotics (e.g., human-robot interaction, emotional intelligence)
- Applications of social robotics in industry
Unit 3: Human-Robot Interaction (2 hours)
- Human factors in robot design
- Techniques for human-robot interaction (e.g., gesture recognition, speech recognition)
- Ethics and safety in human-robot interaction
Unit 4: Introduction to Nao and Pepper Robots (2 hours)
- Overview of the hardware and software of Nao and Pepper robots
- Basic programming concepts for Nao and Pepper robots
- Applications of Nao and Pepper robots in industry and research
Unit 5: Nao and Pepper Programming (2 hours)
- Basic programming with Nao and Pepper robots
- Choregraphe, Python, Java and QiChat programming for Nao and Pepper robots
- Motion and gesture control with Nao and Pepper robots
Unit 6: Chatbots (2 hours)
- Overview of chatbots and their history
- Techniques used in chatbot development (e.g., rule-based systems, machine learning)
- Applications of chatbots in industry and customer service
Unit 7: Chatbot Development (2 hours)
- Basic programming for chatbots (e.g., API with Open AI ChatGPT, RASA and Python)
- Natural language processing for chatbots
- Integration of chatbots with other technologies (e.g., voice assistants, messaging platforms)
Unit 8: Introduction to Furhat Robot (2 hours)
- Overview of the hardware and software of the Furhat robot
- Basic programming concepts for the Furhat robot
- Applications of the Furhat robot in industry and research
Unit 9: Furhat Programming (2 hours)
- Basic programming with the Furhat robot
- Motion and gesture control with the Furhat robot
- Voice and speech recognition with the Furhat robot
Unit 10: Social Robotics in Manufacturing (2 hours)
- Overview of Industry 4.0 and its impact on manufacturing
- Role of social robots in smart factories
- Case studies and applications of social robots in manufacturing
Unit 11: Cognitive Robotics in Maintenance (2 hours)
- Maintenance tasks and their challenges
- Role of cognitive robots in predictive maintenance
- Case studies and applications of cognitive robots in maintenance
Unit 12: Advanced Topics in Cognitive Robotics (2 hours)
- Reinforcement learning and decision-making in cognitive robotics
- Explainable AI and transparency in cognitive robotics
- Integration of cognitive robotics with other technologies (e.g., IoT, AR/VR)
Unit 13: Advanced Topics in Social Robotics (2 hours)
- Emotion recognition and expression in social robotics
- Social and ethical implications of social robotics
- Integration of social robotics with other technologies (e.g., VR, smart homes)
Unit 14: Future Trends and Challenges in Robotics (2 hours)
- Emerging trends and technologies in robotics (e.g., swarm robotics, bio-inspired robotics)
- Challenges and opportunities in robotics research and development
- Implications and ethical considerations for the future of robotics
Lab Work
Unit 1: Advanced Architecture and Capabilities of Social Robots (2 hours of class work)
- Objective: Introduce students to the advanced architecture, AI integration, and real-time monitoring capabilities of modern social robots like Nao, Pepper, and Furhat.
- Advanced Architecture of Nao and Pepper Robots Introduction to new hardware components and enhancements. Discussion on improved AI processors and sensors.
- Advanced Architecture of Furhat Robots Exploration of enhanced face tracking and expression rendering technologies.
- Enhanced Software Settings for Nao and Pepper Robots Overview of updated software environments, including integration with advanced AI frameworks.
- Enhanced Software Settings for Furhat Robots Customization options for facial expressions and conversational nuances.
- Real-Time Monitoring and Remote Control Techniques for remote monitoring and control using cloud-based solutions and real-time analytics.
- Specialized Libraries and APIs Introduction to new specialized libraries and APIs for advanced functionality.
Unit 2: Integrating AI Models with Choregraphe and Pepper SDK (2 hours of class work and 5 hours of individual work)
- Objective: Develop skills in integrating AI models with Choregraphe for Nao and Pepper, leveraging tools like ChatGPT and machine learning libraries.
- User Interface in Choregraphe Navigating the interface with AI extensions.
- Object Boxes and AI Integration Creating and editing boxes with embedded AI functionality.
- Creating Behaviors with AI Models Implementing behaviors using AI models for decision-making.
- Application Development and Testing Developing and testing applications with integrated AI components.
Unit 3: Advanced Python Programming with AI Integration (2 hours of class work and 5 hours of individual work)
- Objective: Utilize Python to develop complex applications that integrate advanced AI models for Nao and Pepper robots.
- Creating Code in Python Boxes with AI Integration Incorporating ChatGPT and other AI models into Python code.
- Creating an AI-Powered App from Scratch End-to-end development of an AI-powered application.
Unit 4: Developing Advanced Applications via API and Machine Learning (2 hours of class work and 5 hours of individual work)
- Objective: Explore API-based development and machine learning applications for robots, focusing on advanced interaction capabilities.
- Client-Server Applications with AI Features Developing applications with server-side AI processing.
- Environment Perception with Machine Learning Using machine learning for real-time environment analysis.
- Creating Custom Functions and Modules Extending robot capabilities with custom AI-powered functions.
Unit 5: Advanced Interactive Dialogs using QiChat and AI Models (2 hours of class work and 5 hours of individual work)
- Objective: Enhance robot-human interaction through advanced dialogue systems incorporating AI models like ChatGPT.
- QiChat with AI Enhancements Integrating ChatGPT for natural language processing.
- Advanced Dialogue Flow Design Creating complex dialogue systems for dynamic interactions.
Unit 6: Designing Interactive Applications with Pepper SDK and AI Tools (2 hours class work and 5 hours of individual work)
- Objective: Create applications that utilize Pepper’s full capabilities, including AI-driven features and cloud-based interactions.
- Installing and Setting Up Advanced SDKs Using Android and Python SDKs with AI integrations.
- Developing AI-Enhanced Robot Applications Implementing applications that leverage Pepper’s sensors and AI for interactive experiences.
Unit 7: Developing Autonomous and Intelligent Applications with Pepper (2 hours of class work and 5 hours of individual work)
- Objective: Create advanced, autonomous applications for Pepper, focusing on AI-driven behaviors and decision-making.
- Preparing Advanced Tools and AI Frameworks Setting up tools for deep learning and autonomous decision-making.
- Creating Autonomous Applications Developing applications that utilize AI for autonomous actions and responses.
Alternative work
Project A: Designing a Smart Chatbot with Advanced NLP (20 hours of individual work)
- Objective: Build a sophisticated chatbot using Python, ChatGPT, and the RASA framework, designed to assist in complex scenarios.
- Advanced Introduction to Chatbots and NLP Exploring the latest NLP advancements and their applications.
- Implementing Advanced NLP Techniques Utilizing deep learning models for nuanced chatbot responses.
- Integrating AI and Machine Learning Models Enhancing chatbot capabilities with AI-driven insights.
Supplementary work (optional)
Project B: Creating an Interactive Training Application with Furhat Robot (8 hours of additional teamwork in the lab)
- Objective: Develop a training application for new employees using the Furhat robot, incorporating AI for adaptive and personalized training.
- Advanced Use of Furhat’s Conversational Interface Customizing interactions and feedback mechanisms using AI.
- Creating an Adaptive Training Program Using AI to tailor the training experience based on user feedback.
Supporting Infrastructure
To run the activity for this course unit, students will have the possibility to work in our labs with the following technologies:
- Several Aldebaran technologies (4 Nao Robots, 2 Pepper robots)
- Furhat robot
- Computers to run various programming languages
- Industrial robots connected to the cloud with video perception (ABB, Kuka, Dobo Magician)
- Autonomous mobile platforms
Trackbacks/Pingbacks