Autonomous Networking

Course objectives

General goals: The course will make students aware of the challenges behind the design, implementation and field use of autonomous networking systems. The course will present both the theoretical foundations and practical aspects you need to know to develop such systems. Specific goals: The combination of many heterogeneous connected devices, including fast moving devices, and advanced communication capabilities that enable real-time interactions is leading to the creation of systems on a scale and/or complexity level that is beyond the ability of humans to fully comprehend and control. Management and operation of these networking systems require an extremely high degree of intelligent automation. Goal of this course is to provide knowledge about the main network-related technologies whose interplay will be responsible for making networking systems autonomous. These technologies, mainly based on reinforcement learning (RL), allow systems react to what is occurring in their environment and respond accordingly. Knowledge and comprehension: At the end of the course students will have knowledge on the technologies and methodologies to design autonomous networks. Specifically, the course will focus on communication and networking issues of autonomous networks and possible solutions. Applying knowledge and understanding: The course will provide students the tools to understand when and how learning techniques can be applied to make a system adaptive and autonomous Critiquing and judgmental skills: Students will acquire the skills to review and analyse the design of autonomous networks. Communication skills: Students will acquire the skills to analyse and present scientific papers and research directions with proper language.

Channel 1
GAIA MASELLI Lecturers' profile

Program - Frequency - Exams

Course program
The course includes three parts: 1) terrestrial and aerial sensor networks, IoT networks, MAC and routing protocol for sensor networks (20 hours) 2) Reinforcement learning: - Multi-armed bandits (10 hours) - Markov Decision Processes (10 hours) - Q-learning (10 hours) 3) MAC and routing protocols for sensor networks based on reinforcement learning.
Prerequisites
Computer Networks
Books
Reinforcement Learning: An Introduction, Richard S. Sutton and Andrew G. Barto, Second Edition MIT Press, Cambridge, MA, 2018
Teaching mode
The course typically takes place in presence. In the event of a COVID emergency, it can be done remotely or blended.
Frequency
Attendance is strongly recommended.
Exam mode
The exam takes place with a written test, with both multiple choice and open questions. There might be homeworks with partial grade.
Bibliography
Scientific papers indicated during the course.
Lesson mode
The course typically takes place in presence. In the event of a COVID emergency, it can be done remotely or blended.
GAIA MASELLI Lecturers' profile

Program - Frequency - Exams

Course program
The course includes three parts: 1) terrestrial and aerial sensor networks, IoT networks, MAC and routing protocol for sensor networks (20 hours) 2) Reinforcement learning: - Multi-armed bandits (10 hours) - Markov Decision Processes (10 hours) - Q-learning (10 hours) 3) MAC and routing protocols for sensor networks based on reinforcement learning.
Prerequisites
Computer Networks
Books
Reinforcement Learning: An Introduction, Richard S. Sutton and Andrew G. Barto, Second Edition MIT Press, Cambridge, MA, 2018
Teaching mode
The course typically takes place in presence. In the event of a COVID emergency, it can be done remotely or blended.
Frequency
Attendance is strongly recommended.
Exam mode
The exam takes place with a written test, with both multiple choice and open questions. There might be homeworks with partial grade.
Bibliography
Scientific papers indicated during the course.
Lesson mode
The course typically takes place in presence. In the event of a COVID emergency, it can be done remotely or blended.
  • Lesson code10596281
  • Academic year2025/2026
  • CourseComputer Science
  • CurriculumSingle curriculum
  • Year2nd year
  • Semester1st semester
  • SSDINF/01
  • CFU6