Técnicas Avanzadas de Inteligencia Artificial26225
- Centro
- Facultad de Informática
- Titulación
- Grado en Inteligencia Artificial
- Curso académico
- 2023/24
- Curso
- 4
- Nº Créditos
- 6
- Idiomas
- Inglés
- Código
- 26225
DocenciaAlternar navegación
Guía docenteAlternar navegación
Descripción y Contextualización de la AsignaturaAlternar navegación
AVISO: LA ASIGNATURA SOLO SE OFERTA EN INGLÉS, POR LO QUE SÓLO HAY DISPONIBLE DOCUMENTACIÓN ACTUALIZADA EN ESTA LENGUA.
The main objective of this course is to learn how Reinforcement Learning (RL) solutions help solve real-world problems through trial-and-error interaction by implementing a complete RL solution from beginning to end.
In order to take the course without excessive difficulty, it is recommended to have previously acquired the following skills:
• Python: Basic knowledge
• Programming level: Data structures and algorithms
• Statistics: Conditional probability
• Machine Learning: Basic knowledge of supervised classification and neural networks
It is also recommended to have taken or be taking the Deep Learning subject.
Competencias/ Resultados de aprendizaje de la asignaturaAlternar navegación
This course provides the basic concepts of reinforcement learning. It gives students a detailed understanding of various topics: Markov Decision Processes, sample-based learning algorithms and deep reinforcement learning.
Contenidos teórico-prácticosAlternar navegación
Topic 1 Introduction to the course
Topic 2 Introduction to Reinforcement Learning: definition of basic concepts such as Markov Decision Proccess and Value Functions
Topic 3 Dynamic Programming: methods to solve the problem when the model is known: policy iteration and value iteration methods
Topic 4 Monte Carlo Methods: methods to solve the problem learning from simulated experiences.
Topic 5 Temporal-Difference Learning: combination of Dynamic Programming and Monte-Carlo: SARSA, Q-Learning and variants
Topic 6 Deep Reinforcement Learning: Function approximation, Batch Learning, Deep Q-Network and Rainbow (combination of several improvements in Deep Reinforcement Learning)
MetodologíaAlternar navegación
Master classes, seminars, laboratories, assignments, practices and presentations.
The skills and competences demonstrated in all aspects of the subject make up your note: active participation, tasks, practice, presentations, etc.
Sistemas de evaluaciónAlternar navegación
- Sistema de Evaluación Final
- Herramientas y porcentajes de calificación:
- The skills and competences demonstrated in all aspects of the subject make up their note: active participation, individual tasks, group practices, presentations, etc. (%): 100
Convocatoria Ordinaria: Orientaciones y RenunciaAlternar navegación
The subject has two possible evaluation modes: final and continuous.
The continuous evaluation is the preferred mode. It establishes a set of activities that allows assessing the progress of each student throughout the course. Thus, the continuous evaluation is offered by default to students who should deliver the assignments of the subject in the established framework including assistance, presentations and face-to-face activities.
Students can also be evaluated through the final evaluation mode. In this case, the students on established dates (when reaching around 60% and 80% of the course) must submit to the teaching supervisors a formal resignation to the continuous evaluation. Then, the teaching supervisors will assign a mandatory practical work and a date for an oral presentation prior to the date indicated for ordinary and extraordinary examination.
The weight of the different aspects to consider in the two alternative forms of evaluation is presented below.
Continuous Evaluation
• 3 obligatory assignments (100%), 40% of the mark must be obtained in each one in order to pass subject
◦ Individual Multiple Choice Exam: 40%
◦ Oral presentation in group (3-4 people) about a Reinforcement Learning applied paper: 30%
◦ Practical work in group (3-4 people): 30%
Final Evaluation
Delivery of mandatory practical work and oral presentation prior to the written exam on the date indicated for the ordinary and extraordinary examination: 100%
Convocatoria Extraordinaria: Orientaciones y RenunciaAlternar navegación
Final Evaluation
Delivery of mandatory practical work and oral presentation prior to the written exam on the date indicated for the ordinary and extraordinary examination: 100%
Materiales de uso obligatorioAlternar navegación
• eGela
• Google Colab
BibliografíaAlternar navegación
Bibliografía básica
Richard S. Sutton and Andrew G. Barto. Reinforcement Learning: An Introduction 2nd Edition, 2018
Bibliografía de profundización
Maxim Lapan. Deep Reinforcement Learning Hands-on. Packt Publishing Ltd., 2nd edition, 2020.
Direcciones web
Artificial Intelligence. Elsevier Science.
GruposAlternar navegación
61 Teórico (Inglés - Mañana)Mostrar/ocultar subpáginas
Semanas | Lunes | Martes | Miércoles | Jueves | Viernes |
---|---|---|---|---|---|
1-15 | 10:30-12:00 (1) | 09:00-10:30 (2) |
Profesorado
61 P. Laboratorio-1 (Inglés - Mañana)Mostrar/ocultar subpáginas
Semanas | Lunes | Martes | Miércoles | Jueves | Viernes |
---|---|---|---|---|---|
1-15 | 12:00-13:30 (1) |
Profesorado
61 P. Laboratorio-2 (Inglés - Mañana)Mostrar/ocultar subpáginas
Semanas | Lunes | Martes | Miércoles | Jueves | Viernes |
---|---|---|---|---|---|
1-15 | 09:00-10:30 (1) |