Skip to main content
European Commission logo print header

Efficient sequential decision making under uncertainty


"Many applications require efficient methods for automated decision making, such as control systems, crisis response, finance, logistics, network security, robotics and traffic management. These problems involve sequential learning and decision making under uncertainty in an unknown environment. As we have incomplete information about the state and dynamics of the environment, the outcome of any specific plan is uncertain. Statistical decision theory offers a framework for finding optimal solutions, but in most problems of interest exact inference and planning are intractable.

The project will develop efficient approximate methods for nearly optimal learning and decision making in such problems. Our first goal is to obtain provably efficient algorithms for decision making in discrete, fully observable environments. Our second goal is to extend these to continuous and partially observable domains. Recent advances in statistical learning theory and in stochastic planning, make this avenue of research particularly promising. Our third theoretical goal is to consider collaborative planning among multiple agents in unknown environments for each of the above cases.

Finally, we shall develop open source code and perform extensive comparative experiments in classical benchmark problems for evaluation purposes. As a more realistic test-bed, we shall focus on the network intrusion detection and response problem, where we must safeguard a network against the attacks of malicious users.

The project coordinator is an expert on Bayesian reinforcement learning and stochastic planning and the host institution has produced seminal breakthroughs in the area of distributed planning, while both have prior experience in problems of network intrusion detection."

Invito a presentare proposte

Vedi altri progetti per questo bando



Batiment ce 3316 station 1
1015 Lausanne

Mostra sulla mappa

Schweiz/Suisse/Svizzera Région lémanique Vaud
Tipo di attività
Higher or Secondary Education Establishments
Contatto amministrativo
Boi Faltings (Prof.)
Contributo UE
Nessun dato