In this talk, I will give an overview on existing results in the automata/verification community concerning the control of probabilistic systems under partial observation. This includes probabilistic automata (over finite or infinite words), optimal strategies for unbounded horizon objectives in POMDP, and more. I will then list several possible research directions in this area.