Fundamental concepts and mathematical frameworks for scientific sequential decision making in the presence of uncertainty. Utility theory, uncertainty modeling, theory of games, dynamic programming, and multi-agent system. Discussion of how the decision theories can be applied to design algorithms and processes for real-world cases.