MDPs: Markov Decision Processes Decision Making Under Uncertainty using POMDPsjl

Course Feature
  • Cost
    Free
  • Provider
    Youtube
  • Certificate
    Paid Certification
  • Language
    English
  • Start Date
    On-Demand
  • Learners
    No Information
  • Duration
    1.00
  • Instructor
    The Julia Programming Language
Next Course
3.0
0 Ratings
This course introduces Markov Decision Processes (MDPs) and Decision Making Under Uncertainty using POMDPs.jl. It covers topics such as MDP definition, Grid World environment, state and action spaces, transition and reward functions, discount factor, QuickPOMDPs, MDP and RL solvers, and a Pluto notebook. Students will gain an understanding of how to use MDPs to make decisions under uncertainty.
Show All
Course Overview

❗The content presented here is sourced directly from Youtube platform. For comprehensive course details, including enrollment information, simply click on the 'Go to class' link on our website.

Updated in [February 21st, 2023]


Intro.
MDP definition.
Grid World.
State space.
Action space.
Transition function.
Reward function.
Discount factor.
QuickPOMDPs.
MDP solvers.
RL solvers.
Pluto notebook.
Grid World environment.
Grid World actions.
Grid World transitions.
Grid World rewards.
Grid World discount.
Grid World termination.
Grid World MDP.
Solutions (offline).
Value iteration.
Transition probability distribution.
Using the policy.
Visualizations.
Reinforcement learning.
TD learning.
Q-learning.
SARSA.
Solutions (online).
MCTS.
MCTS visualization.
Simulations.
Extras.
References.

(Please note that we obtained the following content based on information that users may want to know, such as skills, applicable scenarios, future development, etc., combined with AI tools, and have been manually reviewed)
This course provides an introduction to Markov Decision Processes (MDPs) and Partially Observable Markov Decision Processes (POMDPs), which are powerful tools for decision making under uncertainty. It covers the fundamentals of MDPs, including definitions, grid world environments, state and action spaces, transition and reward functions, and discount factors. It also covers MDP solvers, RL solvers, and Pluto notebooks.
Possible Development Paths include data science, machine learning, artificial intelligence, robotics, and computer science.
Learning Suggestions for learners include studying related topics such as probability theory, linear algebra, calculus, and optimization. Additionally, learners should practice coding and implementing algorithms in Python or other programming languages. They should also explore different reinforcement learning algorithms and apply them to different problems.

Show All
Recommended Courses
free data-wrangling-techniques-in-julia-part-2-tom-kwong-9836
Data Wrangling Techniques in Julia - Part 2 Tom Kwong
3.0
Youtube 0 learners
Learn More
This video, presented by Tom Kwong, is the second part of a series on data wrangling techniques in Julia. It covers two data sets: the Washington state youth suicide data set and the TIPS yield curve and inflation compensation data set. Tom provides helpful tips and techniques for working with these data sets, and encourages viewers to contribute to the accompanying GitHub repo.
julia-getting-started-9837
Julia: Getting Started
2.5
Pluralsight 0 learners
Learn More
This course provides an introduction to the Julia programming language, covering the fundamentals needed to begin developing applications for Data Science, scientific domains, data visualization, parallel computing, and more.
julia-1-fundamentals-9838
Julia 1 Fundamentals
1.5
Pluralsight 0 learners
Learn More
This course introduces the fundamentals of Julia, a high-performance programming language with a focus on productivity. Learn how to write your own Julia applications and take advantage of its unique combination of speed and ease of use.
introduction-to-julia-9839
Introduction to Julia
2.0
ThaiMOOC 0 learners
Learn More
Julia is a high-level, high-performance programming language designed for scientific computing, machine learning, and data mining. It offers a unique combination of ease-of-use and performance, making it an ideal choice for developers and data scientists.
Favorites (0)
Favorites
0 favorite option

You have no favorites

Name delet