Every country I see are using mainly 2 tactics to curb this COVID-19 epidemic. Lock-down & Contact Tracing App. Singapore has launched their own version of Contact Tracing App called TraceTogether which according to them took 40 engineers almost 10,000 man-hours to develop. So I thought, okay anyway I have…

We have a ball, which moves to a random position in the screen when clicked and also changes its color. Lets divide that into steps: First we need to build the ball. Next we need to move the ball to a new position when pressed on it. Finally, we have…

Or is it really that simple? So I was working on a project where I needed to implement a simple stopwatch to let the user know about the time interval spent doing a particular task. Okay, how difficult will that be right? …

By asking myself just one simple question Lets Face it we don’t need focus all the time. I don’t need to be focused all damn day. …

The Problem: Given a gold mine of n*m dimensions. Each field in this mine contains a positive integer which is the amount of gold in tons. Initially the miner is at first column but can be at any row. He can move only (right, right up ,right down) that is from a given cell, the miner can move to the cell diagonally up towards the right or right or diagonally down towards the right. Find out maximum amount of gold he can collect. (source: geeksforgeeks.org)

So I was trying to learn about Reinforcement Learning, and then I came across this thing called ‘Value Iteration’. I really couldn’t wrap my head around Value Iteration. It was very difficult for me to understand how it worked and how it could help an agent to find the optimal…

Coding the GridWorld Example from DeepMind’s Reinforcement Learning Course in Python Here I calculate the state value functions for all states in the GridWorld example from the well renowned David Silver’s Reinforcement Learning Course.