Ian Chen

Ian Chen

Undergraduate

Reinforcement Learning

less than 1 minute read

Published:

Over a year ago now, I took some notes on reinforcement learning from a series of lectures availabe on YouTube. They can be found here.

You May Also Enjoy

2026 July Mindbenders

10 minute read

Published:

If you roll six dice, you could get the same number on every die, or (in contrast) all different numbers. What is the probability of getting exactly four distinct numbers? source.

Cycle Analysis

10 minute read

Published:

Consider an infinitely long sequence of coin flips, i.e. with \(p\) probability heads and \(1-p\) probability tails. You get points for non-overlapping pairs of consecutive heads. How many points do you expect to obtain per flip? That is, what is the limit for the ratio of the number of points over number of flips?

2026 January Momath Mindbender

3 minute read

Published:

Puzzle from here. Consider a ladybug starting on the 12-hand of the clock. During each timestep, it will choose to walk either counterclockwise or clockwise, each with 50% probability. What is the probability that the last new number it visits is 6?