http://aofa.cs.princeton.edu/home/ This is the book by the lecturer of these videos. The book chapters are in line with the lecture videos. In the book's website, you will find exercises in each chapter sections. You will also find lecture slides on each topics on the booksite.