The modern development of the mathematics of dynamical systems has been led by computer experiments since the 1950’s. Yet the theoretical challenges of modeling dynamics on a computer have started coming into focus only recently. Asking and answering the right questions on what can and cannot be modeled numerically leads to a beautiful synthesis between dynamics and theoretical computer science. I will try to give a survey of some of the directions of study and principal challenges.