With the development of video coding and broadband network delivery, students can learn by lecture videos through the Internet without attending the class. However, watching lecture videos alone would be boring and make the self-paced learning difficult and inefficient, since students could not be monitored by the teacher and accompanied by classmates. In this paper, we propose an adaptive video learning system to motivate students and grab their attention by inserting the interactive e-partner into the lecture videos. The e-partner's behavior would evolve and animate with the student's learning style and the lecturer's teaching behavior, so that students can be encouraged to focus on the lecture content and enjoy the self-paced learning at the same time. The experimental results show that the augmented lecture video produced by our proposed system could improve the students' viewing experience to the original lecture video. Moreover, watching the produced lecture video may be more attractive than seeing the lecture content in class.