The identified problems at the third year students of Study Program in English Language Education at Almuslim University were (1) The teacher’s technique was inefficient in improving listening skill (2) The listening materials were not interesting (3) The students had low ability in writing the information from the conversation audio (4) The students had low motivation in learning listening. Based on the problems, the research questions were formulated: (1) How is the teacher’s performance in implementing note taking technique in improving students’ listening skill at the third year students of Study Program in English Language Education at Almuslim University? (2) How effective is note taking technique in improving students’ listening skill? (3) How do the students respond toward the implementation of note taking technique? Note taking technique was applied to improve the students’ listening skill. This research was a classroom action research and was done in two cycles. The procedure of the research consists of planning the action, implementing the action, observing the action and reflection. The instruments used in collecting the data were test, observation sheet and questionnaire. The result of the research showed that the implementation of note taking technique was effective in improving the students’ listening skill. It could be proved by the result of the tests, the students’ mean score of pre-test was 62.5 and it increased to be 72 in cycle 1. At the end of the second cycle, the mean score reached 77.4. Furthermore, the result of the observation checklist indicated that the percentage of the students’ participation in the teaching and learning process increased. It could be seen that the percentage of the students’ involvement was 70.7 in the first cycle. It increased up to 95.7 in the second cycle. It means that the note taking technique was successfully implemented in listening class. Whereas the teacher’s performance improved as well. It could be seen that score percentage of teacher’s performance was 72.3% in the first cycle and it reached 97.1% in the second cycle. Moreover, based on the result of the questionnaire, it shows that the students responded positively toward the implementation of note taking technique. Thus, based on the research findings, it is suggested that other researchers and teachers who have problems in their teaching listening should try to implement this technique. Besides, it might help to overcome the problems encountered by teachers as well as students particularly in listening class.