Emotion is an essential part of user experience. While researchers are striving for new research tools for evaluate emotional experiences in design, designers have been using experience-based tools for studying emotions in practice, such as mood boards. Mood boards were developed for communicating emotional qualities between designers and clients, but have not yet been considered as an evaluation tool for investigating emotional experience. In this study we examined whether design students and non-design students have similar criteria in evaluating these mood boards. The results showed that the inter-rater reliability among all participants were considerably high, which suggested that mood boards are potential to be used as an evaluation tool for research on emotion.