Yelin Kim


Ph.D. Candidate
Department of Electrical Engineering and Computer Science
University of Michigan, Ann Arbor

Email: yelinkim at umich dot edu
LinkedIn: www.linkedin.com/in/yelinkim
Google Scholar Entry: Yelin Kim


Bio

Yelin Kim is a Ph.D. candidate in the Computational Human-Centered Analysis and Integration Laboratory at the University of Michigan, Ann Arbor, working with Professor Emily Mower Provost since 2012. She received her B.S. in Electrical and Computer Engineering from Seoul National University, South Korea in 2011, and her M.S. in Electrical Engineering-Systems from the University of Michigan, Ann Arbor in 2013. During the summer of 2014, she interned with the Computer Vision Lab at GE Global Research, NY, developing an automatic video segmentation and human action recognition system (Mentors: Dr. Jixu Chen and Dr. Peter Tu). During her undergraduate studies, she has interned at Infosys Technologies Ltd., India, developing an assisted healthcare system for children in rural India (Mentor: Dr. Anutosh Maitra). Yelin has been awarded several best paper/poster awards and fellowships, including the Best Student Paper Award (selected among total 679 submissions) at the ACM International Conference on Multimedia (ACM MM) in 2014, Korean Government Scholarship for Study Abroad in 2011-2013, and Qualcomm Scholarship in 2011.

Her research interests are in computational human behavior analysis and affective computing by utilizing multimodal (speech and video) signal processing, and machine learning techniques. She computationally measures, represents, and analyzes human behavior data (vocal and facial expressions, body gestures, etc.) to illuminate fundamental human behavior and emotion perception, and develop natural human-machine interfaces.

Areas of Interest

Human behavioral signal processing, affective computing, machine learning, multimodal signal processing, artificial intelligence, computer vision

News

[July 2015] Invited journal paper, entitled "Emotion Recognition During Speech Using Dynamics of Multiple Regions of the Face," is accepted to ACM Transactions on Multimedia Computing Communications and Applications (TOMM).
[July 2015] Paper, entitled "Exploring Sources of Variation in Human Behavioral Data: Towards Automatic Audio-Visual Emotion Recognition," is accepted to ACII 2015 Doctoral Consortium.
[July 2015] Reviewer for ACM International Conference on Multimodal Interaction (ACM ICMI).
[June 2015] Paper, entitled "Leveraging Inter-rater Agreement for Audio-Visual Emotion Recognition," is accepted to ACII 2015.
[June 2015] Reviewer for ACM International Conference on Multimedia (ACM MM).
[February 2015] Paper, entitled "Exploring Affective and Social Cues in Multimedia Content," is accepted to IEEE FG Doctoral Consortium 2015.
[January 2015] Paper from my summer internship at GE Global Research is accepted to IEEE FG 2015 (Oral Presentation).
[January 2015] Talk at my alma mater, Seoul National University, about my work on audio-visual emotion recognition.
[December 2014] Reviewer for IEEE Transactions on Affective Computing (TAC).
[November 2014] Winner of the Best Student Paper Award at the ACM Multimedia this year for the paper "Say Cheese vs. Smile: Reducing Speech-Related Variability for Facial Emotion Recognition," co-authored with my advisor, Prof. Emily Mower Provost. [News link]

Publications

Journal Publications

[7] Yelin Kim and Emily Mower Provost. "Emotion Recognition During Speech Using Dynamics of Multiple Regions of the Face." ACM Transactions on Multimedia Computing, Communications and Applications (ACM TOMM), Special Issue on ACM Multimedia Best Papers, 2015. Invited Journal. [To Appear]

Peer-Reviewed Conference Publications

[6] Yelin Kim and Emily Mower Provost. "Leveraging Inter-rater Agreement for Audio-Visual Emotion Recognition." Proc. of International Conference on Affective Computing and Intelligent Interaction (ACII), Xi'an, China, September, 2015. [To Appear]

[5] Yelin Kim. "Exploring Sources of Variation in Human Behavioral Data: Towards Automatic Audio-Visual Emotion Recognition." Proc. of International Conference on Affective Computing and Intelligent Interaction (ACII) Doctoral Consortium, Xi'an, China, September, 2015. [To Appear]

[4] Yelin Kim, Jixu Chen, Ming-Ching Chang, Xin Wang, Emily Mower Provost, and Siwei Lyu. "Modeling Transition Patterns Between Events for Temporal Human Action Segmentation and Classification." IEEE International Conference on Automatic Face and Gesture Recognition (FG 2015), Ljubljana, Slovenia, May, 2015. [paper][bib] (Acceptance rate: 12%)

[3] Yelin Kim and Emily Mower Provost. "Say Cheese vs. Smile: Reducing Speech-Related Variability for Facial Emotion Recognition." Proceedings of the ACM International Conference on Multimedia (ACM MM'14). Florida, USA, November, 2014 (Winner, Best Student Paper Award) [paper][bib][slides (pdf)][presentation-coming soon!] (Acceptance rate: 19%)

[2] Yelin Kim, Honglak Lee, and Emily Mower Provost. "Deep Learning for Robust Feature Generation in Audio-Visual Emotion Recognition." IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Vancouver, British Columbia, Canada. May, 2013. [paper][bib][poster]

[1] Yelin Kim and Emily Mower Provost. "Emotion Classification via Utterance-Level Dynamics: A Pattern-Based Approach to Characterizing Affective Expressions." IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Vancouver, British Columbia, Canada. May, 2013. [paper][bib][poster]

Awards and Honors

Paper and Poster Presentation Awards

Best Student Paper Award, ACM International Conference on Multimedia (ACM MM), 2014 [Note: selected among total 679 submissions]
Best Technical Poster Award, The 10th Korean-American Scientists and Engineers Association (KSEA) Young Generation Technical and Leadership Conference, 2014 [Note: 1st place]
Best Poster Award, Engineering Graduate Symposium, University of Michigan, 2013 [Note: 1st place]

Grants and Fellowships

Conference Travel Grants from NSF (2015), CRA-W (2014, 2015), Rackham Graduate School at the University of Michigan (2013, 2014), Computer Science and Engineering Department at the University of Michigan (2013)
Korean Government Scholarship for Study Abroad, 2011-2013
Qualcomm Scholarship, 2011
Korea National Science Scholarship, 2007-2011
Seoul National University Engineering Women Fellowship, 2010
Temasek Foundation-Singapore Management University Leadership Enrichment and Regional Networking Scholarship, 2010
The National Academy of Engineering of Korea: Young Engineers Honor Society, 2009

Teaching

Graduate Student Instructor, EECS 301: Probabilistic Methods in Engineering, University of Michigan, Winter Semester 2015. [Recognized for Excellent Performance in Teaching from the EECS Department (student evaluation: 4.8/5.0)]
Graduate Student Instructor, EECS 451: Digital Signal Processing, University of Michigan, Fall Semester 2014.
Guest Lecturer, EECS 498: Intelligent Interactive Systems, University of Michigan, February 2014.
Guest Lecturer, EECS 498: Human-Centered Computing, University of Michigan, March, 2013.

Talks

Oral Presentation, IEEE International Conference on Automatic Face and Gesture Recognition (FG 2015), Ljubljana, Slovenia, May, 2015.
Doctoral Consortium: Research Proposal, IEEE International Conference on Automatic Face and Gesture Recognition (FG 2015), Ljubljana, Slovenia, May, 2015.
Invited Talk, Signal Processing Systems Lab, Seoul National University, Seoul, South Korea, January, 2015.
Best Paper Session Oral Presentation, The 22nd ACM International Conference on Multimedia (ACM MM), Orlando, Florida, November, 2014. [Note: Winner, Best Student Paper Award]
Lightning Talk, the Society of Women Engineers First Annual Leaders in Engineering Summit, University of Michigan, March, 2014.
Poster Presentation, The 10th Korean-American Scientists and Engineers Association (KSEA) Young Generation Technical and Leadership Conference, Houston, Texas, January, 2014. [Note: Winner, Best Technical Poster Award]
Poster Presentation, Engineering Graduate Symposium, University of Michigan, November, 2013. [Note: Winner, Best Poster Award]
Panelist, College of Engineering New Graduate Student Welcome, University of Michigan, August, 2013.
Poster Presentation, IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). Vancouver, British Columbia, Canada. May, 2013.
Panelist, EECS Faculty/Grad/Alum Panel Event, hosted by student groups IEEE/ACM and gEECS (Girls in EECS), University of Michigan, March, 2013.
Poster Presentation, Engineering Graduate Symposium, University of Michigan, November, 2012.
Panelist, CSE tour for Tech Day, University of Michigan, September, 2012.

Relevant Coursework

Machine Learning
Computer Vision
Probabilistic Graphical Models
Convex Optimization
Stochastic Processes
Information Theory
Estimation, Filtering and Detection
Machine Learning Applications in Human-Centered Computing
Mathematical Methods for Signal Processing
Digital Signal Processing

Activities

Reviewer, IEEE Transactions on Affective Computing (2014-Present), ACM International Conference on Multimedia (2015-Present), ACM International Conference on Multimodal Interaction (2015-Present)
Member, ACM SIGMM (2014-Present)
Student Member, IEEE (2013-Present)
Vice President, Korean Student Association - Graduate, University of Michigan (2013-2014)
Department Representative, CoE Graduate Student Advisory Committee, University of Michigan (2013-2014)
Second Prize Winner, Infosys Business Case Competition (2010)

Contact

3945 Computer Science and Engineering Building, University of Michigan, 2260 Hayward Street, Ann Arbor, MI 48109-2121
Email: yelinkim at umich dot edu

Others


Last updated July 27th, 2015