New(s)

01/2019: Instructor for EECS 493

I'm an Instructor of Record for EECS 493: User Interface Development for the Winter 2019 semester!


11/2018: UMich CSE Graduate Honors Competition finalist

I was the "Interactive Systems" representative for this year's honors competition! I talked about my work in creating robust, reliable, and deployable systems by leveraging crowdsourcing to create new training processes in order to solve real-world problems. Click here for a press article covering this event.


09/2018: Workshop paper at CSCW

Our submission entitled "Challenges in Making Situated Interactions Accessible to Motor-Impaired Users" got accepted to the Accessible Voice Interfaces Workshop at CSCW 2018!


04/2018: Paper at HCOMP

Our submission entitled "EURECA: Enhanced Understanding of Real Environments via Crowd Assistance" has been accepted at HCOMP 2018!

Publications

Conference

HCOMP / Zurich, Switzerland / July 2018

EURECA: Enhanced Understanding of Real Environments via Crowd Assistance

Sai R. Gouravajhala, Jinyeong Yim, Karthik Desingh, Yanda Huang, Odest Chadwicke Jenkins, Walter S. Lasecki

[ Collaboration with the Lab for PROGRESS here at Michigan! :) ]

PDF

Collective Intelligence (CI) / Zurich, Switzerland / July 2018

Finding Mnemo: Hybrid Intelligence Memory in a Crowd-Powered Dialog System

Sai R. Gouravajhala, Youxuan Jiang, Preetraj Kaur, Jarir Chaar, Walter S. Lasecki

[ Collaboration with IBM Research ]

PDF

Collective Intelligence (CI) / New York City, NY, USA / June 2017

Towards Hybrid Intelligence for Robotics

Sai R. Gouravajhala, Jean Young Song, Jinyeong Yim, Raymond Fok, Yanda Huang, Fan Yang, Kyle Wang, Yilei An, Walter S. Lasecki

PDF

Preprint / arXiv

arXiv preprint / Online / Oct 2018

Analyzing Assumptions in Conversation Disentanglement Research Through the Lens of a New Dataset and Model

Jonathan K. Kummerfeld, Sai R. Gouravajhala, Joseph Peper, Chulaka Gunasekara, Jatin Ganhotra, Siva Sankalp Patel, Lazaros Polymenakos, Walter S. Lasecki

[ Collaboration with IBM Research ]

PDF

Workshop

Accessible Voice Interfaces / CSCW / Jersey City, NJ, USA / Nov 2018

Challenges in Making Situated Interactions Accessible to Motor-Impaired Users

Sai R. Gouravajhala, Harmanpreet Kaur, Raymond Fok, Walter S. Lasecki

PDF

Human-Centered Machine Learning (HCML) / CHI / Denver, CO, USA / May 2016

Towards Crowd-Assisted Data Mining

Sai R. Gouravajhala, Danai Koutra, Walter S. Lasecki

PDF

Current Projects

Generalized Object Recognition for Robots

Automated computer vision approaches to detecting objects in a scene require lots of training data; however, these automated approaches can often fail in real-world settings since objects can be occluded, broken, deformed, or in different configurations than those that were used to train the classifiers.

Our goal in this project is to go from limited knowledge about how an object can be in different configurations to an expanded knowledge---all from non-expert crowd worker manipulations of initial object configurations.

EURECA

How can we create reliable and more robust robot perception (3D vision)? We introduce EURECA, a web-based, mixed-initiative, collaborative annotation tool. EURECA lets groups of people (such as crowds on the internet) collectively ground natural language references to objects in 3D scenes in real time.

Our approach requires no prior human or machine training and can in fact generate training data. We target settings where automated systems will have already failed, so this approach is still complementary to existing CV approaches if we have access to preprocessed clusters, labels, etc. The ultimate goal is to help robots “see” their environments better.

Collective Crowd Memory

Crowd-powered conversational systems---in which ever-changing groups of remote human workers collectively hold a conversation with end users---can help bootstrap automated dialog systems by generating training data in real scenarios and succeed where well-trained automated approaches fail. However, since no one worker is present during all sessions, these systems fail to remember all relevant information from interactions that span multiple sessions, leading over time to the loss of conversational context.

We introduce Mnemo, a crowd-powered dialog system plug-in that uses collective processes and automated support to maintain a “collective crowd memory” of user conversations through crowd-generated facts, which workers predict would be important when a similar topic is again discussed in the future by a given user.

LegionTools

LegionTools (LT) is a software tool that allows users to easily recruit and route Amazon Mechanical Turk workers for synchronous realtime crowdsourcing tasks. It was first developed by researchers from HCI at the University of Rochester and is now being maintained by researchers from the Crowds + Machines (CROMA) Lab at the University of Michigan.

LegionTools makes it easier for researchers (and other users) to interface with Amazon Mechanical Turk for their crowdsourcing tasks. LT allows users to create HITs with richer options, as well as makes it easier to keep track of posted HITs, bonus payments, etc. LT also enables real time crowdsourcing applications to interface with AMT and takes care of recruiting, retaining, and routing workers to specific tasks.

Click HERE for more details!