https://jinjoolee.com/about/https://jinjoolee.com/wp-content/uploads/2019/06/jinjoolee.jpgjinjooleehttps://jinjoolee.com/wp-content/uploads/2017/07/jinjoolee_photo-e1560643720270.jpgJin Joo Lee Photo2019-06-16T05:39:43+00:00weekly0.6https://jinjoolee.com/publications/2019-04-15T02:33:53+00:00weekly0.6https://jinjoolee.com/portfolio/jibo-a-proactive-personal-assistant/https://jinjoolee.com/wp-content/uploads/2018/07/get-to-know-him.jpgget-to-know-himhttps://jinjoolee.com/wp-content/uploads/2018/07/jibo-time-magazine.jpgjibo-time-magazineJibo named #1 in Time Magazine’s “25 Best Inventions”2018-08-09T19:46:18+00:00monthlyhttps://jinjoolee.com/portfolio/tega-robot-platform/https://jinjoolee.com/wp-content/uploads/2016/03/tega-full.jpgtega-fullhttps://jinjoolee.com/wp-content/uploads/2013/09/cover2-e1500599329137.jpgTega CAD graphichttps://jinjoolee.com/wp-content/uploads/2017/07/cover.jpgTega Robot Platform2018-08-07T19:05:36+00:00monthlyhttps://jinjoolee.com/portfolio/programming-robots-for-stem-education/https://jinjoolee.com/wp-content/uploads/2008/08/cover.pngRobot Games for STEM Education cover image2018-07-17T21:36:03+00:00monthlyhttps://jinjoolee.com/portfolio/data-of-children-storytelling/https://jinjoolee.com/wp-content/uploads/2017/05/p2pstory_cover_2.pngp2pstory_cover_2https://jinjoolee.com/wp-content/uploads/2015/11/word-cloud-inverted.pngFrequent Behaviors of ChildrenChildren more frequently use gazing and leaning behaviors to communicate that they are engaged and listening. https://jinjoolee.com/wp-content/uploads/2015/11/nod-graphic-inverted.pngNodding DifferencesAll adults use nodding behaviors in social interactions, but only 39% of children do. https://jinjoolee.com/wp-content/uploads/2015/11/word-cloud.pngChildren Behaviors Word Cloudhttps://jinjoolee.com/wp-content/uploads/2015/11/nod-graphic.pngNodding Differences2018-04-30T03:37:00+00:00monthlyhttps://jinjoolee.com/portfolio/intentional-inference-of-emotions/https://jinjoolee.com/wp-content/uploads/2017/05/roc.pngROC curveIn ROC space, the upper left corner represents perfect classification and a curve closer to this point is the better predictor. When representing emotion understanding as a goal-directed POMDP process, we achieve greater accuracy in detecting inattentive listeners compare to more traditional state-estimation models. https://jinjoolee.com/wp-content/uploads/2017/05/models.pngEmotion Recognition ModelsState estimators like hidden Markov models (HMM) are common machine learning algorithms used for emotion recognition. But my work redefines emotion recognition as an interactive and intentional process that occurs in social interactions. Like in storytelling activities, storytellers actively try to understand the emotional state of their partner using social cues, which are nonverbal “actions” they can take. I capture their emotion inference process, or in other words their strategy/policy, as a POMDP model. https://jinjoolee.com/wp-content/uploads/2017/08/cover.pngIntentional Inference Cover2018-04-30T03:30:55+00:00monthlyhttps://jinjoolee.com/portfolio/artificial-listener-with-social-intelligence/https://jinjoolee.com/wp-content/uploads/2017/05/system_diagram_long.pngRealtime Perception-to-behavior generation PipelineThe perception-cognition-action architecture of an artificial listener. The message passing between modules uses ROS, an open-source Robot Operating System. https://jinjoolee.com/wp-content/uploads/2017/05/dbn.pngBayesian Theory of Mind (BToM) Approach to Nonverbal CommunicationThe BToM model consists of two processes: 1) the DBN belief estimator tracks what a storyteller believes about the robot’s attentive state through plan inversion 2) the myopic policy selects listening behaviors to affect those beliefs toward a goal inference.https://jinjoolee.com/wp-content/uploads/2017/05/cover.pngArtificial Robot Listener for Storytelling2018-04-30T03:30:09+00:00monthlyhttps://jinjoolee.com/2017/05/01/disseration-defense/2018-04-30T03:29:20+00:00monthlyhttps://jinjoolee.com/portfolio/realtime-detection-of-social-cues/https://jinjoolee.com/wp-content/uploads/2017/03/bop-model.pngSpeaker Cue Detection ModelFour rule-based models to detect prosodic-based speaker cues. https://jinjoolee.com/wp-content/uploads/2017/03/cover2.pngDetecting Speaker Cues Cover Image2017-08-12T19:18:20+00:00monthlyhttps://jinjoolee.com/portfolio/robots-and-social-psychology/https://jinjoolee.com/wp-content/uploads/2012/11/nexi1.pngNexi, Humanoid Robothttps://jinjoolee.com/wp-content/uploads/2012/11/mouth_ui.pngMouth Control for Lipsyncing to SpeechBy detecting visemes from speech, the robot displays human-like mouth positions that correlate with speech in realtime.https://jinjoolee.com/wp-content/uploads/2012/11/head_ui.pngHead control for communicative nods and shakes.By detecting the operator’s 3D head orientation, the operator's natural head movements are projected onto the humanoid robot.https://jinjoolee.com/wp-content/uploads/2012/11/body_ui-e1500504292551.pngBody Control For GesturesThe graphical interface displays an animated rendering of the robot’s current body configuration as feedback for the operator. The operator can click buttons to trigger full-body animations.https://jinjoolee.com/wp-content/uploads/2012/11/graphic1_inverted.pngNonverbal Behaviors Reveal TrustNonverbal behaviors communicate our underlying intentions, goals, and values.https://jinjoolee.com/wp-content/uploads/2017/07/graphic2.pngLow-Trust CuesWhen Nexi expressed these nonverbal behaviors, participants perceived the robot to be a less trustworthy partner.https://jinjoolee.com/wp-content/uploads/2017/07/graphic1.pngNonverbal BehaviorsNonverbal behaviors communicate our underlying intentions, goals, and values. 2017-08-08T22:52:12+00:00monthlyhttps://jinjoolee.com/portfolio/learning-from-interactive-dialog/https://jinjoolee.com/wp-content/uploads/2017/07/cover1.jpgSimon the Robot2017-08-08T22:44:54+00:00monthlyhttps://jinjoolee.com/portfolio/emotionally-aware-robot-teammates/https://jinjoolee.com/wp-content/uploads/2013/02/graphic1.pngSystem DiagramSystem diagram illustrating tech modules for the autonomous robots, human speech processing, and game play. https://jinjoolee.com/wp-content/uploads/2013/02/cover2.pngHuman Robot Teaming Concept Art2017-08-08T22:43:42+00:00monthlyhttps://jinjoolee.com/portfolio/predicting-trust-between-people/https://jinjoolee.com/wp-content/uploads/2013/12/graphic1_inverted.pngHMM ModelsThrough the construction and simulation of hidden Markov models (HMMs), I investigated the sequential interplay of low-trust and high-trust nonverbal behaviors.https://jinjoolee.com/wp-content/uploads/2017/07/graphic21.pngMachine Learning PipelineDomain knowledge when incorporated into the feature selection process permits a SVM model to outperform human judgement.https://jinjoolee.com/wp-content/uploads/2017/07/cover2.pngHuman-Robot Trust Cover Image2017-08-08T22:41:47+00:00monthlyhttps://jinjoolee.com/2015/07/12/manufacturing-in-shenzhen/https://jinjoolee.com/wp-content/uploads/2015/07/img_4629.jpgStall in HuaqiangbeiA vendor selling motors in Huaqiangbei.https://jinjoolee.com/wp-content/uploads/2015/07/img_4516.jpgCellphones in HuaqiangbeiHacked and customized cellphones sold at Huaqiangbei.https://jinjoolee.com/wp-content/uploads/2015/07/img_2827.jpgFlex PCBSilkscreening flex PCB https://jinjoolee.com/wp-content/uploads/2015/07/img_2623.jpgAQS assembly factoryU-shaped assembly line; printers begin on the left and are completed on the right They also do the packaging right outside that exit.https://jinjoolee.com/wp-content/uploads/2015/07/img_2606.jpgAQS Electronics AssemblyConveyer belt assembly line where larger components are soldered on by hand.https://jinjoolee.com/wp-content/uploads/2015/07/img_2597.jpgQuality Check at AQSQuality check of boards.https://jinjoolee.com/wp-content/uploads/2015/07/img_2589.jpgBoard assembly in AQSSurface mount (SMT) placement machinehttps://jinjoolee.com/wp-content/uploads/2015/07/img_2563.jpgThrough-hole board assembly in AQSThrough-hole parts being assembled onto a single reelhttps://jinjoolee.com/wp-content/uploads/2015/07/img_2506.jpgMold making in Jiada FactoryEDM (Electrical discharge machining) Machinehttps://jinjoolee.com/wp-content/uploads/2015/07/img_2477.jpgMold of our prototype at JiadaInjection-side mold - molten plastic flows through the runners and enters through gates and into the cavity.2017-08-04T04:50:57+00:00monthlyhttps://jinjoolee.com/blog/2017-08-04T01:21:31+00:00weekly0.6https://jinjoolee.com/projects/2017-07-12T20:26:00+00:00weekly0.6https://jinjoolee.comdaily1.02019-06-16T05:39:43+00:00