News
• August: Our team at Google DeepMind demonstrated how to Achieve Human-Level Robot Table Tennis. NEW!
• September: New paper at Conference on Language Modelling 2024 on VLMs for Robotics: Task Success is not Enough". NEW!
• September: I receive the Teaching Excellence Award 2024 at the Fulton Schools of Engineering! NEW!
• September: Four new papers at IROS 2024: NEW!
- Diff-Control: A Stateful Diffusion-based Policy for Imitation Learning
- SiSCo: Signal Synthesis for Effective Human-Robot Communication via Large Language Models
- Repairing Neural Networks for Safety in Robotic Systems using Predictive Models
- Active Learning for Forward/Inverse Kinematics of Redundantly-driven Flexible Tensegrity Manipulator
• August: New paper and code on "A Comparison of Imitation Learning Algorithms for Bimanual Manipulation". NEW!
• February: New journal paper: "Learning-Based Multimodal Control for a Supernumerary Robotic Systems".
• June: Four new papers at IROS 2023:
- Enhancing State Estimation in Robots: A Data-Driven Approach with Differentiable Ensemble Kalman Filters
- Anytime, Anywhere: Human Arm Pose from Smartwatch Data for Ubiquitous Robot Control and Teleoperation
- Learning Soft Robot Dynamics using Differentiable Kalman Filters and Spatio-Temporal Embeddings
- Projecting Robot Intentions Through Visual Cues: Static vs. Dynamic Signaling
• June: New charitable grant provided by RadiusAI. We will be working on augmented reality and computer vision.
• May: Paper at ICRA 2023: Learning and Blending Robot Hugging Behaviors in Time and Space.
• May: PhD student #6 from the Interactive Robotics Laboratory at ASU graduates! Congratulations Dr. Geoffrey Clark.
• May: New grant provided by Procter and Gamble on the topic of human motion interpretation and prediction from smartwatch.
• May: Happy to receive the Best 5% Faculty Award at ASU. This is my fourth award number for teaching excellence. Thank you!
• May: I am co-organizing a workshop on natural language for robotics at RSS 2023. Please check it out and attend: Website!
• Nov: New website with results, code and simulation on robot manipulation: www.bimanualmanipulation.com
• Oct: Our paper at NeurIPS 2022 Robot Learning workshop will receive a Best Paper Award! Paper title: Certifiably-correct Control Policies for Safe Learning and Adaptation in Assistive Robotics!
• Oct: Two new papers at CoRL 2022: (1) Safe Robot Learning through Neural Network Repair and (2) Modularity through Attention: Efficient Training and Transfer of Language-Conditioned Policies for Robot Manipulation!
• July: Joint paper with Google X/Intrinsic at IROS 2022 "A System for Imitation Learning of Contact-Rich Bimanual Manipulation"!
• May: Thanks to Procter and Gamble for an unrestricted gift for research on human motion interpretation !
• May: Got promoted to Associate Professor with Tenure at Arizona State University!
• April: We started a new research project on robotics for photovoltaic systems with Erthos, Inc.
• April: We received a major unrestricted gift from Google X and Intrinsic to work on Bimanual Manipulation.
• Jan: Congratulations Dr. Simon Stepputssi! Joe will join CMU as a postdoctoral scholar.
• Jun: Congratulations Dr. Joe Campbell! Joe will join CMU as a postdoctoral scholar in Prof. Katia Sycara's lab.
• May: I am the main organizer of the ICRA 2021 workshop on "Curious Robots". Check out our website.
• May: Happy to receive the ASU FSE - Top 5% Teaching Award at Arizona State University in 2021.
• May: Invited talk at Samsung Forum on "Human Robot Collaboration and Communication" Check it out: here!
• March-April: Invited talks at Stanford, USC, Cornell, CMU, Clemson University.
• Nov: paper accepted at CoRL 2020 "Learning Predictive Models for Ergonomic Control of Prosthetic Devices".
• Sep: Spotlight Paper at NeurIPS 2020 "Language-Conditioned Imitation Learning for Robot Manipulation Tasks".
• July: panelist at the RSS 2020 Workshop on "Closing the Academia to Real-World Gap in Service Robotics"
• May: Invited talk at the ICRA 2020 Workshop on Long-Term Human Motion Prediction. Video can be found here!
• May: two new papers from our lab at ICRA 2020:
- "Predictive Modeling of Periodic Behavior for Human-Robot Symbiotic Walking"
- "DeepCrashTest: Turning Dashcam Videos into Virtual Crash Tests for Automated Driving Systems"
- "Predictive Modeling of Periodic Behavior for Human-Robot Symbiotic Walking"
- "DeepCrashTest: Turning Dashcam Videos into Virtual Crash Tests for Automated Driving Systems"
• May: Our workshop paper “Robotic In-Space Assembly with Arm-Augmented Cubesats” received the Best Poster Award at the Space Robotics Workshop at ICRA 2020.
• March: Happy to receive the ASU FSE - Top 5% Teaching Award at Arizona State University in 2020.
• January: new collaborative projects with Intel and Honda Research Institute.
• June: New paper together with Facebook Robotics accepted to CoRL 2019. Title: "Data-efficient Co-Adaptation of Morphology and Behaviour with Deep Reinforcement Learning".
• June: 4 new papers accepted to IROS 2019.
• April: New paper accepted to RSS 2019 in Freiburg! Title:"Probabilistic Multimodal Modeling for Human-Robot Interaction Tasks".
• February: Our work was covered on national TV. The program CBS This Morning showed an interview and our robots.
• February: We will be presenting our work on Intention Projection at ICRA 2019.
• January: We successfully organized the Southwest Robotics Symposium.
• October: New joint project with Intel on "Probabilistic Deep Reinforcement Learning".
• October: New paper on "Evaluating Perception Systems for Autonomous Vehicles using Quality Temporal Logic".
• September: I am looking for motivated Postdocs in machine learning. Interested?
• September: New joint project with NASA JPL on robot manipulation in space.
• June: Happy to receive the Fulton Outstanding Assistant Professor Award for 2018-2019.
• June: Happy to receive the ASU FSE - Top 5% Teaching Award at Arizona State University.
• May: Two invited talks, two paper presentations, and member of the Best Paper Committee at ICRA 2018!
- "Deep Predictive Models for Collision Risk Assessment in Autonomous Driving" and
- "Extrinsic Dexterity through Active Slip Control using Deep Predictive Models".
- "Deep Predictive Models for Collision Risk Assessment in Autonomous Driving" and
- "Extrinsic Dexterity through Active Slip Control using Deep Predictive Models".
• March: I am a recipient of the NSF CAREER Award in 2018. The project title is:
CAREER: Preventive Robotics: Learning and Adaptation for Predictive Human Robot Symbiosis".
CAREER: Preventive Robotics: Learning and Adaptation for Predictive Human Robot Symbiosis".
• March: We have released a library for Bayesian Interaction primitives. Check it out here!
• March: New journal paper accepted to Autonomous Robots
- "One-shot learning of human–robot handovers with triadic interaction meshes".
- "One-shot learning of human–robot handovers with triadic interaction meshes".
• Jan: Co-organized the Southwest Robotics Symposium at ASU. See our excellent line-up of speakers: Conference Link
• Dec: New Arxive paper on "Deep Predictive Models for Collision Risk Assessment in Autonomous Driving"!
• Nov: Our workshop proposal for "Virtual, Augmented, and Mixed Reality for Human-Robot Interaction" at HRI got accepted!
Link to the workshop website here!
Link to the workshop website here!
• Nov: Our workshop proposal for "Ergonomic Human-Robot Interaction" at ICRA 2018 got accepted!
• Sept: New paper accepted to the International Conference on Robot Learning (CoRL) "Bayesian Interaction Primitives: A SLAM Approach to Human-Robot Interaction".
• Sept: New paper accepted to ISRR 2018 "Should Robots Feel Pain?'" -- Towards a Computational Theory of Pain in Autonomous Systems.
• Sept: Our research has been featured in the Arizona Republic. See article!
• August: New interview with American Society of Mechanical Engineers. Article!
• July: Our research has been featured multiple times on BBC World.
• July: We started a new project on "Human Intention Recognition for Space Exploration". More info here.
• July: I will be giving an invited talk in the Evo-Deco Workshop at Living Machines in Stanford!
• June: Two new papers accepted to IROS 2017: (a) "Robots that Anticipate Pain: Anticipating Physical Perturbations from Visual Cues through Deep Predictive Models" and (b) "Extracting Bimanual Synergies with Reinforcement Learning"!
• June: Our work is featured on CBS News - video here!
• June: New interview on collaborative robotics with the Mechanical Engineers journal! Link here!
• June: We have been featured on NPR - KJZZ. Together with Dan Aukes I talked about our robot turtle. Link here!
• May: Congratulations to my Ph.D. students Kevin Luck, Trevor Barron, Joe Campbell for their internships at Google Deepmind, Honda Research Institute, and University of Osaka.
• April: Two new accepted papers at RSS 2017 and Living Machines 2017: "From the Lab to the Desert: Fast Prototyping and Learning of Robot Locomotion" (RSS 2017 @ MIT), and "Bio-inspired Robot Design Considering Load-bearing and Kinematic Ontogeny of Chelonioidea Sea Turtles" (Living Machines 2017 @ Stanford).
• March: We presented our robots at the Engineering the Future event at ASU!
• March: Invited talks at Honda Research Institute, Bosch, and Intuitive Surgical.
• January: New paper accepted at ICRA 2017 - "A System for Learning Continuous Human-Robot Interactions from Human-Human Demonstrations".
• January: Joe Campbell receives the NSF EAPSI Award! Joe will spend the summer with our collaborators in Osaka,Japan.
• December: Our project got selected for the Robotiq Tactile Sensor program!
• December: A new interview for the ASU Now website on the HBO series "Westworld". Article here.
• November: Our work on "Learning Human-Robot Interaction from Human-Human Interactions" received the BEST VIDEO Award at IEEE Humanoids 2016 in Mexico. Award Picture here!
• November: Our robot learning to play basketball is featured in an extended interview by Motherboard. Article here.
• November: Research has been featured in ASU Now and Recode. Articles on our basketball-playing robot "Sun Devil-RX".
• October: Our lab's research has been featured in both the online and print version of the NEW SCIENTIST. Check it out!
• September: Our lab member Nikhil Kalige graduated with a Master and will join Intuitive Surgical as robotics engineer.
• September: Our lab is mentioned in a recent article by the TechEmergence website! Check it out.
• August: My talk at Columbia University during the RO-MAN conference was covered in German news website!
See article.
See article.
• August: New paper accepted at IROS2016 in South Korea on "Estimating Perturbations from Experience using Neural Networks and Information Transfer"
• June: I am organizing a Autonomous Robots - Journal special issue on "Learning for Human-Robot Collaboration" - find the Call-for-Papers under this link!
• June: Gave a talk at Phoenix Comicon on "The Science of Iron Man", see an article on the topic here: article!
• May: I organized a joint workshop on "DeepLearning and Embedded Technology" together with Nvidia! Thanks to Jon Saposhnik from Nvidia for the generous support!
• May: Invited talks Ecole de Technologie Superieure (Montreal), Universite Lavalle, and Columbia University (New York).
• May: New paper accepted to ROMAN 2016 "Projecting Robot Intentions into Human Environments"!
• April: I will be giving an invited talk at the "Human Robot Collaboration Towards Co-Adaptive Learning through Semi-Autonomy and Shared Control" Workshop at IROS 2016 in Daejon Korea.
• March: I will be giving an invited talk at the "Behavior, Adaptation and Learning for Assistive Robotics" (BAILAR) workshop at IEEE ROMAN 2016 in New York.
• March: We have released a MATLAB implementation of "Sparse Latent Space Policy Search", see this link!
• February: Manuscript available for our new AAMAS paper "Directing Policy Search with Interactively Taught Via-Points"
• February: Check out our lab website: http://lab.engineering.asu.edu/interactive-robotics/
• February: IJCAI-2016 Workshop "Interactive Machine Learning: Connecting Humans and Machines" together with my dear colleagues Kaushik Subramanian, Andrea Thomaz, and Charles Isbell.
• February: The interactive Robotics Lab participated in AAAI 2016 with a robot demo!
• January: New article about our group in the ASU Now newsletter!
• January: New paper accepted to AAMAS 2016: "Directing Policy Search with Interactively Taught Via-Points"!
• January: New ICRA paper accepted "Experience-based Torque Estimation for an Industrial Robot".
See you in Stockholm!
See you in Stockholm!
• November: Nominated to IJCAI 2016 Senior Program Committee.
• November: Our new paper "Sparse Latent Space Policy Search" together with my first PhD student Kevin S. Luck at Arizona State University has been accepted to AAAI 2016. Only about 26% of the papers were accepted.
• October: Robotiq -one of the leading companies in robotic hands- interviewed me on my views on human-robot collaboration and put the result up as a podcast. Check it out here.
• August: My research on intuitive human-robot interaction has been featured on IEEE Spectrum and a variety of other news sources. See the full video here.
• Fall: I will be teaching the CSE 591 Research Seminar: "Advances in Robot Learning" at ASU during Fall 2015. You can find a description of the syllabus here.
• August: Starting as an Assistant Professor for Robotics at Arizona State University!
• June: Two new accepted papers "Occlusion Aware Object Localization, Segmentation and Pose Estimation" (British Machine Vision Conference) and " A Taxonomy of Benchmark Tasks for Bimanual Manipulators" (International Symposium on Robotics Research). Pdf coming soon!
• June: Appointed Associate Editor for the new IEEE Robotics and Automation Letters (RA-L) journal!
• May: Invited talk on "Robot Learning for Grasping and Manipulation" at ICRA 2015.
• May: Our paper Learning Multiple Collaborative Tasks with a Mixture of Interaction Primitives is nominated for three paper awards including the overall Best Paper Award of the ICRA 2015 conference in Seattle!
• April: Invited talk on "Motor Skill Learning for Interactive Robots" at the University of Texas at Austin. A big thank you to Luis Sentis, Peter Stone and Ashish Deshpande!
• March: I will give an invited talk in the workshop “Learning for Human-Robot Collaboration” at the 2015 IEEE International Symposium on Robot and Human Interactive Communication to be held in Kobe, Japan.
• March: We will organize a workshop on Learning for Visual and Tactile Interaction at RSS 2015 in Rome, Italy. We have great invited speakers. Please consider submitting a workshop paper!
• February: Satya won the Gwinnett Science Fair! Satya received several awards and will directly proceed to the prestigious Intel International Science Fair. As a mentor, I am very proud of him and looking forward to go to the Intel international science fair in Pittsburgh in May.
• January: Our two papers to ICRA 2015 have been accepted! The papers address (1) Learning Multiple Collaborative Tasks with a Mixture of Interaction Primitives and (2) Exploiting Symmetries and Extrusions for Grasping Household Objects.
• December: I will give an invited talk about "Machine Learning for Grasping and Manipulation" at the ICRA 2015 workshop on grasping. Link to Workshop!
• December: I was selected to be part of a committee for the MINTernational award. Our committee will select the top German universities with internationalization efforts.
• November Our paper Online Multi-Camera Registration for Bimanual Workspace Trajectories is a finalist for two Best Paper Awards at Humanoids 2014!
• October Our paper on Perturbation Estimation from low-cost sensors has been accepted to the Advanced Robotics journal!
• October: All of our three paper submission to Humanoids 2014 have been accepted for oral presentations. Check out publications section!
• October: I will act as an Associate Editor for ICRA 2015. I will cover the fields of Human-Robot Interaction and Machine Learning.
• October: I am organizing a workshop on Policy Representation for Humanoid Robots at the Humanoids 2014 conference in Spain.
• August: Our paper Dynamic Mode Decomposition for Perturbation Estimation in Human-Robot Interaction was nominated for a Paper Award at the IEEE ROMAN 2014 conference!
• April: Our paper on Latent Space Policy Search has been accepted to IROS 2014! The paper introduces a novel reinforcement learning algorithm that can reduce the dimensionality of a task during learning.
• We have 2 posters accepted at the RSS workshop Human versus Robot Grasping and Manipulation! Congratulations to our students Neil Dantam and Ana Huaman! The papers deal with fault recovery in grasping and bi-manual grasping and hand-over.
• Neil Dantam will present our paper Online Camera Registration for Robot Manipulation at ISER 2014 in Morroco.
• Our paper on Dynamic Mode Decomposition for Perturbation Estimation in Human Robot Interaction was accepted to ROMAN 2014. The paper shows how machine learning can be used to estimate external perturbations using low-cost sensors.
• We have presented our recent work on Interaction Primitives at the ICRA Conference in Hong Kong. Interaction Primitives are a new representation for imitation learning in human-robot interaction tasks.
• I was asked to act as an associate editor of the new journal Frontiers in Robotics and AI. Looking forward to this exciting task!
• I edited a special issue of the Autonomous Robots journal on grasping and manipulation. The special issue contains the state-of-the-art in this field. It also contains four papers on the DARPA ARM project. Check it out!
• I was awarded a Daimler-Benz Travel Award for my research on Human-Robot Interaction!
