2024:

• Goel, S. , Lymperopoulos, P., Thielstrom, T., Krause, E., Feeney, P., Lorang, P., Schneider, S., Wei, Y., Kildebeck, E., Goss, S., Hughes, M., Liu, L., Sinapov, J., and Scheutz, M. (2024)
  A neurosymbolic cognitive architecture framework for handling novelties in open worlds
  Journal of Artificial Intelligence, Vol. 331, Special Issue on Open-World AI, June 2024. [LINK]


• Shukla, Y. , Burman, T., Kulkarni, A., Wright, R., Velasquez, A., and Sinapov, J. (2024)
  Logical Specifications-guided Dynamic Task Sampling for Reinforcement Learning Agents
  To appear in Proceedings of the 34th International Conference on Automated Planning and Scheduling (ICAPS), Banff, Alberta, 2024.


• Tatiya, G., Framcis, J., Wu, H., Bisk, Y., and Sinapov, J. (2024)
  MOSAIC: Learning Unified Multi-Sensory Object Property Representations for Robot Perception
  To appear in Proceedings of the IEEE International Conference on Robotics and Automations (ICRA), 2024.


• Goel., S., Wei, Y., Lymperopoulos, P., Chura, K., Scheutz, M., and Sinapov, J. (2024)
  NovelGym: A Flexible Ecosystem for Hybrid Planning and Learning Agents Designed for Open Worlds
  To appear in Proceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Auckland, NZ, 2024. [LINK] [VIDEO] [WEBSITE]


• Shukla, Y. , Gao, W., Sarathy, V., Velasquez, A., Wright, R., and Sinapov, J. (2024)
  LgTS: Dynamic Task Sampling using LLM-generated sub-goals for Reinforcement Learning Agents
  To appear in Proceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Auckland, NZ, 2024. [LINK]

2023:

• Shukla, Y., Kesari, B., Goel, S., Wright, R., and Sinapov J. (2023)
  A Framework for Few-Shot Policy Transfer through Observation Mapping and Behavior Cloning
  In proceedings of the 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) [PDF] [VIDEO]


• Shukla, Y., Kulkarni, A., Wright R., Velasquez, A., and Sinapov J. (2023)
  Automaton-guided Curriculum Generation for Reinforcement Learning Agents
  In proceedings of the 33rd International Conference on Automated Planning and Scheduling, 2023 [PDF]


• Tatiya G., Francis J., and Sinapov J. (2023)
  Transferring Implicit Knowledge of Non-Visual Object Properties Across Heterogeneous Robot Morphologies
  In proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2023. [LINK]


• Zhang, Z., Lavigne, K., Church, W., Sinapov,. J., and Rogers, C. (2023)
  Introducing Reinforcement Learning to K-12 Students with Robots and Augmented Reality
  International Conference on Robotics in Education (RiE), 351-365 [PDF]
  


• Zhang, X., Amiri, S., Sinapov, J., Thomason, J., Stone, P., and Zhang, S. (2023)
  Multimodal embodied attribute learning by robots for object-centric action policies
  Autonomous Robots, 1-24. [LINK]


• Miller-Klugman B., Cleaver A., and Sinapov J. (2023)
  DARA: A Dynamic Augmented Reality Architecture for Human-Robot Interaction
  In proceedings of the 6th International Workshop on Virtual, Augmented, and Mixed Reality for Human-Robot Interactions (VAM-HRI), 2023. [LINK]


• Cleaver A., Chen V., and Sinapov J. (2023)
  Helping Humans Become Better Teachers for Robots with Augmented Reality
  In proceedings of the 6th International Workshop on Virtual, Augmented, and Mixed Reality for Human-Robot Interactions (VAM-HRI), 2023. [LINK]


• Cleaver A., Chen V., and Sinapov J. (2023)
  First Encounters with a Robot: The Value of Augmented Reality when Learning about Mobile Robots
  In proceedings of the 6th International Workshop on Virtual, Augmented, and Mixed Reality for Human-Robot Interactions (VAM-HRI), 2023. [LINK]


• Cleaver A., and Sinapov J. (2023)
  Demonstrating TRAinAR: An Augmented Reality Tool that Helps Humans Teach Robots
  In proceedings of the International Conference on Human-Robot Interaction (HRI) Video, 2023. [LINK]

2022:

• Gizzi, E., Nair, L., Chernova, S., and Sinapov, J. (2022)
  Creative Problem Solving in Artificially Intelligent Agents: A Survey and Framework
  Journal of Artificial Intelligence Research 75 (2022) [PDF] [LINK]


• Gizzi, E., Lin, W. W., Castro, M. G., Harvey, E., and Sinapov, J. (2022)
  Toward life-long creative problem solving: Using world models for increased performance in novelty resolution
  In 13th International Conference on Computational Creativity. [PDF]


• Thai, T., Shen, M., Varshney, N., Gopalakrishnan, S., Soni, U., Baral, C., Scheutz, M., and Sinapov, J. (2022)
  An Architecture for Novelty Handling in a Multi-Agent Stochastic Environment: Case Study in Open-World Monopoly
  In Proceedings of the 2022 AAAI Spring Symposium 'Designing Artificial Intelligence for Open Worlds' [PDF]


• Goel S., Shukla Y., Sarathy V., Scheutz M., and Sinapov J. (2022)
  RAPid-Learn: A Framework for Learning to Recover for Handling Novelties in Open-World Environments
  In Proceedings of International Conference on Development and Learning (ICDL), 2022 [PDF]


• Gizzi E., Owens H., Pellegrino N., Trombley C., Marshall J., Sinapov J. (2022)
  Autonomous System-Level Fault Diagnosis in Satellites using Housekeeping Telemetry
  In Proceedings of the Small Satellite Conference, 2022. [PDF] [LINK]


• Lorang, P., Goel, S., Zips, P., Sinapov, J., and Scheutz, M. (2022)
  Speeding-up Continual Learning through Information Gains in Novel Experiences
  In Proceedings of 5th Workshop on Bridging the Gap Between AI Planning and Reinforcement Learning (PRL) at International Joint Conference of Artificial Intelligence (IJCAI), 2022. [PDF]


• Shukla, Y., and Sinapov J. (2022)
  A Framework for Curriculum Schema Transfer from Low-Fidelity to High-Fidelity Environments
  In Proceedings of the 3rd Workshop on Closing the Reality Gap in Sim2Real Transfer for Robotics at Robotics: Science and Systems (RSS), 2022. [PDF]


• Shukla, Y., Loar, K., Wright R., and Sinapov J. (2022)
  An Object-Oriented Approach for Generating Low-Fidelity Environments for Curriculum Schema Transfer
  In Proceedings of the Scaling Robot Learning Workshop at International Conference on Robotics and Automation (ICRA), 2022. [PDF]


• Shukla, Y., Thierauf C., Hosseini R., Tatiya G., and Sinapov J. (2022)
  ACuTE: Automatic Curriculum Transfer from Simple to Complex Environments
  In Proceedings of International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Online, 2022. [PDF] [Video]

2021:

• Zhang, Z., Akai-Nettey, S.M., Addo, A., Rogers, C., and Sinapov, J. (2021)
  An Augmented Reality Platform for Introducing Reinforcement Learning to K-12 Students with Robots
  In Proceedings of the 2021 AAAI Fall Symposium "Artificial Intelligence for Human-Robot Interaction" [PDF] [Video]


• Gizzi, E., Hassan, A., Lin, W., Rhea, K., and Sinapov, J. (2021)
  Toward Creative Problem Solving Agents: Action Discovery through Behavior Babbling
  In proceedings of the IEEE International Conference on Development and Learning (ICDL), Beijing, China, August 23-26, 2021. [PDF]


• Gizzi, E., Guaman, M., Lin, W., Sinapov, J. (2021)
  A Framework for Creative Problem Solving Through Action Discovery
  In Proceedings of RSS 2021 Workshop on Declarative and Neurosymbolic Representations in Robot Learning and Control [PDF] [VIDEO]


• Zhang, X., Sinapov, J.,and Zhang, S. (2021)
  Planning Multimodal Exploratory Actions for Online Robot Attribute Learning
  In proceedings of Robotics: Science and Systems (RSS), July 12-16, 2021. [Preprint PDF] [Code and Data]


• Hosseini, R., Chen, X., Panetta, K., and Sinapov, J. (2021)
  A Framework for Multisensory Foresight for Embodied Agents
  In proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Xi’an, China, May 30-June 5, 2021. [Preprint PDF]


• Goel, S., Tatiya, G., Scheutz, M., and Sinapov, J., (2021)
  NovelGridworlds: A Benchmark Environment for Detecting and Adapting to Novelties in Open Worlds
  In proceedings of the 2021 AAMAS Workshop on Adaptive Learning Agents (ALA) [PDF] [Video]


• Sarathy, V., Kasenberg, D., Goel, S., Sinapov, J., and Scheutz, M. (2021)
  SPOTTER: Extending Symbolic Planning Operators through Targeted Reinforcement Learning
  In proceedings of the 2021 ACM Conference on Autonomous Agents and Multi-Agent Systems (AAMAS) [PDF]


• Muhammad, F., Sarathy, V., Tatiya, G., Gyawali, S., Goel, S., Guaman, M., Sinapov, J. and Scheutz, M. (2021)
  A Novelty-Centric Agent Architecture for Changing Worlds
  In proceedings of the 2021 ACM Conference on Autonomous Agents and Multi-Agent Systems (AAMAS) [PDF]


• Zhang, Z., Willner-Giwerc, S., Sinapov, J., Cross, J., and Rogers, C. (2021)
  An Interactive Robot Platform for Introducing Reinforcement Learning to K-12 Students
  In proceedings of the International Conference on Robotics in Education (RiE), Apr 28-30, 2021. [PDF]


• Cleaver, A., Tang, D., Chen, V., Short, E., and Sinapov, J. (2021)
  Dynamic Path Visualization for Human-Robot Collaboration
  Late-Breaking Report in Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction [PDF]

2020:

• Cleaver, A., Tang, D., Chen, V., and Sinapov, J. (2020)
  HAVEN: A Unity-based Virtual Robot Environment to Showcase HRI-based Augmented Reality
  In Proceedings of the 2020 AAAI Fall Symposium "Artificial Intelligence for Human-Robot Interaction" [PDF]


• Cleaver, A., Muhammad, F., Hassan, A., Short, E., and and Sinapov, J. (2020)
  SENSAR: A Visual Tool for Intelligent Robots for Collaborative Human-Robot Interaction
  In Proceedings of the 2020 AAAI Fall Symposium "Artificial Intelligence for Human-Robot Interaction" [PDF]


• Tatiya, G., Shukla, Y., Edegware, M., and Sinapov, J. (2020)
  Haptic Knowledge Transfer Between Heterogeneous Robots using Kernel Manifold Alignment
  In proceedings of the 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) [PDF]


• Tatiya, G., Hosseini, R., Hughes, M., and Sinapov, J. (2020)
  A Framework for Sensorimotor Cross-Perception and Cross-Behavior Knowledge Transfer for Object Categorization
  Frontiers in Robotics and AI, Vol. 7., special issue titled ``ViTac: Integrating Vision and Touch for Multimodal and Cross-Modal Perception'', 2020 [LINK] [BIB]


• Narvekar, S., Peng, B., Leonetti, M., Sinapov, J., Taylor, M. E., and Stone, P. (2020)
  Curriculum Learning for Reinforcement Learning Domains: A Framework and Survey
  Journal of Machine Learning Research, 21(181):1−50, 2020 [PDF] [BIB]


• Gizzi, E., Nair, L., Sinapov, J., and Chernova, S. (2020)
  From Computational Creativity to Creative Problem Solving Agents
  In proceedings of the 2020 International Conference on Computational Creativity (ICCC) [PDF]


• Cleaver, A., Short, E., and Sinapov, J. (2020)
  RAIN: A Vision Calibration Tool using Augmented Reality
  In proceedings of the 3rd International Workshop on Virtual, Augmented, and Mixed Reality for Human-Robot Interactions (VAM-HRI), March, 2020 [PDF]


• Thomason, J., Padmakumar, A., Sinapov, J., Walker, N., Jiang, Y., Yedidsion, H., Hart, J., Stone, P. and Mooney, R.J. (2020)
  Jointly improving parsing and perception for natural language commands through human-robot dialog
  Journal of Artificial Intelligence Research 67 (2020) [PDF] [VIDEO]

2019:

• Tatiya, G., Hosseini, R., Hughes, M., and Sinapov, J. (2019)
  Sensorimotor Cross-Behavior Knowledge Transfer for Grounded Category Recognition
  In proceedings of the Joint IEEE 9th International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), Oslo, Norway, Aug. 19-22, 2019. [PDF] [BIB] [DATASET]


• Gizzi, E., Guaman, M., and Sinapov, J. (2019)
  Creative Problem Solving by Robots Using Action Primitive Discovery
  In proceedings of the Joint IEEE 9th International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), Oslo, Norway, Aug. 19-22, 2019. [PDF] [BIB]


• Tatiya, G., and Sinapov, J. (2019)
  Deep Multi-Sensory Object Category Recognition Using Interactive Behavioral Exploration
  In proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Montreal, Canada, May 20-24, 2019. [PDF] [BIB] [DATASET]


• Tatiya, G., and Sinapov, J. (2019)
  Sensorimotor Cross-Perception Knowledge Transfer for Grounded Category Recognition
  In proceedings of the ICRA 2019 Workshop: Integrating Vision and Touch for Multimodal and Cross-modal Perception (ViTac), Montreal, Canada, May 23, 2019. [PDF] [BIB] [DATASET]


• Thomason, J., Padmakumar, A., Sinapov, J., Walker, N., Jiang, Y., Yedidsion, H., Hart, J., Stone, P., and Mooney, R. (2019)
  Improving Grounded Natural Language Understanding through Human-Robot Dialog
  In proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Montreal, Canada, May 20-24, 2019.


• Muhammad, F., Hassan, A., Cleaver, A., and Sinapov, J. (2019)
  Creating a Shared Reality with Robots
  In Late-Breaking Reports Track at the 14th ACM/IEEE Annual Conference on Human-Robot Interaction, Daego, Korea, Mar. 11-14, 2019. [PDF] [VIDEOS] [BIB]

2018:

• Hart, J., Yedidsion, H., Jiang, Y., Walker, N., Shah, R., Thomason, J., Padmakumar, A., Fernandez, R., Sinapov, J., Mooney, R., and Stone, P. (2018)
  Interaction and Autonomy in RoboCup@Home and Building-Wide Intelligence
  In proceedings of the 2018 AAAI Fall Symposium "Interactive Learning in Artificial Intelligence for Human-Robot Interaction", Arlington, Virginia USA, October 18-20, 2018. [PDF]
  


• Fernandez, R., John, N., Kirmani, S., Hart, J., Sinapov, J., and Stone, P. (2018)
  Passive Demonstrations of Light-Based Robot Signals for Improved Human Interpretability
  In proceedings of the 2018 IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), Nanjing, China, Aug. 27-31, 2018. [PDF]
  


• Gizzi, E., Le Vie, L., Scheutz, M., Sarathy, V., Sinapov, J. (2018)
  Knowledge Acquisition in the Cockpit Using One-Shot Learning
  In proceedings of the 2018 IEEE National Aerospace and Electronics Conference (NAECON), Dayton, OH, Jul. 23-26, 2018. [PDF]
  


• Amiri, S., Wei, S., Zhang, S., Sinapov, J., Thomason, J., and Stone, P. (2018)
  Multi-modal Predicate Identification using Dynamically Learned Robot Controllers
  In proceedings of the 2018 International Joint Conference on Artificial Intelligence (IJCAI), Stockholm, Sweden, Jul. 13-19, 2018. [PDF]
  


• Gizzi, E., Le Vie, L., Scheutz, M., Sarathy, V., Sinapov, J. (2018)
  A Generalized Framework for Detecting Anomalies in Real-Time Using Contextual Information
  In proceedings of the 2018 Workshop on Modeling and Reasoning in Context (MRC) co-located with IJCAI, Stockholm, Sweden, Jul. 13, 2018. [PDF]
  


• Thomason, J., Padmakumar A., Sinapov, J., Walker, N., Jiang, Y., Yedidsion, H., Hart, J., Stone, P., and Mooney, R.J. (2018)
  Jointly Improving Parsing and Perception for Natural Language Commands through Human-Robot Dialog
  In proceedings of the RSS Workshop on Models and Representations for Natural Human-Robot Communication (MRHRC-18), Pittsburgh, PA, Jun. 29-30, 2018. [PDF] [VIDEO]
  


• Amiri, S., Wei, S., Zhang, S., Sinapov, J., Thomason, J., and Stone, P. (2018)
  Robot Behavioral Exploration and Multi-modal Perception using Dynamically Constructed Controllers
  In proceedings of the AAAI Spring Symposium on Integrating Representation, Reasoning, Learning, and Execution for Goal Directed Autonomy, Stanford, CA, Mar. 26-28, 2018. [PDF]
  


• Cheli, M., Sinapov, J., Danahy, E., Rogers, C. (2018)
  Towards an Augmented Reality Framework for K-12 Robotics Education
  In proceedings of the 1st International Workshop on Virtual, Augmented, and Mixed Reality for Human-Robot Interactions (VAM-HRI), Chicago, IL, Mar. 5, 2018. [PDF] [BIB]
  


• Thomason, J., Sinapov, J., Stone, P., and Mooney, R. (2018)
  Guiding Exploratory Behaviors for Multi-Modal Grounding of Linguistic Descriptions
  In proceedings of the 32nd Conference of the Association for the Advancement of Artificial Intelligence (AAAI), New Orleans, LA, Feb. 2-7, 2018. [PDF] [BIB]