👥 SocNavGym

TEAM CONTRIBUTION
COMPLETED

2020-2024 • Team Project • Supervisor: Dr. Luis J. Manso

Table of Contents


1. Overview

Comprehensive Social Navigation

SocNavGym is a comprehensive social navigation gymnasium environment for evaluating social robot navigation algorithms with multiple entity types including robot agents, human pedestrians, and obstacles (see Technical Specifications section). As part of the development team, I focused on reinforcement learning aspects and integration with predictive models (see My Contribution section). This was the primary environment for testing Predictive World Models and validating Adaptive Prediction Horizons (see Research Impact section), with results published in UKCI 2023 and my PhD thesis.

Target
Primary Environment
For predictive models
Book
UKCI 2023
Published results
Check
Team Project
2020-2024

We can see SocNavGym in action: multiple entities interacting in social navigation scenarios. Blue circle = robot agent, colored circles = human pedestrians, gray rectangles = static obstacles (tables, walls), green markers = goals/destinations (see Technical Specifications section for entity details)


2. Research Motivation

Why This Was Needed

Social robot navigation requires algorithms that can handle complex interactions with humans and dynamic environments. Traditional navigation environments lacked the social dynamics necessary to evaluate algorithms designed for real-world social scenarios.

As part of the development team, I contributed to SocNavGym to provide a comprehensive testing ground for social navigation algorithms with multiple entity types (see Technical Specifications section), enabling researchers to:

Research Design

As part of the development team, I focused on reinforcement learning aspects and integration with predictive models (see My Contribution section). SocNavGym became the primary environment for testing Predictive World Models (2StepAhead, MASPM) and validating Adaptive Prediction Horizons (see Research Impact section), enabling comprehensive evaluation of sequential learning approaches in complex social navigation scenarios.


3. The Challenge

What Makes This Hard?

Social navigation presents unique challenges:

The Solution

SocNavGym addresses these challenges by providing:


4. Key Innovation

What Makes SocNavGym Unique?

SocNavGym provides a comprehensive social navigation environment with:

  1. Full Social Dynamics
    • Realistic human-robot interactions with multiple entity types (see Technical Specifications section)
    • Social navigation rules and conventions
    • Multi-agent scenarios with robot, humans, and obstacles
  2. Comprehensive Features
    • Detailed visual rendering of all entities
    • Full physics simulation for realistic movement
    • Complete state representation including all entity information
  3. Research Integration
    • Compatible with standard RL frameworks
    • Supports predictive model evaluation
    • Enables comprehensive benchmarking
  4. Extensibility
    • Customizable scenarios and entity configurations
    • Flexible evaluation metrics
    • Easy integration with new algorithms

5. Results & Performance

Research Outcomes

SocNavGym has been used successfully for testing Predictive World Models (2StepAhead, MASPM) and validating Adaptive Prediction Horizons in complex social navigation scenarios with multiple entities (see Research Impact section for details). Results were published in UKCI 2023 and used in my PhD thesis.

Key Achievements


6. My Contribution

Team Role

As part of the development team, I focused on:

  1. RL Algorithm Integration
    • Integration with reinforcement learning frameworks
    • Testing RL algorithms in social navigation scenarios
    • Performance benchmarking systems
  2. Predictive Model Evaluation
    • Framework for evaluating predictive world models
    • Integration with 2StepAhead and MASPM models
    • Validation of Adaptive Prediction Horizons
  3. Performance Benchmarking
    • Development of evaluation metrics
    • Systematic performance comparison
    • Results analysis and reporting
  4. Research Integration
    • Integration with proposed models
    • Publication support (UKCI 2023)
    • PhD thesis research support

7. Technical Specifications

Environment Type

Environment Entities

SocNavGym simulates a social navigation environment with the following entities:

  1. Robot Agent
    • The controlled agent navigating the environment
    • Receives observations and executes actions
    • Must navigate while respecting social norms
  2. Human Pedestrians
    • Dynamic entities that move through the environment
    • Follow social navigation patterns and conventions
    • Interact with the robot and other pedestrians
    • Represent realistic human movement behaviors
  3. Static Obstacles
    • Fixed obstacles in the environment (walls, barriers, furniture)
    • Define the physical layout and constraints
    • Create navigation challenges and path planning requirements
  4. Dynamic Obstacles
    • Moving obstacles that change position over time
    • May include other robots or moving objects
    • Add complexity to navigation and prediction tasks
  5. Goals/Destinations
    • Target locations the robot must reach
    • Define navigation objectives and success criteria
    • May be static or dynamic depending on the scenario

Observation Space

Action Space

Key Features


8. Installation & Usage

Installation

# Clone the repository
git clone https://github.com/gnns4hri/SocNavGym.git
cd SocNavGym

# Install dependencies
pip install -e .
# or
pip install gymnasium numpy pygame

When to Use SocNavGym

Use SocNavGym when:

Use LiteSocNavGym when:

Basic Usage

import gymnasium as gym
from socnavgym import SocNavGym

# Create environment
env = SocNavGym()

# Reset environment
obs, info = env.reset()
print(f"Observation: {obs}")
print(f"Info: {info}")

# Run episode
for step in range(1000):
    # Get action from your model
    action = your_model.predict(obs)
    
    # Step environment
    obs, reward, terminated, truncated, info = env.step(action)
    
    # Render (optional)
    env.render()
    
    if terminated or truncated:
        obs, info = env.reset()

env.close()

Integration with Predictive Models

# Example: Using with 2StepAhead model
from socnavgym import SocNavGym
from your_models import TwoStepAhead

env = SocNavGym()
model = TwoStepAhead()

obs, info = env.reset()
for step in range(1000):
    action = model.predict(obs)
    obs, reward, terminated, truncated, info = env.step(action)
    if terminated or truncated:
        obs, info = env.reset()

API Documentation

Main Methods:

Observation Format:

Action Format:


9. Research Impact

SocNavGym was the primary environment for testing Predictive World Models (2StepAhead, MASPM) and validating Adaptive Prediction Horizons, with results published in UKCI 2023 and used in my PhD thesis. The environment enabled comprehensive evaluation of sequential learning approaches in complex social navigation scenarios, establishing a foundation for applying predictive models to real-world social robot navigation.

Key Contributions:

  1. Primary Testing Environment - Used for all predictive model evaluations (see Results & Performance section)
  2. Published Results - UKCI 2023 publication
  3. PhD Thesis Support - Core environment for thesis research
  4. Comprehensive Evaluation - Full-featured testing platform (see Key Innovation section)

Usage in Research

SocNavGym was important for evaluating and validating Predictive World Models and Adaptive Prediction Horizons. The environment enabled:


10. Experimental Setup

Research Context

SocNavGym was used as the primary environment for testing Predictive World Models (2StepAhead, MASPM) and validating Adaptive Prediction Horizons (see Research Impact section). The environment enabled comprehensive evaluation of sequential learning approaches in complex social navigation scenarios with multiple entities including robot agents, human pedestrians, and dynamic obstacles.

Evaluation Framework

As part of the development team, I developed the evaluation framework for:

Research Integration

SocNavGym was integrated with:


11. Comparison with LiteSocNavGym

When to Use Which

Feature SocNavGym LiteSocNavGym
Simulation Speed Baseline 3-5x Faster
Visual Rendering Full Detail Lite
Core Dynamics Full Preserved
Use Case Final Evaluation Rapid Development
API Compatibility Full Compatible

Key Differences

SocNavGym:

LiteSocNavGym:


12. Limitations & Future Work

Current Limitations

Potential Extensions

Future Work


Used In:

Related Environments:

Comparison with Other Environments:


14. FAQ

Q: What is SocNavGym?

A: SocNavGym is a comprehensive social navigation gymnasium environment for evaluating social robot navigation algorithms. It provides full-featured social navigation scenarios with multiple entity types including robot agents, human pedestrians, static obstacles, and dynamic obstacles (see Technical Specifications section for details).

Q: How was SocNavGym used in your research?

A: SocNavGym was the primary environment for testing Predictive World Models (2StepAhead, MASPM) and validating Adaptive Prediction Horizons (see Research Impact section). Results were published in UKCI 2023 and used in my PhD thesis.

Q: What was your contribution to SocNavGym?

A: As part of the development team, I focused on reinforcement learning aspects, predictive model evaluation framework, performance benchmarking systems, and integration with proposed models (see My Contribution section).

Q: When should I use SocNavGym vs LiteSocNavGym?

A: Use SocNavGym for final evaluation, comprehensive testing, and when you need full visual rendering. Use LiteSocNavGym for rapid development, testing, and prototyping (see Comparison section).

Q: Is SocNavGym compatible with standard RL frameworks?

A: Yes, SocNavGym is compatible with standard reinforcement learning frameworks and works with Gymnasium.

Q: Where can I find the code?

A: The code is available on GitHub at: gnns4hri/SocNavGym


15. Citation & Resources

Citation

If you use SocNavGym in your research, please cite:

BibTeX:

@inproceedings{oguzie2023predictive,
  title={Predictive World Models for Social Navigation},
  author={Oguzie, Goodluck},
  booktitle={UK Conference on Intelligent Systems (UKCI 2023)},
  year={2023},
  organization={Aston University}
}

APA:

Oguzie, G. (2023). Predictive World Models for Social Navigation. 
In UK Conference on Intelligent Systems (UKCI 2023). Aston University.

Technologies: Python • Gymnasium • Reinforcement Learning • Social Navigation

GitHub Repository:

Related Projects:

Publications:

Research Applications:

← Back to Research Portfolio