Research Portfolio

My research focuses on Social Robot Navigation, Reinforcement Learning, and Action Recognition. Below are the environments I’ve created or contributed to, the models I’ve proposed, and applications I’ve developed.

Filter by Research Area:


PUBLISHED
IEEE PRML 2024

Cosine-Gated LSTM for Sequential Learning

2024 • Neural Network Architecture

Visual comparison of predictive performance in SocNavGym: CGLSTM (accurate predictions in blue), Transformer (high accuracy with some red inconsistencies), Vanilla LSTM (predominantly red, inaccurate), and GRU (inaccurate but slightly better than LSTM). Yellow represents current state.
Cosine-Gated LSTM architecture diagram

Novel Cosine-Gated LSTM architecture for improved sequential learning, outperforming LSTM, GRU, and Transformer models across multiple benchmarks.

View Paper →
PUBLISHED
UKCI 2023

Predictive World Models for Social Navigation

2023 • Reinforcement Learning

Predictive World Models architecture showing 2StepAhead and MASPM

Predictive models (2StepAhead, MASPM) for safe autonomous navigation, improving performance and reducing collisions in social environments.

View Paper →

Research Environments

DEVELOPED
COMPLETED

FallingBallEnv

2023 • Custom OpenAI Gym Environment

FallingBallEnv bounce-off visualization showing ball physics and bouncing behavior with prediction states

Simple environment where a ball falls and bounces, obeying gravity. The floor position is not included in the observation space, testing predictive capabilities.

Published in IEEE PRML 2024 • Validated CGLSTM architecture
View Details →
DEVELOPED
COMPLETED

LiteSocNavGym

2024 • Lightweight Social Navigation Environment

LiteSocNavGym environment output

Lite version of SocNavGym optimized for rapid iteration. 3-5x faster simulations while preserving core social navigation dynamics.

Used for Predictive World Models • Core dynamics preserved
View Details →
TEAM CONTRIBUTION
COMPLETED

SocNavGym

2020-2024 • Team Project • Supervisor: Dr. Luis J. Manso

SocNavGym episode metrics histograms comparing RVO2, DuelingDQN, SFM, WM DuelingDQN and 2StepAhead MASPM DuelingDQN algorithms

Comprehensive social navigation gymnasium environment for evaluating social robot navigation algorithms. Primary environment for testing Predictive World Models.

View Details →

Proposed Models & Algorithms

PROPOSED MODEL
PUBLISHED

Predictive World Models (2StepAhead & MASPM)

2023 • Published at UKCI 2023

Predictive World Models training results

Predictive world models giving agents short-horizon views of human movement. Three variants: 2StepAhead, MASPM, and fused 2StepAhead-MASPM.

0.67 reward achieved • Lower collisions • Faster convergence
View Architecture →
PROPOSED MODEL
PUBLISHED

Cosine-Gated LSTM

2024 • Published at IEEE PRML 2024

Cosine-Gated LSTM test results showing improved performance

LSTM architecture with cosine similarity gates prioritizing trajectory-aligned inputs. Superior sequence prediction across multiple benchmarks.

99.07% accuracy on MNIST • 35% lower MAE than Transformer
View Benchmarks →
PROPOSED MODEL
ONGOING

Adaptive Prediction Horizons

2024 - Present • Aston University

Adaptive Prediction Horizons comparison: Fixed vs Entropy-driven

Entropy-driven controller extending SAC + CGLSTM only when policy is uncertain. Cuts training time while preserving real-time inference budgets.

100% success rate • 5.62 days vs 28.41 days training
View Methodology →

Action Recognition Research

PROPOSED PROJECT
ONGOING

Wi-Fi CSI Action Recognition with ESP32

2024 - Present • Hardware-based Action Recognition

Developing action recognition systems using Wi-Fi Channel State Information (CSI) with ESP32 microcontrollers for privacy-preserving human action prediction.

View System Design →

MSc Project

COMPLETED

Multifunctional Autonomous Mobile Robot

January 2019 – May 2019 • Sheffield Hallam University • MSc Merit

Dissertation supervised by Dr Lyuba Alboul. A physical wheeled Hummer bot on an Arduino UNO with an L298N motor driver. Tested infrared obstacle avoidance, ultrasonic obstacle avoidance, line following, and wireless control by infrared remote and Bluetooth. The controller used sensor thresholds and timed motor commands. Mark 63.

Read the project →

PhD Thesis

COMPLETED

PhD Thesis: Enhancing Robot Social Navigation

2020 - 2025 • Aston University

PhD Thesis results: Average return vs inference time for various models

Completed PhD thesis integrating all three proposed models into a comprehensive framework: Predictive World Models, Cosine-Gated LSTM, and Adaptive Prediction Horizons. Successfully defended with 2 conference papers published (UKCI 2023, IEEE PRML 2024).

Read Thesis Summary →

Note: For complete work experience and previous positions, please visit the About or CV page.