Featured Projects

Robotics projects in perception, control, and autonomy

Depth driven exploration policy in unknown environments

THESIS

May 2026 to Present

Depth-only world model and exploration policy letting quadrotors navigate unknown environments without privileged information available only in simulation.

Key Achievements

  • Designs a depth-only recurrent model for autonomous UAV exploration in unknown environments, replacing privileged-information navigation baselines (time-of-arrival maps, differentiable-physics gradients) with an onboard-only depth-prediction pipeline
  • Built a GRU-based recurrent depth predictor fusing depth, proprioceptive state, action, and timestep inputs; skip-connected decoding cut test loss ~40%, and bidirectional training resolved a forward/reverse temporal asymmetry
PythonPyTorchROS 2World ModelsGRUHabitat-SimHM3D
World ModelsUAV NavigationDeep LearningSpatial Reasoning

MonoSense: Monocular Perception Pipeline

FEATURED

April 2026

MonoSense Demo Thumbnail
Click to play demo

Tesla-inspired end-to-end monocular perception pipeline for autonomous driving with 3D scene reconstruction and real-time visualization

Key Achievements

  • Trained custom YOLOv6 on BDD100K dataset achieving mAP50 of 0.564 for multi-class object detection
  • Integrated DepthAnythingV2 for metric depth estimation and FCOS3D for 3D vehicle pose estimation
  • Implemented UFLDv2 for lane detection with inverse perspective mapping
  • Built ego-motion estimation using RANSAC-based visual odometry
PythonPyTorchYOLOv6DepthAnythingV2FCOS3DUFLDv2BlenderSLURM
Computer VisionAutonomous DrivingDeep Learning3D ReconstructionGPU Computing

March to April 2026

Deep Visual Inertial Odometry

Deep learning VIO stack for UAVs with 6 fusion approaches on custom Blender rendered trajectories.

  • Implemented 6 VIO approaches: vision only (DeepVO style), AirIMU+AirIO, PRGFlow, PRGFlow+yaw, EKF loose fusion, cross attention tight fusion
  • Built vision only odometry using Siamese MobileNetV2 + correlation + LSTM for relative pose estimation
  • Integrated AirIMU (IMU correction) + AirIO (velocity prediction) + 15 state EKF for state estimation
PythonPyTorchBlenderEKFTransformersSLURM
Visual Inertial OdometrySensor FusionDeep LearningUAVState Estimation

April 2026

Imitation Learning for Robotic Stacking

Behavioral Cloning vs Diffusion Policy comparison for UR5e robotic stacking with keyboard teleoperation.

  • BC-Transformer reached 100% rollout success by epoch 950
  • Diffusion Policy reached 80% success by epoch 350, with non-zero success from as few as 5 demonstrations
  • Implemented BC Transformer and Diffusion Policy for UR5e robotic stacking task in robosuite simulator
PythonPyTorchrobosuiterobomimicUR5eDiffusion Models
Imitation LearningBehavioral CloningDiffusion PolicyRobotic Manipulation
Deep Reinforcement Learning for Robotic Picking

March 2026

Deep Reinforcement Learning for Robotic Picking

Implementation of deep RL algorithms (REINFORCE, Actor Critic, A3C) for robotic manipulation tasks.

  • Benchmarked REINFORCE, A2C, and A3C on LunarLander-v2; A2C reached mean reward 201.7 vs. 175.3 for REINFORCE, a 29% reduction in variance
  • Deployed A3C with a CNN actor-critic on PyBullet Kuka, reaching 31% grasp success over 100 episodes
PythonPyTorchPyBulletOpenAI GymA3CActor Critic
Reinforcement LearningDeep LearningRoboticsPolicy Gradient

February to March 2026

Structure from Motion and Neural Radiance Fields

Implemented classical Structure from Motion pipeline from scratch and trained Neural Radiance Fields for photorealistic 3D scene reconstruction.

  • Implemented complete SfM pipeline: RANSAC feature matching, 8 point fundamental matrix, essential matrix decomposition, cheirality based pose disambiguation, linear/nonlinear triangulation
  • Built PnP solver with RANSAC for camera registration from 2D to 3D correspondences
  • Reduced reprojection error by 36% (from 33.2 to 21.2 pixels) using sparse bundle adjustment
PythonOpenCVNumPyPyTorchCUDA
Computer Vision3D ReconstructionBundle AdjustmentNeural RenderingGPU Computing

August to December 2025

Franka Panda Grasping Pipeline

Built as part of directed research at WPI. The robot needed to pick waste objects off a moving conveyor belt and sort them. I integrated RealSense depth data with an antipodal grasping network in ROS 2 and handled singularities using a Jacobian based differential controller. Also replaced the existing Arduino conveyor controller with a Beckhoff TwinCAT PLC for real time determinism.

ROS 2 HumbleMoveIt2PythonFranka Emika PandaObject Detection

November to December 2025

Quadrotor Trajectory Control

Implemented PD and LQR controllers in PyBullet simulation, then validated on real Crazyflie 2.0 hardware. Performed system identification reducing sim to real RMSE from 4.8mm (simulation) to 0.8mm (real hardware), an 83% improvement. LQR controller maintained position error below 2cm on hardware. Also implemented polynomial trajectory generation for smooth 3D paths.

PythonCrazyflie 2.0PD ControlLQRTrajectory Planning