Cross-platform, customizable ML solutions for live and streaming media.

[CVPR'23] Universal Instance Perception as Object Discovery and Retrieval

Teach-Repeat-Replan: A Complete and Robust System for Aggressive Flight in Complex Environments

Perception toolkit for sim2real training and validation in Unity

Visual SLAM/odometry package based on NVIDIA-accelerated cuVSLAM

⚡️The spatial perception framework for rapidly building smart robots and spaces

An open-source computer vision framework to build and deploy apps in minutes

An OpenAI gym wrapper for CARLA simulator

Platform for Situated Intelligence

LSD (LiDAR SLAM & Detection) is an open source perception architecture for autonomous vehicle/robotic

Modular autonomous driving platform running on the CARLA simulator and real-world vehicles.

Fast, efficient and accurate multi-resolution, multi-sensor 3D occupancy mapping

(CVPR 2022) A minimalist, mapless, end-to-end self-driving stack for joint perception, prediction, planning and control.

Notebook-based book "Introduction to Robotics and Perception" by Frank Dellaert and Seth Hutchinson

Simulations for TurtleBot3

[ECCV2024 Oral🔥] Official Implementation of "GiT: Towards Generalist Vision Transformer through Universal Language Interface"

Unity's privacy-preserving human-centric synthetic data generator

[ICRA 2022] CaTGrasp: Learning Category-Level Task-Relevant Grasping in Clutter from Simulation

A complete end-to-end demonstration in which we collect training data in Unity and use that data to train a deep neural network to predict the pose of a cube. This model is then deployed in a simulated robotic pick-and-place task.

Object detection / tracking / fusion based on Apollo r3.0.0 perception module in ROS