Tao Jin

I am a third-year Ph.D. candidate in Electrical and Computer Engineering at Carnegie Mellon University (CMU), advised by Prof. Anthony Rowe in WiseLab. My current research interest is in designing Mixed / eXtended Reality (MR/XR) systems that combine sensing, localization, and edge computing to make 3D telepresence accessible. You can find my CV here.

Previousely, I obtained my Bachelor of Science degree in Electrical Engineering at the University of Washington in Seattle (UW). During my time at UW, I worked on Assistive Robots with Prof. Siddhartha Srinivasa in the Personal Robotics Lab. I worked at Magic Leap in 2022 as a Research Intern, hosted by Connor Smith.

Publications

DART: Implicit Doppler Tomography for Radar Novel View Synthesis

Tianshu Huang* , John Miller* , Akarsh Prabhakara , Tao Jin, Tarana Laroia , Zico Kolter , and Anthony Rowe

In The Conference on Computer Vision and Pattern Recognition (CVPR) , 2024

Paper Video Website BibTex

@inproceedings{dart,
  title = {DART: Implicit Doppler Tomography for Radar Novel View Synthesis},
  author = {Huang*, Tianshu and Miller*, John and Prabhakara, Akarsh and Jin, Tao and Laroia, Tarana and Kolter, Zico and Rowe, Anthony},
  booktitle = {The Conference on Computer Vision and Pattern Recognition (CVPR)},
  year = {2024},
}

MeshReduce: Scalable and Bandwidth Efficient 3D Scene Capture

Tao Jin, Mallesham Dasari , Connor Smith , Kittipat Apicharttrisorn , Srinivasan Seshan , and Anthony Rowe

In 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR) , 2024

Paper Short Vid Video BibTex

@inproceedings{meshreduce,
  title = {MeshReduce: Scalable and Bandwidth Efficient 3D Scene Capture},
  author = {Jin, Tao and Dasari, Mallesham and Smith, Connor and Apicharttrisorn, Kittipat and Seshan, Srinivasan and Rowe, Anthony},
  booktitle = {2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)},
  year = {2024},
  organization = {IEEE},
  video_short = {https://www.youtube.com/embed/IfPKjP4ZYmY?si=N2BpCG9tli1eQfht},
}

StageAR: Markerless Mobile Phone Localization for AR in Live Events

Tao Jin, Shengxi Wu , Mallesham Dasari , Kittipat Apicharttrisorn , and Anthony Rowe

In 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR) , 2024

Paper Video BibTex

@inproceedings{stagear,
  title = {StageAR: Markerless Mobile Phone Localization for AR in Live Events},
  author = {Jin, Tao and Wu, Shengxi and Dasari, Mallesham and Apicharttrisorn, Kittipat and Rowe, Anthony},
  booktitle = {2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)},
  year = {2024},
  organization = {IEEE},
}

High resolution point clouds from mmWave radar

Akarsh Prabhakara , Tao Jin, Arnav Das , Gantavya Bhatt , Lilly Kumari , Elahe Soltanaghai , Jeff Bilmes , Swarun Kumar , and Anthony Rowe

In 2023 IEEE International Conference on Robotics and Automation (ICRA) , 2023

Paper Video Code Poster Slides BibTex

@inproceedings{prabhakara2023high,
  title = {High resolution point clouds from mmWave radar},
  author = {Prabhakara, Akarsh and Jin, Tao and Das, Arnav and Bhatt, Gantavya and Kumari, Lilly and Soltanaghai, Elahe and Bilmes, Jeff and Kumar, Swarun and Rowe, Anthony},
  booktitle = {2023 IEEE International Conference on Robotics and Automation (ICRA)},
  pages = {4135--4142},
  year = {2023},
  organization = {IEEE},
}

Demos

VRW

MeshReduce: Split Rendering of Live 3D Scene for Virtual Teleportation

Tao Jin, Edward Lu , Mallesham Dasari , Kittipat Apicharttrisorn , Srinivasan Seshan , and Rowe Anthony

In 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) , 2024

Paper Video BibTex

@inproceedings{meshreduce_demo,
  title = {MeshReduce: Split Rendering of Live 3D Scene for Virtual Teleportation},
  author = {Jin, Tao and Lu, Edward and Dasari, Mallesham and Apicharttrisorn, Kittipat and Seshan, Srinivasan and Anthony, Rowe},
  booktitle = {2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)},
  year = {2024},
  organization = {IEEE},
}

Mobicom

RadarHD: Demonstrating Lidar-like Point Clouds from mmWave Radar

Akarsh Prabhakara , Tao Jin, Arnav Das , Gantavya Bhatt , Lilly Kumari , Elahe Soltanaghai , Jeff Bilmes , Swarun Kumar , and Anthony Rowe

In Proceedings of the 29th Annual International Conference on Mobile Computing and Networking , 2023

Paper BibTex

@inproceedings{prabhakara2023radarhd,
  title = {RadarHD: Demonstrating Lidar-like Point Clouds from mmWave Radar},
  author = {Prabhakara, Akarsh and Jin, Tao and Das, Arnav and Bhatt, Gantavya and Kumari, Lilly and Soltanaghai, Elahe and Bilmes, Jeff and Kumar, Swarun and Rowe, Anthony},
  booktitle = {Proceedings of the 29th Annual International Conference on Mobile Computing and Networking},
  pages = {1--3},
  year = {2023},
}

Sensys

Live 3D Scene Capture for Virtual Teleportation

Tao Jin, Mallesham Dasari , Connor Smith , Kittipat Apicharttrisorn , Anthony Rowe , and Srinivasan Seshan

In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems , 2022

Paper BibTex

@inproceedings{jin2022live,
  title = {Live 3D Scene Capture for Virtual Teleportation},
  author = {Jin, Tao and Dasari, Mallesham and Smith, Connor and Apicharttrisorn, Kittipat and Rowe, Anthony and Seshan, Srinivasan},
  booktitle = {Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems},
  pages = {774--775},
  year = {2022},
}

Teaching

Teaching Assistant at Carnegie Mellon University

18-453: Introduction to XR Systems, Fall 2023
18-449/649: Distributed Embedded Systems, Spring 2022
18-500: ECE Design Experience, Fall 2021, Spring 2021

Teaching Assistant at University of Washington

EE/CSE 474: Introduction to Embedded Systems, Summer 2019 - Spring 2020