Joanne Truong

Email: truong dot j at gatech dot edu


Ph.D. in Robotics
2019 - 2024

B.S. Computer Engineering
2014 - 2019

About Me

I am a Research Scientist at Fundamental AI Research (FAIR) at Meta, working on Embodied AI. I am interested in working at the intersection of machine learning and robotics. My long-term research goal is to develop robots that are scalable, robust and capable of working in complex, real world environments.

I completed my Robotics Ph.D. at the Georgia Institute of Technology, advised by Dhruv Batra and Sonia Chernova. My PhD research was supported by the NSF Graduate Research Fellowship, Apple Scholars in AI/ML PhD Fellowship, Adobe Research Fellowship, and Google Women Techmakers Scholarship.

During my PhD, I was an intern at Apple, working with Walter Talbot, Miguel Angel Bautista, Alex Toshev, and Josh Susskind in 2023. In 2022, I was a student researcher at Google, working with Jie Tan, Wenhao Yu, and Tingnan Zhang. In 2021, I was an intern at NVIDIA, working with Clemens Eppner, Ankur Handa, and Dieter Fox. In 2020, I was an intern at FAIR (Meta), working with Akshara Rai.

As an undergrad, I worked in the Robotics and Intelligent Vehicles Research (RIVeR) lab at Northeastern University with Taskin Padir. During my time there, I competed at the 2019 RoboCup@Home competition in Sydney, Australia and the 2018 World Robot Summit in Tokyo, Japan.

I also had the pleasure of mentoring Max Rudolph (MS@GT -> UT Austin PhD Student), Simar Kareer (MS@GT -> GT PhD Student), and Marco Delgado (BS@GT).


Apple
Summer 2023

Google
Summer 2022

NVIDIA
Summer 2021

FAIR
Summer 2020


News


Research


IndoorSim-to-OutdoorReal: Learning to Navigate Outdoors without any Outdoor Experience
Joanne Truong, April Zitkovich, Sonia Chernova, Dhruv Batra, Tingnan Zhang, Jie Tan, Wenhao Yu
IROS 2024 & RA-L 2024 and
Taking Mobile Manipulators into the Real World RSS Workshop 2023
[Paper] [Project Page] [Bibtex]
[Blog Post]

Embodiment Randomization for Cross Embodiment Navigation
Pranav Putta, Gunjan Aggarwal, Roozbeh Mottaghi, Dhruv Batra, Naoki Yokoyama, Joanne Truong, Arjun Majumdar
IROS 2024

Adaptive Skill Coordination for Robotic Mobile Manipulation
Naoki Yokoyama, Alexander Clegg, Joanne Truong, Eric Undersander, Tsung-Yen Yang, Sergio Arnaud, Sehoon Ha, Dhruv Batra, Akshara Rai
ICRA 2024 & RA-L 2023 and
Sim-to-Real Robot Learning: Locomotion and Beyond CoRL Workshop 2022
[Paper] [Project Page] [Code] [Bibtex]

LSC: Language-guided Skill Coordination for Open-Vocabulary Mobile Pick-and-Place
Tsung-Yen Yang, Sergio Arnaud, Kavit Shah, Naoki Yokoyama, Alexander Clegg, Joanne Truong , Eric Undersander, Oleksandr Maksymets, Sehoon Ha, Mrinal Kalakrishnan, Roozbeh Mottaghi, Dhruv Batra, Akshara Rai
CVPR 2023 Demo Track and
CVPR Expo Meta AI Booth

[Poster] [Project Page] [Code]

Retrospectives on the Embodied AI Workshop
Matt Deitke, Dhruv Batra, ..., Joanne Truong, Luca Weihs, Jiajun Wu
[Paper] [Bibtex]

ViNL: Visual Navigation and Locomotion Over Obstacles
Simar Kareer*, Naoki Yokoyama*, Dhruv Batra, Sehoon Ha, Joanne Truong
ICRA 2023 and
Best Paper Award at Learning for Agile Robotics CoRL Workshop 2022

[Paper] [Project Page] [Code] [Bibtex]


Rethinking Sim2Real: Lower Fidelity Simulation Leads to Higher Sim2Real Transfer in Navigation
Joanne Truong, Max Rudolph, Naoki Yokoyama, Sonia Chernova, Dhruv Batra, Akshara Rai
CoRL 2022 and
Spotlight at Sim-to-Real Robot Learning: Locomotion and Beyond CoRL Workshop 2022

[Paper] [Project Page] [Code] [Bibtex] [Video]


Learning Navigation Skills for Legged Robots with Learned Robot Embeddings
Joanne Truong, Denis Yarats, Tianyu Li, Franziska Meier, Sonia Chernova, Dhruv Batra, Akshara Rai
IROS 2021
[Paper] [Bibtex]

Bi-directional Domain Adaptation for Sim2Real Transfer of Embodied Navigation Agents
Joanne Truong, Sonia Chernova, Dhruv Batra
ICRA & RA-L 2021
[Paper] [Bibtex]

Sim-to-Real Transfer for Vision-and-Language Navigation
Peter Anderson, Ayush Shrivastava, Joanne Truong, Arjun Majumdar, Devi Parikh, Dhruv Batra, Stefan Lee
CoRL 2020 and
Embodied Vision, Actions & Language
ECCV Workshop 2022

[Paper] [Bibtex]

Sim2Real Predictivity: Does Evaluation in Simulation Predict Real-World Performance?
Abhishek Kadian*, Joanne Truong*, Aaron Gokaslan, Alexander Clegg, Erik Wijmans, Stefan Lee, Manolis Savva, Sonia Chernova, Dhruv Batra
IROS & RA-L 2020 and
Closing the Reality Gap in Sim2Real Transfer for Robotics RSS Workshop 2020

[Paper] [Bibtex]

System Architecture for Autonomous Mobile Manipulation of Everyday Objects in Domestic Environments
Tarik Kelestemur, Naoki Yokoyama, Joanne Truong, Anas Abou Allaban, Taskin Padir
PETRA 2019
[Paper] [Bibtex]

2019 RoboCup@Home Sydney, Australia
Joanne Truong, Naoki Yokoyama, Taskin Padir

2018 World Robot Summit Tokyo, Japan
Joanne Truong , Naoki Yokoyama, Tarik Kelestemur, Anas Abou Allaban, Taskin Padir

TRI University Challenges Boston, MA
Joanne Truong , Naoki Yokoyama, Tarik Kelestemur, Taskin Padir