Tracking Objects with Point Clouds from Vision and Touch by Gregory Izatt and Geronimo Mirano and Edward Adelson and Russ Tedrake
We present an object-tracking framework that fuses
point cloud information from an RGB-D camera with tactile
information from a GelSight contact sensor. We propose that
GelSight can be treated as a source of dense local geometric
information, which we incorporate directly into a conventional
point-cloud-based articulated object tracker based on signed-
distance functions. Our implementation runs at 12 Hz using
an online depth reconstruction algorithm for GelSight and a
modified second-order update for the tracking algorithm. We
present data from hardware experiments demonstrating that the
addition of contact-based geometric information significantly improves the pose accuracy during contact, and provides robustness
to occlusions of small objects by the robotÂ’s end effector.
Supplemental materials:
https://www.youtube.com/watch?v=BIW_jq3dOEE
Under review. Comments welcome.
Planning robust walking motion on uneven terrain via convex optimization
by Hongkai Dai and Russ Tedrake
In this paper, we present a convex optimization problem to generate Center of Mass (CoM) and momentum trajectories of a walking robot, such that the motion robustly satisfies the friction cone constraints on uneven terrain. We adopt the Contact Wrench Cone (CWC) criterion to measure a robot's dynamical stability, which generalizes the venerable Zero Moment Point (ZMP) criterion. Unlike the ZMP criterion, which is ideal for walking on flat ground with unbounded tangential friction forces, the CWC criterion incorporates non-coplanar contacts with friction cone constraints. We measure the robustness of the motion using the margin in the Contact Wrench Cone at each time instance, which quantifies the capability of the robot to instantaneously resist external force/torque disturbance, without causing the foot to tip over or slide. For pre-specified footstep location and time, we formulate a convex optimization problem to search for robot linear and angular momenta that satisfy the CWC criterion. We aim to maximize the CWC margin to improve the robustness of the motion, and minimize the centroidal angular momentum (angular momentum about CoM) to make the motion natural. Instead of directly minimizing the non-convex centroidal angular momentum, we resort to minimizing a convex upper bound. We show that our CWC planner can generate motion similar to the result of the ZMP planner on flat ground with sufficient friction. Moreover, on an uneven terrain course with friction cone constraints, our CWC planner can still find feasible motion, while the outcome of the ZMP planner violates the friction limit.
Under review. Comments welcome.
Balance control using center of mass height variation: limitations imposed by unilateral contact
by Twan Koolen and Michael Posa and Russ Tedrake
Maintaining balance is fundamental to legged robots. The most commonly used mechanisms for balance control are taking a step, regulating the center of pressure (ankle strategies), and to a lesser extent, changing centroidal angular momentum (e.g., hip strategies). In this paper, we disregard these three mechanisms, instead focusing on a fourth: varying center of mass height. We study a 2D variable-height center of mass model, and analyze how center of mass height variation can be used to achieve balance, in the sense of convergence to a fixed point of the dynamics. In this analysis, we pay special attention to the constraint of unilateral contact forces. We first derive a necessary condition that must be satisfied to be able to achieve balance. We then present two control laws, and derive their regions of attraction in closed form. We show that one of the control laws achieves balance from any state satisfying the necessary condition for balance. Finally, we briefly discuss the relative importance of CoM height variation and other balance mechanisms.
Under review. Comments welcome.
Integrated Perception and Control at High Speed: Evaluating Collision Avoidance Maneuvers Without Maps
by Peter R. Florence and John Carter and Russ Tedrake
We present a method for robust high-speed quadrotor flight through unknown cluttered environments using a fast approximation of
collision probabilities. Motivated by experiments in which the difficulty of accurate state estimation was a primary limitati...
Under review. Comments welcome.
Localizing External Contact Using Proprioceptive Sensors: The Contact Particle Filter
by Lucas Manuelli and Russ Tedrake
In order for robots to interact safely and intelligently
with their environment they must be able to reliably
estimate and localize external contacts. This paper introduces
CPF, the Contact Particle Filter, which is a general algorithm
for detecting and localizing external contacts on rigid body
robots without the need for external sensing. CPF finds external
contact points that best explain the observed external joint
torque, and returns sensible estimates even when the external
torque measurement is corrupted with noise. We demonstrate
the capability of the CPF to track multiple external contacts
on a simulated Atlas robot, and compare our work to existing
approaches.
Supplemental materials:
http://youtu.be/ckvsMK0QhB0
Under review. Comments welcome.
May 13, 2016. PhD Defense. Ani Majumdar has successfully defended his PhD thesis. Congratulations Ani! Click on the link to watch his talk, and check the publications page to read his thesis.
February 24, 2016. Media. NOVA's documentary on the DARPA Robotics Challenge, titled "Rise of the Robots" is online now.
December 7, 2015. PhD Defense. Andy Barry has successfully defended his PhD thesis. Congratulations Andy! Click on the link to watch his talk.
November 18, 2015. In the news. NASA's R5 humanoid robot is coming to MIT. We're very excited to have the opportunity to do research on this amazing platform.
November 5, 2015. Award. Our DRC Team's continuous walking with stereo fusion paper just won the Best Paper Award (Oral) at Humanoids 2015. Congratulations all!
November 5, 2015. In the news. Andy's video of high-speed UAV obstacle avoidance (using only onboard processing) got some great coverage this week. This article by the IEEE Spectrum was particularly nice and insightful.
October 26, 2015. PhD Defense. Andres Valenzuela just successfully defended his PhD thesis. Congratulations Andres!
May 29, 2015. News. We're heading off to the DARPA Robotics Challenge. We've been posting some fun videos to our YouTube site (linked here). Wish us luck!
May 26, 2015. News. Benoit Landry has submitted his Masters Thesis on Aggressive Quadrotor Flight in Dense Clutter. Be sure to check out his cool video.
May 28, 2015. News. Scott Kuindersma has accepted a tenure-track position at Harvard starting this fall. Congratulations Scott!
November 20, 2014. Award. Robin Deits' paper on Mixed-integer optimization for footstep planning just won the Best Paper Award (Oral) at Humanoids 2014. Congratulations Robin!
December 31, 1969. Award. Benoit Landry has been awarded the 2014 Siebel Scholarship. Congratulations Benoit!
June 18, 2014. News. Ram Vasudevan has officially accepted a tenure-track position at the University of Michigan, Ann Arbor. Congratulations Ram! Go Blue!
June 16, 2014. News. Joe Moore has officially accepted a position at the Johns Hopkins Applied Phsyics Lab. Congratulations Joe!
May 27, 2014. PhD Defense. Joseph Moore officially defended his PhD. You can watch his defense on the group talks page. Congratulations Joe!
December 21, 2013. News. Team MIT advances to the next round in the DARPA Robotics Challenge.
October 2, 2013. Award. Michael Posa has been awarded the 2013 Rolf Locher Graduate Fellowship. Congratulations Michael!
September 14, 2013. News. The Robot Locomotion Group hosted the evening session of the 2014 Boston Barefoot Running Festival.
September 11, 2013. In the News. Tough robo-challenge casts robots as rescuers.
June 27, 2013. In the News. Team MIT Completes First Hurdle in DARPA Robotics Challenge.