IARMasterclass
Course companion · 0 / 17

Lesson 14 · Book chapter pointer

Manipulation

Read the chapter source: manipulation.tex — do not treat this note as the book.

Learning goals

  • Tell a manipulation pipeline as perceive, grasp, move, release — with aborts.
  • Reuse inverse kinematics and Jacobian-transpose force as working tools, not memories.
  • Explain why pick-and-place is a planning problem in a changing scene.
  • Account for compliance: the world is not a perfect CAD constraint.
  • Know what “in hand” sensing is for after the fingers close.

Teaching note

Manipulation is where Parts I–III stop being chapters and start being a shift. You need a pose of an object (vision, features, maybe a net), a grasp that statics would bless, an arm trajectory that does not hit the table, and a release that does not topple the mug. Any one of those can be a paper. The teaching job is to keep the pipeline visible so students do not spend six weeks on a color threshold and call it manipulation.

Inverse kinematics returns for real: the grasp frame in the world must become joint angles, then a motion that respects limits and collisions. Jacobian-transpose control is a gentle way to press, insert, or follow a surface when you would rather command a force than a brittle pose. If the previous lessons felt abstract, this is their court date.

Pick-and-place is not “IK then open.” The object may move. The grasp you planned in the camera frame is stale after you reach. A human hand is in the workspace. You need the task-execution lesson: modes, timeouts, a reflex if contact comes early. Motion planning here is often in configuration space with a swept volume of the hand plus object — after the grasp, the robot changed shape.

Compliance is how you survive being wrong. A rigid position command into a slightly misplaced hole will either miss or bend something. A bit of give — a spring, a force loop, a guarded move along the table — turns geometry errors into slides. Industry learned this before academia was polite about it. Teach one guarded move: move down until force, then slide until a second force.

If the lab has no arm, mime the pipeline with a webcam and a human hand as the actuator, or use the mobile base to “place” a block into a taped square. The ideas travel. Then read the book chapter for the formal treatment this companion refuses to copy.

Key idea

Guarded move: follow \(\dot{p} = v_\text{cmd}\) until \(\|F\| > F_\text{thresh}\), then switch mode. Contact is an event, not a surprise.

Self-check

1. Why replan or re-sense after the grasp closes?
The object pose relative to the hand is now the thing that matters, and it may not match the pre-grasp plan. Also the swept body changed.
2. What does a guarded move give you that open-loop IK does not?
A success test from the world. You stop on contact instead of trusting that the table height in software is the table height in the room.
3. Is a perfect point cloud enough to pick?
No. You still need a grasp that can resist the task wrench and a motion that does not collide. Perception is one verb in the sentence.