Exp-Force: Experience-Conditioned Pre-Grasp
Force Selection with Vision-Language Models

Accurate pre-contact grasp force selection is critical for safe and reliable robotic manipulation. Adaptive controllers regulate force after contact but still require a reasonable initial estimate. Starting a grasp with too little force requires reactive adjustment, while starting a grasp with too high a force risks damaging fragile objects. This trade-off is particularly challenging for compliant grippers, whose contact mechanics are difficult to model analytically.

We propose Exp-Force, an experience-conditioned framework that predicts the minimum feasible grasping force from a single RGB image. The method retrieves a small set of relevant prior grasping experiences and conditions a vision–language model on these examples for in-context inference, without analytic contact models or manually designed heuristics.

On 129 object instances, Exp-Force achieves a best-case MAE of 0.43 N, reducing error by 72% over zero-shot inference. In real-world tests on 30 unseen objects, it improves appropriate force selection rate from 63% to 87%. These results demonstrate that Exp-Force enables reliable and generalizable pre-grasp force selection by leveraging prior interaction experiences.

Overview Video


Zero-shot vs Exp-Force

Cheez-It Box

Champagne Glass


Grasping Fragile and Light Objects


Grasping Fragile and Heavy Objects


Grasping Bottle and Odd Objects


Dataset

The dataset contains 129 object instances used to study pre-grasp force prediction. Each entry includes the object image, its measured mass in grams, and the minimum feasible grasping force in newtons. Expand the table below to browse the full dataset and inspect each object image directly. Click any thumbnail to enlarge it without leaving the page.

View full dataset (129 objects)
Image Object Mass [g] Grasp Force [N]
Black chocolate candy ball Black chocolate candy ball 11.0 0.25
Pringles can Pringles can 202.0 1.5
Spam canned meat Spam canned meat 368.0 2.5
Orange drinking straw Orange drinking straw 1.0 0.25
Small paper cup Small paper cup 2.0 0.25
Medium paper cup Medium paper cup 11.0 0.25
Medium plastic cup Medium plastic cup 10.0 0.25
Blueberry jam jar (Empty) Blueberry jam jar (Empty) 145.0 0.75
Small lime Small lime 42.0 0.5
Supplement bottle: Fish oil Supplement bottle: Fish oil 193.0 2.0
Supplement bottle: CoQ10 Supplement bottle: CoQ10 105.0 1.5
Seaweed snack package Seaweed snack package 27.0 0.5
Marshmallow 1 (regular) Marshmallow 1 (regular) 6.0 0.25
Power adapter Power adapter 309.0 5.0
Tabletop mobile phone stand Tabletop mobile phone stand 154.0 2.0
Monster Energy drink (zero) Monster Energy drink (zero) 489.0 1.75
Red Bull can (355 ml) Red Bull can (355 ml) 385.0 2.5
Multivitamin bottle (One A Day) Multivitamin bottle (One A Day) 216.0 2.0
Green power bank Green power bank 201.0 2.0
Roma tomato 1 Roma tomato 1 89.0 2.0
Roma tomato 2 Roma tomato 2 79.0 2.0
Grapefruit Grapefruit 396.0 2.0
Lemon Lemon 105.0 0.5
Apple (organic) Apple (organic) 297.0 1.5
Yellow mini bell pepper (large) Yellow mini bell pepper (large) 45.0 1.0
Strawberry 1 Strawberry 1 41.0 0.5
Cara Cara orange 1 Cara Cara orange 1 162.0 1.5
Cara Cara orange 2 Cara Cara orange 2 168.0 1.5
Orange 1 Orange 1 237.0 1.5
Mandarin 2 Mandarin 2 96.0 1.0
Lime 2 Lime 2 74.0 1.0
Red grape 1 Red grape 1 7.0 0.5
Red grape 2 Red grape 2 9.0 0.5
Blue drinking straw Blue drinking straw 1.0 0.25
Yellow drinking straw Yellow drinking straw 1.0 0.25
Blackberry 2 Blackberry 2 4.0 0.25
White chocolate candy ball White chocolate candy ball 10.0 0.25
Pocky snack box (Long-edge orientation) Pocky snack box (Long-edge orientation) 88.0 1.0
Oreo Thin cookie pack Oreo Thin cookie pack 7.0 0.25
Single Pringles potato chip Single Pringles potato chip 2.0 0.25
Glass whiskey cup Glass whiskey cup 278.0 1.5
H-E-B Texas steak seasoning H-E-B Texas steak seasoning 181.0 1.0
7UP Tropical soda (zero) 7UP Tropical soda (zero) 373.0 2.0
Diet Coke can Diet Coke can 370.0 2.0
Pringles can (side orientation) Pringles can (side orientation) 134.0 3.0
Sweet bean paste (regular) Sweet bean paste (regular) 338.0 2.0
Protein shaker bottle Protein shaker bottle 130.0 2.0
Marshmallow 2 (regular) Marshmallow 2 (regular) 4.0 0.25
Marshmallow 3 (regular) Marshmallow 3 (regular) 6.0 0.25
TV remote control TV remote control 91.0 1.0
5V power adapter 5V power adapter 51.0 1.0
Magic tape roll Magic tape roll 33.0 2.0
Peeler Peeler 36.0 5.0
Skippy creamy peanut butter Skippy creamy peanut butter 508.0 1.75
Goodbye Stress gummies (42 count) Goodbye Stress gummies (42 count) 150.0 0.75
Banana Banana 206.0 1.0
Barbasol shaving cream (aloe) Barbasol shaving cream (aloe) 279.0 1.0
Sticky lint roller Sticky lint roller 99.0 1.25
Crest 3D White toothpaste (box) Crest 3D White toothpaste (box) 127.0 2.0
Large brown egg Large brown egg 64.0 0.5
Large white egg Large white egg 62.0 0.5
Olly Sleep Melatonin Gummies Olly Sleep Melatonin Gummies 286.0 3.0
Gatsby hair wax Gatsby hair wax 112.0 1.25
Green pear Green pear 237.0 1.5
Large lemon Large lemon 181.0 0.75
Golden apple Golden apple 238.0 1.5
Red apple 1 Red apple 1 231.0 1.5
Green apple Green apple 282.0 1.5
Red apple 2 (large) Red apple 2 (large) 387.0 2.0
Mini bell pepper 1 Mini bell pepper 1 23.0 0.5
Mini bell pepper 2 Mini bell pepper 2 17.0 0.5
Mini bell pepper 3 Mini bell pepper 3 15.0 0.5
Strawberry 2 Strawberry 2 40.0 0.5
Strawberry (large) Strawberry (large) 64.0 1.0
Mandarins Mandarins 88.0 1.0
Red grape 3 Red grape 3 8.0 0.5
Green grape 1 Green grape 1 11.0 0.5
Green grape 2 Green grape 2 15.0 0.5
Green grape 3 Green grape 3 8.0 0.5
Red grape tomato 1 Red grape tomato 1 18.0 0.5
Red grape tomato 2 Red grape tomato 2 11.0 0.5
Green grape tomato 1 Green grape tomato 1 13.0 0.5
Yellow grape tomato Yellow grape tomato 10.0 0.5
Green grape tomato 2 Green grape tomato 2 11.0 0.5
Green grape tomato 3 Green grape tomato 3 11.0 0.5
Blueberry Blueberry 1.0 0.25
Raspberry Raspberry 4.0 0.25
Blackberry 1 Blackberry 1 5.0 0.25
Sunkist Orange soda (zero) Sunkist Orange soda (zero) 370.0 2.0
Muffin mix box Muffin mix box 612.0 2.0
Cheez-It crackers box Cheez-It crackers box 236.0 2.0
CeraVe Moisturizing Lotion CeraVe Moisturizing Lotion 395.0 2.25
Yellow mustard bottle Yellow mustard bottle 439.0 3.25
H-E-B Pink Salt refill H-E-B Pink Salt refill 423.0 2.5
Tomato soup can Tomato soup can 349.0 2.5
H-E-B Vitamins Melatonin 5 mg Gummies - Strawberry H-E-B Vitamins Melatonin 5 mg Gummies - Strawberry 394.0 1.5
Nutella jar Nutella jar 416.0 2.0
Morton salt container Morton salt container 794.0 4.5
Monster Energy drink Monster Energy drink 511.0 2.0
StarKist tuna can StarKist tuna can 175.0 1.5
Duct tape roll Duct tape roll 123.0 1.0
Red apple 3 Red apple 3 220.0 2.0
Orange 2 Orange 2 273.0 2.0
OxiClean container (12 oz) OxiClean container (12 oz) 413.0 3.0
Clorox toilet bleach cleaner bottle Clorox toilet bleach cleaner bottle 801.0 3.25
OxiClean stain remover (21.5 oz) OxiClean stain remover (21.5 oz) 733.0 5.0
Head & Shoulders shampoo bottle Head & Shoulders shampoo bottle 431.0 2.0
Glass Coca-Cola bottle Glass Coca-Cola bottle 635.0 2.5
Small bean paste tub Small bean paste tub 337.0 2.0
Pocky snack box (Short-edge orientation) Pocky snack box (Short-edge orientation) 89.0 1.0
Granulated sugar (32 oz) Granulated sugar (32 oz) 961.0 3.5
Little Debbie Swiss Rolls box Little Debbie Swiss Rolls box 641.0 2.0
Toothpaste box Toothpaste box 133.0 1.5
Red plastic cup Red plastic cup 14.0 0.25
Plastic shot cup (2 oz) Plastic shot cup (2 oz) 2.0 0.25
Glass tumbler Glass tumbler 286.0 1.5
Margarita glass Margarita glass 274.0 1.0
Champagne glass Champagne glass 204.0 1.0
Wine glass Wine glass 245.0 1.0
Ceramic mug Ceramic mug 424.0 1.5
Plastic mug Plastic mug 83.0 1.0
Large marshmallow Large marshmallow 21.0 0.25
Sweet bean paste (28oz) Sweet bean paste (28oz) 869.0 3.5
OnePlus Phone Charger Adapter OnePlus Phone Charger Adapter 70.0 1.5
Generic Phone Charger Adapter Generic Phone Charger Adapter 30.0 1.0
Apple MacBook Power Adapter Apple MacBook Power Adapter 280.0 1.75
Generic AC Power Adapter Generic AC Power Adapter 305.0 2.5
Umbrella (Folded) Umbrella (Folded) 225.0 1.5
Handheld Power Drill Handheld Power Drill 1384.0 7.0