Abstract

This paper presents the design of a light-weight, compliant end-effector and an image processing strategy that together enable the Interacting-BoomCopter (I-BC) unmanned aerial vehicle (UAV) to perform an autonomous door-opening task. Autonomy is achieved through the use of feedback from an onboard camera for door detection & localization, and embedded force and distance sensors in the end-effector for detecting the physical interaction with the door. The results of several experimental flight tests are presented in which the end-effector and image processing strategy were deployed on the I-BC to successfully open a small enclosure door autonomously.

References

1.
Papachristos
,
C.
,
Alexis
,
K.
, and
Tzes
,
A.
,
2014
, “
Efficient Force Exertion for Aerial Robotic Manipulation: Exploiting the Thrust-Vectoring Authority of a Tri-Tiltrotor UAV
,”
Proceedings of the IEEE ICRA
,
Hong Kong, China
,
May 31–June 5
, pp.
4500
4505
.
2.
Oosedo
,
A.
,
Abiko
,
S.
,
Narasaki
,
S.
,
Kuno
,
A.
,
Konno
,
A.
, and
Uchiyama
,
M.
,
2015
, “
Flight Control Systems of a Quad Tilt Rotor Unmanned Aerial Vehicle for a Large Attitude Change
,”
Proceedings of the IEEE ICRA
,
Seattle, WA
,
May 26–30
, pp.
2326
2331
.
3.
Albers
,
A.
,
Trautmann
,
S.
,
Howard
,
T.
,
Nguyen
,
T. A.
,
Frietsch
,
M.
, and
Sauter
,
C.
,
2010
, “
Semi-Autonomous Flying Robot for Physical Interaction With Environment
,”
Proceedings of the IEEE Conference on RAM
,
Singapore
,
June 28–29
, pp.
441
446
.
4.
Jiang
,
G.
, and
Voyles
,
R.
,
2013
, “
Hexrotor UAV Platform Enabling Dextrous Interaction With Structures-Flight Test
,”
Proceedings of the IEEE International SSRR, Linköping
,
Sweden
,
Oct. 21–26
, pp.
1
6
.
5.
Ryll
,
M.
,
Muscio
,
G.
,
Pierri
,
F.
,
Cataldi
,
E.
,
Antonelli
,
G.
,
Caccavale
,
F.
, and
Franchi
,
A.
,
2017
, “
6D Physical Interaction With a Fully Actuated Aerial Robot
,”
Proceedings of the IEEE ICRA
,
Singapore
,
May 29–June 3
, pp.
5190
5195
.
6.
Brescianini
,
D.
, and
Andrea
,
R. D.
,
2016
, “
Design, Modeling and Control of an Omni-Directional Aerial Vehicle
,”
Proceedings of the IEEE ICRA
,
Stockholm, Sweden
,
May 16–21
, pp.
3261
3266
.
7.
Park
,
S.
,
Her
,
J.
,
Kim
,
J.
, and
Lee
,
D.
,
2016
, “
Design, Modeling and Control of Omni-Directional Aerial Robot
,”
Proceedings of the IEEE/RSJ IROS, Daejeon
,
Korea
,
Oct. 9–14
, pp.
1570
1575
.
8.
Long
,
Y.
,
Wang
,
L.
, and
Cappelleri
,
D. J.
,
2014
, “
Modeling and Global Trajectory Tracking Control for An Over-Actuated MAV
,”
Adv. Rob.
,
28
(
3
), pp.
145
155
. 10.1080/01691864.2013.861339
9.
Fumagalli
,
M.
,
Naldi
,
R.
,
Macchelli
,
A.
,
Forte
,
F.
,
Keemink
,
A. Q. L.
,
Stramigioli
,
S.
,
Carloni
,
R.
, and
Marconi
,
L.
,
2014
, “
Developing an Aerial Manipulator Prototype: Physical Interaction With the Environment
,”
IEEE Rob. Autom. Mag.
,
21
(
3
), pp.
41
50
. 10.1109/MRA.2013.2287454
10.
Alexis
,
K.
,
Darivianakis
,
G.
,
Burri
,
M.
, and
Siegwart
,
R.
,
2016
, “
Aerial Robotic Contact-Based Inspection: Planning and Control
,”
Auton. Rob.
,
40
(
4
), pp.
631
655
. 10.1007/s10514-015-9485-5
11.
Bartelds
,
T.
,
Capra
,
A.
,
Hamaza
,
S.
,
Stramigioli
,
S.
, and
Fumagalli
,
M.
,
2016
, “
Compliant Aerial Manipulators: Toward a New Generation of Aerial Robotic Workers
,”
IEEE Rob. Autom. Lett.
,
1
(
1
), pp.
477
483
. 10.1109/LRA.2016.2519948
12.
Jimenez-Cano
,
A. E.
,
Braga
,
J.
,
Heredia
,
G.
, and
Ollero
,
A.
,
2015
, “
Aerial Manipulator for Structure Inspection by Contact From the Underside
,”
Proceedings of the IEEE/RSJ IROS, Hamburg
,
Germany
,
Sept. 28–Oct. 2
, pp.
1879
1884
.
13.
Mellinger
,
D.
,
Lindsey
,
Q.
,
Shomin
,
M.
, and
Kumar
,
V.
,
2011
, “
Design, Modeling, Estimation and Control for Aerial Grasping and Manipulation
,”
Proceedings of the IEEE/RSJ IROS
,
San Fransisco, CA
,
Sept. 25–30
, pp.
2668
2673
.
14.
Augugliaro
,
F.
,
Mirjan
,
A.
,
Gramazio
,
F.
,
Kohler
,
M.
, and
D’Andrea
,
R.
,
2013
, “
Building Tensile Structures With Flying Machines
,”
Proceedings of the IEEE/RSJ IROS
,
Tokyo, Japan
,
Nov. 3–7
, pp.
3487
3492
.
15.
Huber
,
F.
,
Kondak
,
K.
,
Krieger
,
K.
,
Sommer
,
D.
,
Schwarzbach
,
M.
,
Laiacker
,
M.
,
Kossyk
,
I.
,
Parusel
,
S.
,
Haddadin
,
S.
, and
Albu-Schäffer
,
A.
,
2013
, “
First Analysis and Experiments in Aerial Manipulation Using Fully Actuated Redundant Robot Arm
,”
Proceedings of the IEEE/RSJ IROS
,
Tokyo, Japan
,
Nov. 3–7
, pp.
3452
3457
.
16.
Orsag
,
M.
,
Korpela
,
C.
,
Bogdan
,
S.
, and
Oh
,
P.
,
2017
, “
Dexterous Aerial Robots—Mobile Manipulation Using Unmanned Aerial Systems
,”
IEEE Trans. Rob.
,
33
(
6
), pp.
1
14
. 10.1109/TRO.2017.2750693
17.
Kamel
,
M.
,
Alexis
,
K.
, and
Siegwart
,
R.
,
2016
, “
Design and Modeling of Dexterous Aerial Manipulator
,”
Proceedings of the IEEE/RSJ IROS
,
Daejeon, Korea
,
Oct. 9–14
, pp.
4870
4876
.
18.
Pounds
,
P. E.
,
Bersak
,
D. R.
, and
Dollar
,
A. M.
,
2011
, “
Grasping From the Air: Hovering Capture and Load Stability
,”
Proceedings of the IEEE ICRA
,
Shanghai, China
,
May 9–13
, pp.
2491
2498
.
19.
Mellinger
,
D.
,
Shomin
,
M.
,
Michael
,
N.
, and
Kumar
,
V.
,
2013
, “Cooperative Grasping and Transport Using Multiple Quadrotors,”
Distributed Autonomous Robotic Systems
,
A.
Martinoli
,
F.
Mondada
,
N.
Correll
,
G.
Mermoud
,
M.
Egerstedt
,
M.
Ani Hsieh
,
L. E.
Parker
, and
K.
Støy
, eds.,
Springer Tracts in Advanced Robotics
, vol.
83
,
Springer
,
Berlin, Heidelberg
, pp.
545
558
.
20.
Gawel
,
A.
,
Kamel
,
M.
,
Novkovic
,
T.
,
Widauer
,
J.
,
Schindler
,
D.
,
von Altishofen
,
B. P.
,
Siegwart
,
R.
, and
Nieto
,
J.
,
2017
, “
Aerial Picking and Delivery of Magnetic Objects With MAVS
,”
Proceedings of the IEEE ICRA
,
Singapore
,
May 29–June 3
, pp.
5746
5752
.
21.
Pereira
,
P. O.
, and
Dimarogonas
,
D. V.
,
2017
, “
Stability of Load Lifting by a Quadrotor Under Attitude Control Delay
,”
Proceedings of the IEEE ICRA
,
Singapore
,
May 29–June 3
, pp.
3287
3292
.
22.
McArthur
,
D. R.
,
Chowdhury
,
A. B.
, and
Cappelleri
,
D. J.
,
2017
, “
Design of the I-Boomcopter UAV for Environmental Interaction
,”
Proceedings of the IEEE ICRA
,
Singapore
,
May 29–June 3
, pp.
5209
5214
.
23.
McArthur
,
D. R.
,
Chowdhury
,
A. B.
, and
Cappelleri
,
D. J.
,
2018
, “
Design of the Interacting-BoomCopter Unmanned Aerial Vehicle for Remote Sensor Mounting
,”
ASME J. Mech. Rob.
,
10
(
2
), p.
025001
. 10.1115/1.4038973
24.
McArthur
,
D. R.
,
Chowdhury
,
A. B.
, and
Cappelleri
,
D. J.
,
2018
, “
Autonomous Control of the Interacting-BoomCopter UAV for Remote Sensor Mounting
,”
Proceedings of the IEEE ICRA
,
Brisbane, Australia
,
May 21–26
, pp.
5219
5224
.
25.
Dalal
,
N.
, and
Triggs
,
W.
,
2005
, “
Histograms of Oriented Gradients for Human Detection
,”
Proceedings of the IEEE Computer Society Conference on CVPR
,
San Diego, CA
,
June 20–25
, Vol.
1
, pp.
886
893
.
You do not currently have access to this content.