<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Baxter |</title><link>https://www.ugr.es/~cvrlab/tags/baxter/</link><atom:link href="https://www.ugr.es/~cvrlab/tags/baxter/index.xml" rel="self" type="application/rss+xml"/><description>Baxter</description><generator>HugoBlox Kit (https://hugoblox.com)</generator><language>en-us</language><lastBuildDate>Fri, 27 Apr 2018 00:00:00 +0000</lastBuildDate><image><url>https://www.ugr.es/~cvrlab/media/icon_hu_138e5d72c01fd19a.png</url><title>Baxter</title><link>https://www.ugr.es/~cvrlab/tags/baxter/</link></image><item><title>Real-time clustering and tracking for event-based sensors</title><link>https://www.ugr.es/~cvrlab/projects/neuro_clusteringiros/</link><pubDate>Fri, 27 Apr 2018 00:00:00 +0000</pubDate><guid>https://www.ugr.es/~cvrlab/projects/neuro_clusteringiros/</guid><description>&lt;p&gt;This package implements a clustering and tracking using Kalman filters for DVS data (event based camera).&lt;/p&gt;
&lt;h2 id="getting-started"&gt;Getting Started&lt;/h2&gt;
&lt;p&gt;Clone or download the project. After that, first source your &lt;em&gt;ROS distro&lt;/em&gt; files:&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" class="chroma"&gt;&lt;code class="language-fallback" data-lang="fallback"&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt;$ source /opt/ros/&amp;lt;your_distro&amp;gt;/setup.bash
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;And follow the next files to compile the package:&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" class="chroma"&gt;&lt;code class="language-fallback" data-lang="fallback"&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt;$ mkdir -p ~/dvs_clustering_tracking/src
&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt;$ cd ~/dvs_clustering_tracking/
&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt;$ catkin_make
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;After this, you will have a copy of the project for testing.&lt;/p&gt;
&lt;h3 id="prerequisites"&gt;Prerequisites&lt;/h3&gt;
&lt;p&gt;In order to install the project, you will need a ROS distribution running in your platform. This project was developed and tested using &lt;em&gt;kinetic&lt;/em&gt;. See more about the installation and tutorial examples in the
.&lt;/p&gt;
&lt;h3 id="installing"&gt;Installing&lt;/h3&gt;
&lt;p&gt;In order to install all the dependencies you will have to install:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;
: where you will require &lt;code&gt;dvs_ros_driver&lt;/code&gt;(and then &lt;code&gt;dvs_driver&lt;/code&gt;), &lt;code&gt;dvs_msgs&lt;/code&gt;, &lt;code&gt;dvs_renderer&lt;/code&gt;, &lt;code&gt;libcaer_catkin&lt;/code&gt; (and then &lt;code&gt;libcaer&lt;/code&gt;)&lt;/li&gt;
&lt;li&gt;
&lt;/li&gt;
&lt;/ul&gt;
&lt;h2 id="running-the-tests"&gt;Running the tests&lt;/h2&gt;
&lt;p&gt;After the compiling the project code, source the &lt;em&gt;setup.bash&lt;/em&gt; file&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" class="chroma"&gt;&lt;code class="language-fallback" data-lang="fallback"&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt;:~/dvs_clustering_tracking$ source devel/setup.bash
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;Next, we will show two examples for running some of the tests:&lt;/p&gt;
&lt;h3 id="running-the-dvs_renderer"&gt;Running the dvs_renderer&lt;/h3&gt;
&lt;p&gt;If you do not have the DVS camera and want to run a file, simply run:&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" class="chroma"&gt;&lt;code class="language-fallback" data-lang="fallback"&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt;:~/dvs_clustering_tracking$ rosbag play ~/bagfiles/shapes_rotation.bag -l
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;where in &lt;code&gt;~/bagfiles&lt;/code&gt; we have the rosbag file with dvs events ([rosbag files dataset] (
))&lt;/p&gt;
&lt;p&gt;Or, if you have your own camera, just run in a different console (you&amp;rsquo;ll need to source again the setup.bash files in this new console):&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" class="chroma"&gt;&lt;code class="language-fallback" data-lang="fallback"&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt;$ roslaunch dvs_renderer dvs_mono.launch
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;h3 id="running-dvs_meanshift"&gt;Running dvs_meanshift&lt;/h3&gt;
&lt;p&gt;In case there is no attached DVS, just run the same rosbag example:&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" class="chroma"&gt;&lt;code class="language-fallback" data-lang="fallback"&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt;:~/dvs_clustering_tracking$ rosbag play ~/bagfiles/shapes_rotation.bag -l
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;where in &lt;code&gt;~/bagfiles&lt;/code&gt; we have the rosbag file with dvs events ([rosbag files dataset] (
))&lt;/p&gt;
&lt;p&gt;Then, run in a different console (you&amp;rsquo;ll need to source again the &lt;em&gt;setup.bash&lt;/em&gt; files in this new console):&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" class="chroma"&gt;&lt;code class="language-fallback" data-lang="fallback"&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt;$ roslaunch dvs_meanshift dvs_segmentation.launch
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden;"&gt;
&lt;iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share; fullscreen" loading="eager" referrerpolicy="strict-origin-when-cross-origin" src="https://www.youtube.com/embed/p-eapPg5BuE?autoplay=0&amp;amp;controls=1&amp;amp;end=0&amp;amp;loop=0&amp;amp;mute=0&amp;amp;start=0" style="position: absolute; top: 0; left: 0; width: 100%; height: 100%; border:0;" title="YouTube video"&gt;&lt;/iframe&gt;
&lt;/div&gt;
&lt;h2 id="publications"&gt;Publications&lt;/h2&gt;
&lt;p&gt;If you use this work in an academic context, please cite the following publication:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;F. Barranco, C. Fermuller, E. Ros: &lt;strong&gt;Real-time clsutering for multi-target tracking using event-based sensors&lt;/strong&gt;. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, 2018. (
)&lt;/li&gt;
&lt;/ul&gt;
&lt;h2 id="authors"&gt;Authors&lt;/h2&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;Francisco Barranco&lt;/strong&gt; - &lt;em&gt;University of Granada&lt;/em&gt;
Please report problems, bugs, or suggestions to fbarranco_at_ugr_dot_es (Replace &lt;em&gt;at&lt;/em&gt; by @ and &lt;em&gt;dot&lt;/em&gt; by .).&lt;/li&gt;
&lt;/ul&gt;
&lt;h2 id="acknowledgments"&gt;Acknowledgments&lt;/h2&gt;
&lt;ul&gt;
&lt;li&gt;This work was supported by a Spanish Juan de la Cierva grant (IJCI-2014-21376), partially funded by MINECO-FEDER TIN2016-81041-R grant, the EU HPB-SGA2 grant (H2020-RIA 785907), the National Science Foundation under grant SMA 1540916, and the NG-UMD seed grant (Object Motion Analysis for Autonomous Systems).&lt;/li&gt;
&lt;/ul&gt;
&lt;h2 id="license"&gt;License&lt;/h2&gt;
&lt;p&gt;Copyright (C) 2018 Francisco Barranco, 01/09/2018, University of Granada.&lt;/p&gt;
&lt;p&gt;This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License.&lt;/p&gt;
&lt;p&gt;This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.&lt;/p&gt;
&lt;p&gt;You should have received a copy of the GNU General Public License along with this program. If not, see
.&lt;/p&gt;</description></item><item><title>Visuoimitation - Baxter imitates movements looking at an operator</title><link>https://www.ugr.es/~cvrlab/projects/baxter_visuoimitation/</link><pubDate>Fri, 27 Apr 2018 00:00:00 +0000</pubDate><guid>https://www.ugr.es/~cvrlab/projects/baxter_visuoimitation/</guid><description>&lt;p&gt;The objective of the system is to control a baxter robot using the kinect V2 and tis body structure extraction modules (body tracking) under the ROS (Robot Operating System) framework. Modules will be developed to make an interface between the robot and the Kinect body pose estimation so that the robot can imitate the movements of the operator in real time. The system is developed in Ubuntu through the use of libraries usch as libfreenect2, openNI-2, and NITE2 becasue the ROS framework is developed for Ubuntu.&lt;/p&gt;
&lt;h2 id="installation"&gt;Installation&lt;/h2&gt;
&lt;p&gt;The project has been tested with the 14.04 STL Ubuntu distribution. Also, for the current project ROS indigo was installed. In case you need to install this ROS version, you need first:&lt;/p&gt;
&lt;p&gt;Configure the source.list file&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ sudo sh -c 'echo &amp;quot;deb http://packages.ros.org/ros/ubuntu \$ (lsb\_release -sc) main&amp;quot;&amp;gt; /etc/apt/sources.list.d/ros-latest.list'
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;Configure the keys&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ sudo apt-key adv --keyserver hkp: //ha.pool.sks-keyservers.net: 80 --recv-key 421C365BD9FF1F717815A3895523BAEEB01FA116
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;Installation&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ sudo apt-get update sudo apt-get install ros-indigo-desktop-full
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;Before using ROS, update rosdep to install all the required dependencies&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ sudo rosdep init
$ rosdep update
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;Configure the environment for compilation&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ echo &amp;quot;source /opt/ros/indigo/setup.bash&amp;quot; &amp;gt;&amp;gt; ~/.bashrc
$ source ~/.bashrc
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;Installing Gazebo for simulation: First we decided to use catkin&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ mkdir -p ~/catkin_ws/src
$ cd ~/catkin_ws/src
$ catkin_init_workspace
$ cd ~/catkin_ws
$ catkin_make
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;Configure the environment&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ echo &amp;quot;source ~/catkin_ws/devel/setup.bash&amp;quot; &amp;gt;&amp;gt; ~/.bashrc
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;Install Gazebo&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ sudo apt-get install -y gazebo2
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;Donwload all the code for ROS indigo ad build Gazebo&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ cd ~/catkin_ws/src
$ git clone https://github.com/ros-simulation/gazebo_ros_pkgs.git -b indigo-devel
$ cd ~/catkin_ws/
$ catkin_make
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;Install the Baxter package to use it with the simulator now&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ cd ~/ros_ws/src
$ wstool init .
$ wstool merge https://raw.githubusercontent.com/RethinkRobotics/
$ baxter_simulator/master/baxter_simulator.rosinstall
$ wstool update
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;Compile the package&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ source /opt/ros/indigo/setup.bash
$ cd ~/ros_ws
$ catkin_make
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;Run Baxter for the simulator&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ roslaunch baxter_gazebo baxter_world.launch****
&lt;/code&gt;&lt;/pre&gt;
&lt;h2 id="workstation-setup"&gt;Workstation Setup&lt;/h2&gt;
&lt;p&gt;The required steps to setup your workstation are described in the tutorial from rethink robotics®. This include the installation of Ubuntu, ROS, the Baxter SDK and the first connection to the robot. The direct connection from the Baxter to your workstation also requires a
.&lt;/p&gt;
&lt;pre&gt;&lt;code&gt; Example: Network Connection-&amp;gt;Add-&amp;gt;Ethernet
Connection name: Baxter
IPv4 Settings: Method: Manual
Address: 169.254.0.10, Netmask: 255.255.0.0, Gateway: 0.0.0.0
&lt;/code&gt;&lt;/pre&gt;
&lt;h2 id="gazebo-optional"&gt;Gazebo (optional)&lt;/h2&gt;
&lt;p&gt;Gazebo is a powerful simulation tool for robots. It allows to use already existing robots like the Baxter or to create own one. It is very useful for people who have not the possibility to work with a physical robot.
.&lt;/p&gt;
&lt;p&gt;It is more comfortable to have a separate workspace for the physical robot and the visual one in the simulation. It is for example not necessary to change everytime the baxter.sh file. The tutorial from the
explains the steps and it is a good way to get in touch with gazebo.&lt;/p&gt;
&lt;p&gt;If MoveIt is already installed the packages must be copied from the workspace ros_ws in the src folder from ros_gazebo_master. But to use the simulation from this website don&amp;rsquo;t modify the following line from baxter_world.launch.&lt;/p&gt;
&lt;pre&gt;&lt;code&gt; &amp;lt;arg name=&amp;quot;world_name&amp;quot; value=&amp;quot;$(find baxter_gazebo)/worlds/baxter.world&amp;quot;/&amp;gt;
&lt;/code&gt;&lt;/pre&gt;
&lt;h2 id="robot-arm-calibration"&gt;Robot arm calibration&lt;/h2&gt;
&lt;p&gt;The calibration of the arms is recommended to get precisely results. There are two different calibration routines which are very well described on the website from rethink robotics.
.&lt;/p&gt;
&lt;h2 id="examples-and-code"&gt;Examples and code&lt;/h2&gt;
&lt;p&gt;The main objective of the project is described in the initial section of this page. The following videos show first and example of the setup with the code running, and the Baxter simulation in Gazebo imitating the movements of the operator. The next video shows a successful example of the robot imitating the operator movements.&lt;/p&gt;
&lt;div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden;"&gt;
&lt;iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share; fullscreen" loading="eager" referrerpolicy="strict-origin-when-cross-origin" src="https://www.youtube.com/embed/KZcqivsb1dM?autoplay=0&amp;amp;controls=1&amp;amp;end=0&amp;amp;loop=0&amp;amp;mute=0&amp;amp;start=0" style="position: absolute; top: 0; left: 0; width: 100%; height: 100%; border:0;" title="YouTube video"&gt;&lt;/iframe&gt;
&lt;/div&gt;
&lt;p&gt;The next video shows a successful example of the robot imitating the operator movements.&lt;/p&gt;
&lt;div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden;"&gt;
&lt;iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share; fullscreen" loading="eager" referrerpolicy="strict-origin-when-cross-origin" src="https://www.youtube.com/embed/V6VbvJ-t0vg?autoplay=0&amp;amp;controls=1&amp;amp;end=0&amp;amp;loop=0&amp;amp;mute=0&amp;amp;start=0" style="position: absolute; top: 0; left: 0; width: 100%; height: 100%; border:0;" title="YouTube video"&gt;&lt;/iframe&gt;
&lt;/div&gt;
&lt;h2 id="contact"&gt;Contact&lt;/h2&gt;
&lt;p&gt;Granada
Cristina Garrido
&lt;/p&gt;</description></item><item><title>Object manipulation with the Baxter robot</title><link>https://www.ugr.es/~cvrlab/projects/baxter_objectmanipulation/</link><pubDate>Thu, 27 Apr 2017 00:00:00 +0000</pubDate><guid>https://www.ugr.es/~cvrlab/projects/baxter_objectmanipulation/</guid><description>&lt;p&gt;This website presents various demonstrations of pick and place tasks with the Baxter research robot. It contains object recognition and manipulation with different focus areas such as various shapes, sizes, and colours. It also includes trajectory and motion planning and the use of different grippers with the physical robot and in the simulation with gazebo, too. The demonstrations, based upon a project from Abhishek Patil from the Northwestern University. (
)&lt;/p&gt;
&lt;h3 id="contents"&gt;Contents&lt;/h3&gt;
&lt;p&gt;The packages include the following files:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;baxter_pnp.py&lt;/strong&gt;&lt;br /&gt;
It includes the commands for the pick and place task and subscribes to the topic &amp;ldquo;detected objects&amp;rdquo; which contains the coordinates of the objects. The MoveGroupCommander and the PlanningSceneInterface are used for the movements.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;baxter_img.cpp&lt;/strong&gt;&lt;br /&gt;
The file is for the object detection with the Baxter hand camera. The tool OpenCV is used and the results are published to the topic &amp;ldquo;detected_objects&amp;rdquo;.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;baxter_pick_and_place.launch&lt;/strong&gt;&lt;br /&gt;
The launch file runs all the required nodes for the specific project.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Folder with models for simulation&lt;/strong&gt;&lt;br /&gt;
The projects for the simulation contain some models for the objects and the table which are from the Rethink Robotics example.&lt;/li&gt;
&lt;/ul&gt;
&lt;h2 id="prerequisites"&gt;Prerequisites&lt;/h2&gt;
&lt;h2 id="workstation-setup"&gt;Workstation Setup&lt;/h2&gt;
&lt;p&gt;To set the workstation, the tutorial from
, in this site you can find the installation of Ubuntu, the ROS specific version for that Ubuntu version, the Baxter SDK and the instructions for establishing the first comunication with the robot, which requires an Ethernet connection.&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;Example: Network Connection-&amp;gt;Add-&amp;gt;Ethernet
Connection name: Baxter
IPv4 Settings: Method: Manual
Address: 169.254.0.10, Netmask: 255.255.0.0, Gateway: 0.0.0.0
&lt;/code&gt;&lt;/pre&gt;
&lt;h2 id="moveit"&gt;MoveIt&lt;/h2&gt;
&lt;p&gt;
is used for the motion planning, manipulation and collision checking.&lt;/p&gt;
&lt;p&gt;Moreover the package
by Michael Ferguson needs to be installed.&lt;/p&gt;
&lt;h2 id="robot-arm-calibration"&gt;Robot arm calibration&lt;/h2&gt;
&lt;p&gt;It is recommended to calibrate Baxter&amp;rsquo;s arms for getting more precise results.
there are two different calibration routines which are very well described.&lt;/p&gt;
&lt;h2 id="table-position-and-zero-point-in-moveit"&gt;Table position and zero point in MoveIt&lt;/h2&gt;
&lt;p&gt;It is very annoying to find every time you change the position of the robot or the used table to get the right sizes and coordinates manually for the simulation in MoveIt!. There are two programs which make this task easier. The first one is used to get the distance from the ground to the zero point from the reference frame &amp;ldquo;base&amp;rdquo; from MoveIt!. This value is always the same if the robot position doesn&amp;rsquo;t change. The table height must be smaller than 0.9 m and known to get this distance.
&lt;/p&gt;
&lt;p&gt;Then you can continue with the second program which finds the size and the position of the table. At first add the measured distance from the task before.
&lt;/p&gt;
&lt;h2 id="the-color-of-the-objects"&gt;The color of the objects&lt;/h2&gt;
&lt;p&gt;The object recognition can only work if the colors of the objects are known. The colors are defined in the baxter_img.cpp file as low and high hsv values. The example colored_papers.pdf includes three different colors with the related hsv values. They can be printed and used for a first test to recognize them. Download the colored papers! But this aren&amp;rsquo;t the exact values because it depends on the printer settings, the ink, the paper, etc. The best way to get the color values from an object which should be detected is to take pictures with the Baxter camera from it on the workspace in different positions. This can be in the shadow from something or at a highly illuminated area. Moreover, it is recommended to have every time all the used colors on every picture to see that only the color with the specific hsv values is detected.&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ rosrun image_view image_view image:=/cameras/right_hand_camera/image
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;This command opens a window with a stream of images from Baxter&amp;rsquo;s right hand camera and allows to save images by right-clicking on the display window.
Then the images can be analysed with the
. Open a new terminal and execute the python file from the location where it is saved.&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ python hsvThresholder.py frame0000.jpg
&lt;/code&gt;&lt;/pre&gt;
&lt;h2 id="camera-calibration-and-other-parameters"&gt;Camera calibration and other parameters&lt;/h2&gt;
&lt;p&gt;The camera calibration is always necessary because every camera is different. The parameters can be determined with the
. The website explains the calibration and optimization from a camera with a printed checkerboard. The first calibration example, can be done with an example based on a total of 20 images to learn the process. Another option without the software Matlab is the tutorial
. The parameters must be changed in the baxter_img.cpp file which is in the package from the projects.&lt;/p&gt;
&lt;p&gt;The distance from the camera to the object must be changed in function &amp;ldquo;Get3DPos&amp;rdquo; which is in the same file. (475 mm) Moreover must be the offsets &amp;ldquo;0.07+0.57&amp;rdquo; and &amp;ldquo;0.032&amp;rdquo; checked. They are necessary to get the coordinates in the Baxter coordinate system.&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;pose.position.x = rel_pos[i].x / 1000+0.07+0.57;
pose.position.y = rel_pos[i].y / 1000-0.032;
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;One object can be placed on the table and the position can be determined by the gripper position.&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;rostopic echo /robot/limb/left/endpoint_state/pose -n 1
rostopic echo detected_objects -n 1
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;Then must be the detected position of this object compared with the real one. The differences are the offsets.
The factors 0.015 and 0.058 correct the small deviations from the functions
(int) rect.center.x- WIDTH / 2 and -((int) rect.center.y- HEIGHT / 2) which are used in the code.&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;float tempx = _Ma(0, 0, INVTRANS) * src-&amp;gt;x + 0.015;
float tempy = _Ma(1, 1, INVTRANS) * src-&amp;gt;y + 0.058;
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;The following example shows the equations for the camera resolution 1280x800.&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;2*(1280/2-c_x)/f_x and 2*(800/2-c_y)/f_y
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;Further changes for the size of the objects are explained in the comments of the code.&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;Change grippers&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;At first the arguments in the demo_baxter.launch must be changed to true.&lt;/p&gt;
&lt;pre&gt;&lt;code&gt; &amp;lt;arg name=&amp;quot;load_robot_description&amp;quot; default=&amp;quot;true&amp;quot;/&amp;gt;
&amp;lt;arg name=&amp;quot;right_electric_gripper&amp;quot; default=&amp;quot;true&amp;quot;/&amp;gt;
&amp;lt;arg name=&amp;quot;left_electric_gripper&amp;quot; default=&amp;quot;true&amp;quot;/&amp;gt;
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;Then can the grippers be changed in the files left_end_effector.urdf.xacro and right_end_effector.urdf.xacro.
The possible settings for this files are explained at
.&lt;/p&gt;
&lt;h2 id="tasks-overview"&gt;Tasks Overview&lt;/h2&gt;
&lt;p&gt;The tasks use two different path planning functions which have advantages and disadvantages. The movements with the common function are in the most cases faster and smoother but sometimes it computes very strength pathes. The cartesian path planning allways plans straight ways to the added waypoints. This can be very important for tasks, like the pick and place tasks with the basket, where the orientation should be the same. The disadvantages are that the function can&amp;rsquo;t allways find a path to the goal and that it doesn&amp;rsquo;t wait to continue with the code until it finished. (See Troubleshooting section) Moreover the tasks present various variations to solve a task with different performances.&lt;/p&gt;
&lt;div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden;"&gt;
&lt;iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share; fullscreen" loading="eager" referrerpolicy="strict-origin-when-cross-origin" src="https://www.youtube.com/embed/nwvRZnX8Rho?autoplay=0&amp;amp;controls=1&amp;amp;end=0&amp;amp;loop=0&amp;amp;mute=0&amp;amp;start=0" style="position: absolute; top: 0; left: 0; width: 100%; height: 100%; border:0;" title="YouTube video"&gt;&lt;/iframe&gt;
&lt;/div&gt;
&lt;p&gt;&lt;strong&gt;Measure MoveIt zero point&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;This package is used to get the distance from the ground to the zero point from the reference frame &amp;ldquo;base&amp;rdquo; from MoveIt. This value is needed for the collision checking and is allways the same if the robot position doesn&amp;rsquo;t change. The table height must be smaller then 0.9 m and added to the variable table_size_z. The right arm move from the start position down and measure with the infrared sensor the distance to the table and calculate the zero point with the current position, the distance to the table and the table height. The result will be printed on the screen and is required for all tasks.&lt;/p&gt;
&lt;p&gt;The project must be added in the src folder from the workspace and can be launched after it is build from a sourced terminal.
Open a new terminal:&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ source /opt/ros/indigo/setup.bash
$ source ros_ws/devel/setup.bash
$ cd ros_ws/
$ ./baxter.sh
$ catkin_make
$ roslaunch baxter_measure_zero_point baxter_pick_and_place.launch
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;&lt;strong&gt;Build a tower with one arm&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;In this project the Baxter build the tower only with the right arm. The right hand camera detect every time at the start position the objects on the table and they will be sorted by size. Then it allways pick the biggest one and build a tower. It approach the object and orientate the gripper to the right angle and if it failed to pick the object it try it again. This continue until the table is clear. The program require the values for the variable offset_zero_point, the table size and position.&lt;/p&gt;
&lt;div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden;"&gt;
&lt;iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share; fullscreen" loading="eager" referrerpolicy="strict-origin-when-cross-origin" src="https://www.youtube.com/embed/fi68d5B1JOE?autoplay=0&amp;amp;controls=1&amp;amp;end=0&amp;amp;loop=0&amp;amp;mute=0&amp;amp;start=0" style="position: absolute; top: 0; left: 0; width: 100%; height: 100%; border:0;" title="YouTube video"&gt;&lt;/iframe&gt;
&lt;/div&gt;
&lt;p&gt;&lt;strong&gt;Build a tower with one arm and detect the objects only one time&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;This change improves the performance of the Baxter because it detects the objects only at the start and at the end to look if the table is clear.&lt;/p&gt;
&lt;div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden;"&gt;
&lt;iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share; fullscreen" loading="eager" referrerpolicy="strict-origin-when-cross-origin" src="https://www.youtube.com/embed/KQ7efHl967M?autoplay=0&amp;amp;controls=1&amp;amp;end=0&amp;amp;loop=0&amp;amp;mute=0&amp;amp;start=0" style="position: absolute; top: 0; left: 0; width: 100%; height: 100%; border:0;" title="YouTube video"&gt;&lt;/iframe&gt;
&lt;/div&gt;
&lt;p&gt;The project must be added in the src folder from the workspace and can be launched after it is build from a sourced terminal.
Open a new terminal:&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ source /opt/ros/indigo/setup.bash
$ source ros_ws/devel/setup.bash
$ cd ros_ws/
$ ./baxter.sh
$ catkin_make
$ roslaunch baxter_pnp_one_arm baxter_pick_and_place.launch
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;&lt;strong&gt;Build a tower with one arm in Gazebo&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;This is the same task in the simulation with Gazebo but the camera isn&amp;rsquo;t used and the position of the objects are fixed.&lt;/p&gt;
&lt;div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden;"&gt;
&lt;iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share; fullscreen" loading="eager" referrerpolicy="strict-origin-when-cross-origin" src="https://www.youtube.com/embed/wKhNArqU0MA?autoplay=0&amp;amp;controls=1&amp;amp;end=0&amp;amp;loop=0&amp;amp;mute=0&amp;amp;start=0" style="position: absolute; top: 0; left: 0; width: 100%; height: 100%; border:0;" title="YouTube video"&gt;&lt;/iframe&gt;
&lt;/div&gt;
&lt;p&gt;The project must be added in the src folder from the workspace for the simulation and can be launched after it is build from a sourced terminal.
Open a new terminal:&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ source /opt/ros/indigo/setup.bash
$ source ros_gazebo_master/devel/setup.bash
$ cd ros_gazebo_master
$ ./baxter.sh sim
$ catkin_make
$ roslaunch baxter_gazebo baxter_world.launch
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;Open a second new terminal:&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ source /opt/ros/indigo/setup.bash
$ source ros_gazebo_master/devel/setup.bash
$ cd ros_gazebo_master
$ ./baxter.sh sim
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;&lt;em&gt;Wait until the message &amp;ldquo;Simulator is loaded and started successfully&amp;rdquo; in the first terminal appears.&lt;/em&gt;&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ rosrun baxter_tools enable_robot.py -e
$ roslaunch baxter_pnp_one_arm_cartesian_sim baxter_pick_and_place.launch
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;&lt;strong&gt;Build a tower with both arms alternately&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;In this project the Baxter build the tower with both arms alternately. Both of the hand cameras detect every time at the start position the objects on the table and they will be sorted by size. The arms pick only the objects on their side and allways start with the biggest one and build a tower together. The grippers approach the objects and orientate to the right angle and if they fail to pick an object they try it again. This continue until the table is clear. The program require the values for the variable offset_zero_point, the table size and position.&lt;/p&gt;
&lt;div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden;"&gt;
&lt;iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share; fullscreen" loading="eager" referrerpolicy="strict-origin-when-cross-origin" src="https://www.youtube.com/embed/6UzWeti0UB4?autoplay=0&amp;amp;controls=1&amp;amp;end=0&amp;amp;loop=0&amp;amp;mute=0&amp;amp;start=0" style="position: absolute; top: 0; left: 0; width: 100%; height: 100%; border:0;" title="YouTube video"&gt;&lt;/iframe&gt;
&lt;/div&gt;
&lt;p&gt;The project must be added in the src folder from the workspace and can be launched after it is build from a sourced terminal.
Open a new terminal:&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ source /opt/ros/indigo/setup.bash
$ source ros_ws/devel/setup.bash
$ cd ros_ws/
$ ./baxter.sh
$ catkin_make
$ roslaunch baxter_pnp_both_arms_alternately baxter_pick_and_place.launch
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;&lt;strong&gt;Pick and Place with a basket&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;The task from Baxter is to grip a pink basket with the left gripper and throw the cubes with the right gripper in it. It starts to find the position of the basket. At first the right hand camera detect the it from the start position and move to it. Then it looks a second time because if the basket is not directly under the camera it will also detect the sides from the basket and this cause deviations.&lt;/p&gt;
&lt;figure&gt;&lt;img src="https://www.ugr.es/~cvrlab/projects/baxter_objectmanipulation/basketview.jpg"&gt;
&lt;/figure&gt;
&lt;p&gt;In the next step moves the right arm to the side of the table and the left arm approach the detected position with a specific orientation. It moves a little bit further than the pick goal to have it very close in the gripper. Then the left gripper grip it and moves to the start position for the left arm which has specific joint coordinates because they allows a high probability that a valid cartesian path can be found. The right hand camera detect every time at the start position the objects on the table. The right gripper approach the object and orientate to the right angle and pick the object. If it failed to pick an object it try it again. Then the right gripper moves up and the left gripper moves with the basket under it. The cube will be thrown in the basket and this continue until the table is clear. The program require the values for the variable offset_zero_point, the table size and position.&lt;/p&gt;
&lt;div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden;"&gt;
&lt;iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share; fullscreen" loading="eager" referrerpolicy="strict-origin-when-cross-origin" src="https://www.youtube.com/embed/cJtrwRFSiCc?autoplay=0&amp;amp;controls=1&amp;amp;end=0&amp;amp;loop=0&amp;amp;mute=0&amp;amp;start=0" style="position: absolute; top: 0; left: 0; width: 100%; height: 100%; border:0;" title="YouTube video"&gt;&lt;/iframe&gt;
&lt;/div&gt;
&lt;p&gt;The project must be added in the src folder from the workspace and can be launched after it is build from a sourced terminal.
Open a new terminal:&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ source /opt/ros/indigo/setup.bash
$ source ros_ws/devel/setup.bash
$ cd ros_ws/
$ ./baxter.sh
$ catkin_make
$ roslaunch baxter_pnp_basket_cartesian baxter_pick_and_place.launch
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;&lt;strong&gt;Troubleshooting&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;The projects include some features to solve problems when the robot failed. The following video will explain them.&lt;/p&gt;
&lt;div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden;"&gt;
&lt;iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share; fullscreen" loading="eager" referrerpolicy="strict-origin-when-cross-origin" src="https://www.youtube.com/embed/0TOK8PX-DxI?autoplay=0&amp;amp;controls=1&amp;amp;end=0&amp;amp;loop=0&amp;amp;mute=0&amp;amp;start=0" style="position: absolute; top: 0; left: 0; width: 100%; height: 100%; border:0;" title="YouTube video"&gt;&lt;/iframe&gt;
&lt;/div&gt;
&lt;p&gt;The simulation in Gazebo has sometimes the problems that the object slip out of the gripper or it doesn&amp;rsquo;t stop to move.&lt;/p&gt;
&lt;div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden;"&gt;
&lt;iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share; fullscreen" loading="eager" referrerpolicy="strict-origin-when-cross-origin" src="https://www.youtube.com/embed/IT4SCURQNSk?autoplay=0&amp;amp;controls=1&amp;amp;end=0&amp;amp;loop=0&amp;amp;mute=0&amp;amp;start=0" style="position: absolute; top: 0; left: 0; width: 100%; height: 100%; border:0;" title="YouTube video"&gt;&lt;/iframe&gt;
&lt;/div&gt;
&lt;p&gt;&lt;em&gt;Errors&lt;/em&gt;
“Invalid Trajectory: start point deviates from current robot state more than …“&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ rosparam set /move_group/trajectory_execution/allowed_start_tolerance 0.0
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;&lt;strong&gt;Copyright (C) 2017 Maik Heufekes, 05/07/2017.&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;This program is free software: you can redistribute it and/or modify it under the terms of the GNU Lesser General Public License as published by the Free Software Foundation, either version 3 of the License.&lt;/p&gt;
&lt;p&gt;This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU Lesser General Public License for more details.&lt;/p&gt;
&lt;p&gt;You should have received a copy of the GNU Lesser General Public License along with this program. If not, see
.&lt;/p&gt;</description></item><item><title>Object classification with the Baxter robot</title><link>https://www.ugr.es/~cvrlab/projects/baxter_conveyor/</link><pubDate>Wed, 27 Apr 2016 00:00:00 +0000</pubDate><guid>https://www.ugr.es/~cvrlab/projects/baxter_conveyor/</guid><description>&lt;p&gt;This project shows the development of various classification tasks in static and dynamic environments with the Baxter robot. This robot will separate two groups of objects with different colours, positions and sizes, using the Robot Operating System (ROS Kinetic) on Ubuntu 16.04 LTS, MoveIt! and the OpenCV library for the computer vision, based on the colour filter made by
. Check the
.&lt;/p&gt;
&lt;h2 id="prerequisites"&gt;Prerequisites&lt;/h2&gt;
&lt;h2 id="workstation-setup"&gt;Workstation Setup&lt;/h2&gt;
&lt;p&gt;To set the workstation, the tutorial from
, in this site you can find the installation of Ubuntu, the ROS specific version for that Ubuntu version, the Baxter SDK and the instructions for establishing the first comunication with the robot, which requires an Ethernet connection.&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;Example: Network Connection-&amp;gt;Add-&amp;gt;Ethernet
Connection name: Baxter
IPv4 Settings: Method: Manual
Address: 169.254.0.10, Netmask: 255.255.0.0, Gateway: 0.0.0.0
&lt;/code&gt;&lt;/pre&gt;
&lt;h2 id="moveit"&gt;MoveIt&lt;/h2&gt;
&lt;p&gt;
is used for the motion planning, manipulation and collision checking.&lt;/p&gt;
&lt;p&gt;Moreover the package
by Michael Ferguson needs to be installed.&lt;/p&gt;
&lt;h2 id="robot-arm-calibration"&gt;Robot arm calibration&lt;/h2&gt;
&lt;p&gt;It is recommended to calibrate Baxter&amp;rsquo;s arms for getting more precise results.
there are two different calibration routines which are very well described.&lt;/p&gt;
&lt;h2 id="colour-of-the-objects"&gt;Colour of the objects&lt;/h2&gt;
&lt;p&gt;The object recognition can only work if the colours of the objects are known. The colours are defined in the baxter_img.cpp file as low and high HSV values. The best way to get the color values from an object which should be detected is to take pictures with the Baxter camera from it on the workspace in different positions and with different illuminations.&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ rosrun image_view image_view image:=/cameras/right_hand_camera/image
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;This command opens a window with a stream of images from Baxter&amp;rsquo;s right hand camera and allows to save images by right-clicking on the display window.
Then the images can be analyzed with the
. Open a new terminal and execute the python file from the location where it is saved.&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ python hsvThresholder.py frame0000.jpg
&lt;/code&gt;&lt;/pre&gt;
&lt;h2 id="tasks-overview"&gt;Tasks Overview&lt;/h2&gt;
&lt;p&gt;There are two main classification tasks using a paddle and a wedge as tools, the first one is used in static classification and the other one in dynamic. Both of them are made out of cardboard and it is common that sometimes the objects weight more than the tools, resulting on difficulties at the time of classifying. The clustering algorithm used is K-means with k = 2, it separates the objects by colour and position. This algorithm gives us the centroids of both groups so that we can get the middle point.&lt;/p&gt;
&lt;h3 id="static-environment-classification"&gt;Static environment classification&lt;/h3&gt;
&lt;p&gt;Baxter classifies objects on the top of a table, setting them aside.&lt;/p&gt;
&lt;p&gt;The project must be added in the src folder from the workspace and can be launched after it is built from a sourced terminal.&lt;/p&gt;
&lt;div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden;"&gt;
&lt;iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share; fullscreen" loading="eager" referrerpolicy="strict-origin-when-cross-origin" src="https://www.youtube.com/embed/wTfLTKC_PFo?autoplay=0&amp;amp;controls=1&amp;amp;end=0&amp;amp;loop=0&amp;amp;mute=0&amp;amp;start=0" style="position: absolute; top: 0; left: 0; width: 100%; height: 100%; border:0;" title="YouTube video"&gt;&lt;/iframe&gt;
&lt;/div&gt;
&lt;p&gt;Open a new terminal:&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ source /opt/ros/kinetic/setup.bash
$ source ros_ws/devel/setup.bash
$ cd ros_ws/
$ ./baxter.sh
$ catkin_make
$ roslaunch classif classification.launch
&lt;/code&gt;&lt;/pre&gt;
&lt;h3 id="dynamic-environment-classification-using-a-wedge"&gt;Dynamic environment classification using a wedge&lt;/h3&gt;
&lt;p&gt;For making this classification, the speed of the objects on the conveyor belt has to be calculated. Then, the Baxter robot will predict where the objects are to separate them.&lt;/p&gt;
&lt;div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden;"&gt;
&lt;iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share; fullscreen" loading="eager" referrerpolicy="strict-origin-when-cross-origin" src="https://www.youtube.com/embed/crF7NCy9WJw?autoplay=0&amp;amp;controls=1&amp;amp;end=0&amp;amp;loop=0&amp;amp;mute=0&amp;amp;start=0" style="position: absolute; top: 0; left: 0; width: 100%; height: 100%; border:0;" title="YouTube video"&gt;&lt;/iframe&gt;
&lt;/div&gt;
&lt;p&gt;The project must be added in the src folder from the workspace and can be launched after it is built from a sourced terminal.
Open a new terminal:&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ source /opt/ros/kinetic/setup.bash
$ source ros_ws/devel/setup.bash
$ cd ros_ws/
$ ./baxter.sh
$ catkin_make
$ roslaunch dyn_wedge dyn_wedge.launch
&lt;/code&gt;&lt;/pre&gt;
&lt;h3 id="dynamic-environment-classification-using-a-paddle"&gt;Dynamic environment classification using a paddle&lt;/h3&gt;
&lt;p&gt;For making this classification, the speed of the objects on the conveyor belt has to be calculated. Then, the Baxter robot will predict where the objects are to separate them. In this case, the tool used is a paddle, so it will be necessary to predict the position twice, as it can be seen in the video.&lt;/p&gt;
&lt;p&gt;The project must be added in the src folder from the workspace and can be launched after it is built from a sourced terminal.&lt;/p&gt;
&lt;div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden;"&gt;
&lt;iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share; fullscreen" loading="eager" referrerpolicy="strict-origin-when-cross-origin" src="https://www.youtube.com/embed/BypfZhM5Lto?autoplay=0&amp;amp;controls=1&amp;amp;end=0&amp;amp;loop=0&amp;amp;mute=0&amp;amp;start=0" style="position: absolute; top: 0; left: 0; width: 100%; height: 100%; border:0;" title="YouTube video"&gt;&lt;/iframe&gt;
&lt;/div&gt;
&lt;p&gt;Open a new terminal:&lt;/p&gt;
&lt;pre&gt;&lt;code&gt;$ source /opt/ros/kinetic/setup.bash
$ source ros_ws/devel/setup.bash
$ cd ros_ws/
$ ./baxter.sh
$ catkin_make
$ roslaunch dyn_classif dyn_classif.launch
&lt;/code&gt;&lt;/pre&gt;
&lt;h2 id="packages"&gt;Packages&lt;/h2&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;classif&lt;/strong&gt;. It includes the classification in a static environment.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;dyn_classif&lt;/strong&gt;. Classification in a dynamic environment using a paddle.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;dyn_wedge&lt;/strong&gt;. Classification in a dynamic environment using a wedge.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;pick_and_place&lt;/strong&gt;. Adapted pick and place program for executing it in the Baxter robot.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;The files included by this packages are:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;baxter_img.cpp: This C++ program identifies the objects in the image, visualizes them and calculates the middle point between the two groups of objects, sending them to the control file.&lt;/li&gt;
&lt;li&gt;file.py: It is the control file, it subscribes to the &amp;ldquo;clasificacion&amp;rdquo; or &amp;ldquo;detected_objects&amp;rdquo; topic and plans the trajectories and execute them to separate or pick the objects.&lt;/li&gt;
&lt;li&gt;file.launch: This launch file runs all the required nodes to accomplish the task.&lt;/li&gt;
&lt;/ul&gt;</description></item></channel></rss>