The RoiDB module (region of interest database module) allows the global definition of 2D and 3D regions of interest, which can then be used in many detection modules. The ROIs are available for all modules supporting 2D or 3D ROIs on the rc_visard.
The RoiDB module is a base module which is available on every rc_visard.
|Supported ROI types||2D, 3D|
|Supported ROI geometries||2D ROI: rectangle, 3D ROI: box, sphere|
|Max. number of ROIs||2D: 100, 3D: 100|
|ROIs available in||2D: SilhouetteMatch, LoadCarrier, 3D: ItemPick and BoxPick|
|Supported reference frames||camera, external|
Region of interest¶
A region of interest (ROI) defines a volume in space (3D region of interest,
or a rectangular region in the left camera image (2D region of interest,
region_of_interest_2d) which is of interest for
a specific user-application.
A ROI can narrow the volume where a load carrier is searched for, or select a volume which only contains items to be detected and/or grasped. Processing times can significantly decrease when using a ROI.
3D regions of interest of the following types (
type) are supported:
BOX, with dimensions
SPHERE, with radius
The user can specify the 3D region of interest
pose in the
camera or the
external coordinate system.
External can only be chosen if a
Hand-eye calibration is available.
When the sensor is robot mounted, and the region of interest is defined in the external frame, the current
robot pose must be given to every detect service call that uses this region of interest.
A 2D ROI is defined as a rectangular part of the left camera image, and can be set via the REST-API interface or the rc_visard Web GUI on the page Regions of Interest under Database. The Web GUI offers an easy-to-use selection tool. Each ROI must have a unique name to address a specific 2D ROI.
In the REST-API, a 2D ROI is defined by the following values:
id: Unique name of the region of interest
offset_y: offset in pixels along the x-axis and y-axis from the top-left corner of the image, respectively
height: width and height in pixels
The rc_visard can persistently store up to 100 different 3D regions of interest and the same number of 2D regions of interest. The configuration of regions of interest is normally performed offline, during the set up of the desired application. This can be done via the REST-API interface of RoiDB module, or in the rc_visard Web GUI on the page Regions of Interest under Database.
The configured regions of interest are persistent even over firmware updates and rollbacks.
Interaction with other modules¶
Internally, the RoiDB module depends on, and interacts with other on-board modules as listed below.
In case the camera has been calibrated to a robot, the pose of a 3D ROI
can be provided in the robot coordinate frame by setting the corresponding
pose_frame values can be chosen:
- Camera frame (
camera). The ROI pose is provided in the camera frame, and no prior knowledge about the pose of the camera in the environment is required. This means that the configured load carriers move with the camera. It is the user’s responsibility to update the configured poses if the camera frame moves (e.g. with a robot-mounted camera).
- External frame (
external). The ROI pose is provided in the external frame, configured by the user during the hand-eye calibration process. The module relies on the on-board Hand-eye calibration module to retrieve the sensor mounting (static or robot mounted) and the hand-eye transformation.
If no hand-eye calibration is available, all
pose_frame values should be set to
pose_frame values that are not
external are rejected.
The RoiDB module is called
rc_roi_db in the REST-API and is represented in the
Web GUI under
The user can explore and call the RoiDB module’s services,
e.g. for development and testing, using the
REST-API interface or
the Web GUI.
The RoiDB module offers the following services.
Persistently stores a 3D region of interest on the rc_visard. All configured 3D regions of interest are persistent over firmware updates and rollbacks.
This service can be called as follows.PUT http://<host>/api/v2/nodes/rc_roi_db/services/set_region_of_interest
Persistently stores a 2D region of interest on the rc_visard. All configured 2D regions of interest are persistent over firmware updates and rollbacks.
This service can be called as follows.PUT http://<host>/api/v2/nodes/rc_roi_db/services/set_region_of_interest_2d
Returns the configured 3D regions of interest with the requested
This service can be called as follows.PUT http://<host>/api/v2/nodes/rc_roi_db/services/get_regions_of_interest
Returns the configured 2D regions of interest with the requested
This service can be called as follows.PUT http://<host>/api/v2/nodes/rc_roi_db/services/get_regions_of_interest_2d
Deletes the configured 3D regions of interest with the requested
This service can be called as follows.PUT http://<host>/api/v2/nodes/rc_roi_db/services/delete_regions_of_interest
Deletes the configured 2D regions of interest with the requested
This service can be called as follows.PUT http://<host>/api/v2/nodes/rc_roi_db/services/delete_regions_of_interest_2d
Each service response contains a
which consists of a
value plus an optional
A successful service returns with a
return_code value of
return_code values indicate that the service failed.
return_code values indicate that the service succeeded with additional information.
The smaller value is selected in case a service has multiple
but all messages are appended in the
The following table contains a list of common codes:
|-1||An invalid argument was provided|
|-10||New element could not be added as the maximum storage capacity of regions of interest has been exceeded|
|10||The maximum storage capacity of regions of interest has been reached|
|11||An existent persistent model was overwritten by the call to