Skip to content

Commit

Permalink
docs for rawlogviewer and more
Browse files Browse the repository at this point in the history
  • Loading branch information
jlblancoc committed May 18, 2021
1 parent 45794c9 commit 171942e
Show file tree
Hide file tree
Showing 20 changed files with 348 additions and 18 deletions.
2 changes: 1 addition & 1 deletion doc/source/app_GridmapNavSimul.rst
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
.. app_GridmapNavSimul:
.. _app_GridmapNavSimul:

====================================================
Application: GridmapNavSimul
Expand Down
259 changes: 259 additions & 0 deletions doc/source/app_RawLogViewer.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,259 @@
.. _app_RawLogViewer:

====================================================
Application: RawLogViewer
====================================================

.. contents:: :local:

1. Purpose of this program
----------------------------

The main goal of the GUI program RawLogViewer is to allow users to
**quickly inspect**, cut, or modify in many different ways a
given :ref:`Rawlog (datasets)<robotics_file_formats>` gathered by a robot,
with the idea of preparing it as the input to some other program, typically for
localization (pf-localization) or mapping (kf-slam, rbpf-slam,...):

.. image:: images/RawlogViewerRole.png
:alt: RawlogViewerRole

Examples of typical operations are extracting just a part of a large dataset,
decimating the rawlog if original data was gathered at a very high rate, or
modifying the sensor poses with respect to the robot/vehicle frame of reference.

The program also permits importing and exporting datasets to other formats.
Limited exporting is also implemented into plain text files, e.g. for processing
data in MATLAB. Note that future development of this program will focus on
visualization only, while modification of datasets should preferably be done
by means of the program ``rawlog-edit``.

This video demonstrates RawLogViewer inspecting some datasets with
Velodyne 3D Lidar data, as well as others with 2D lidars and 3D RGB+D cameras:

.. raw:: html

<div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden; max-width: 100%; height: auto;">
<iframe src="https://www.youtube.com/embed/Dau0ir_L77w" frameborder="0" allowfullscreen style="position: absolute; top: 0; left: 0; width: 100%; height: 100%;"></iframe>
</div>

Another (older) video demonstrating RawLogViewer inspecting RGB+D datasets grabbed
with Microsoft Kinect:

.. raw:: html

<div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden; max-width: 100%; height: auto;">
<iframe src="https://www.youtube.com/embed/RZhMZWRplO0" frameborder="0" allowfullscreen style="position: absolute; top: 0; left: 0; width: 100%; height: 100%;"></iframe>
</div>


2. Interface description
----------------------------

.. image:: images/rawlogviewer_UI_details.png
:alt: rawlogviewer UI parts

- Left: The sequence of all the objects stored in the loaded dataset.
Click on an object to select it and preview its contents on the other
right-hand spaces.

- Top-right: A textual description of the selected object.

- Bottom-right: For some objects, a visual preview of the observation contents.
For example, a 2D view of a laser scan, the images of a monocular or stereo
camera, etc. When no object is selected, this panel displays a summary of
the entire dataset, including timing information for each sensor.


3. Important manipulations of a rawlog
---------------------------------------

.. note::
The command-line program ``rawlog-edit`` provides many other manipulation
opportunities for rawlog datasets.

Cut, selective removals, etc
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Menu path: “Edit” -> “Edit rawlog…”

Description: This command opens up a dialog with several configurable filters
to remove specific parts of a dataset, either by their position in time,
or by sensor-type or sensor-label.

.. image:: images/Screenshot-RawlogViewer-Edit-the-rawlog.png
:alt: RawlogViewer Edit rawlog

Changing the position of sensors
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Menu path: “Edit” -> “Change sensor/camera parameters…”

Description: All sensor (observation) objects in a dataset have an associated “pose on the robot”, describing its 6D location on the vehicle frame of reference (e.g. which will be always the origin for hand-held devices). This dialog allows getting and setting this pose to all the objects in a dataset at once. It’s typically used together to sensor labels:

.. image:: images/Screenshot-RawlogViewer-Change-sensor-pose-information.png
:alt: Screenshot-RawlogViewer-Change-sensor-pose-information

Converting a rawlog format: “observations-only” ==> “actions-sensory frame“
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Menu path: “Edit” -> “Convert into SF format” -> choose your conversion parameters.

Note: Typically, at least one of the first “actions” will be empty (e.g. without odometry).
Check it out by inspecting rawlog entry number “1” in the tree view.
If it is empty, it is strongly recommended to cut off those first entries.
See how to remove part of a rawlog in section 3.1 above.
Continue inspecting the rawlog and, if satisfied, save it as a new rawlog file.

Converting a rawlog format: “actions-sensory frame” ==> “observations-only“
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Menu path: “File” -> “Operations on files” -> “Convert to observations-only rawlog”


4. The “maps and paths generation module” dialog
-----------------------------------------------------

Menu path: “Tools” -> “Open the maps & paths generation module…”

Description: Mostly oriented to datasets with 2D/3D laser scans, this dialog allows
quickly inspecting a map built from unprocessed odometry, useful to gain a first quick
insight of the environment, and the odometry quality.


5. The Scan-Matching (ICP) module
-----------------------------------------------------

This module of the RawLogViewer application is a graphical front-end to the
:ref:`ICP algorithms<tutorial-icp-alignment>` implemented in ``mrpt-slam``.
Basically, two sensory frames (or individual observations) from the
currently-loaded rawlog are aligned using `mrpt::slam::CICP <class_mrpt_slam_CICP.html>`_
allowing the user to tune all parameters at a glance.

So, you can use this module to tune or trial-and-error tests related to ICP.
Optionally, the ICP iterations can be seen visually as an animation.

Note that in the "animate mode" the execution of ICP is intentionally
carried out more slowly to ease the step-by-step visualization,
though the normal operation usually takes a few milliseconds.

In this first experiment we can see how the threshold value for the maximum
distance for establishing a correspondence between the two maps strongly
limits the attainable adjustment that the ICP algorithm can perform from
the **initial position**: in a first trial, a threshold of 0.75m is not
enough to lead the algorithm to convergence, but it does quickly by changing
the threshold to 2.5m:

.. raw:: html

<div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden; max-width: 100%; height: auto;">
<iframe src="https://www.youtube.com/embed/B_OAlxjDhEM" frameborder="0" allowfullscreen style="position: absolute; top: 0; left: 0; width: 100%; height: 100%;"></iframe>
</div>


This second video demonstrates the two reference maps that MRPT's ICP
implementation can handle: a map of points, or a grid map.
In this latter case, correspondences are established by matching laser points
to occupied cells in the grid:

.. raw:: html

<div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden; max-width: 100%; height: auto;">
<iframe src="https://www.youtube.com/embed/WbM8ri7Jk_w" frameborder="0" allowfullscreen style="position: absolute; top: 0; left: 0; width: 100%; height: 100%;"></iframe>
</div>


6. Actions: odometry and its uncertainty
-----------------------------------------------------

Concepts
~~~~~~~~~~

For the mathematical details of each probabilistic model read:
:ref:`probabilistic_motion_models`.

Modifying the probabilistic motion model
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Menu path: Sensors -> Odometry -> Modify motion model...

Description: This dialog allows experimenting with the parameters of two
different probabilistic motion models and changing those parameters for all the odometry increments in the rawlog.

.. image:: images/Screenshot_topic_motion_model_thrun_0.png
:alt: Screenshot_topic_motion_model_thrun_0

Modeling the actual uncertainty may be critical for some particle filter-based
SLAM methods. As can be seen in the next example, sometimes it is needed to
increase the uncertainty of odometry increments up to the point that the
real hypothesis after closing a loop is included by the probability distribution
of all the potential robot paths:


.. image:: images/Screenshot-GenRandomPaths2.png
:alt: Screenshot-GenRandomPaths2

.. image:: images/Screenshot-GenRandomPaths1.png
:alt: Screenshot-GenRandomPaths1

Note how the loop closure cannot be correctly detected by a RBPF SLAM method
if the uncertainty in the odometry is over-confident, as in the first of the two images above.

Creating ‘odometry’ from scan-matching
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Menu path: Sensors -> Odometry -> Recalculate actions with ICP...

Description: This operation allows "correcting" the wheels-based odometry
readings by performing ICP-based scan matching between each pair of
consecutive observations.
Note that this operation is only implemented for rawlogs in the “SensoryFrame” format.


.. image:: images/Screenshot-RawMap-odo.png
:alt: Screenshot-RawMap-odo.png

.. image:: images/Screenshot-RawMap-odo-icp.png
:alt: Screenshot-RawMap-odo-icp


7. Browse point cloud sensors (LIDARs, RGBD)
-----------------------------------------------------

This video demonstrates RawLogViewer inspecting some datasets with
Velodyne 3D Lidar data, as well as others with 2D lidars and 3D RGB+D cameras:

.. raw:: html

<div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden; max-width: 100%; height: auto;">
<iframe src="https://www.youtube.com/embed/Dau0ir_L77w" frameborder="0" allowfullscreen style="position: absolute; top: 0; left: 0; width: 100%; height: 100%;"></iframe>
</div>

8. Browse images
--------------------

Menu path: Sensors -> Images -> Show images as a video...

Description: This module allows visualizing all existing imaging sensors in
a dataset as a video sequence or just peeking through the entire duration using a scrollbar:

Screenshot-Play_images_in_a_Rawlog_as_a_video

Note that this works for monocular cameras, stereo cameras and the intensity channel of 3D cameras.

9. Generating a ground truth path from rawlogs with 3 RTK GPS
--------------------------------------------------------------

This specifically applies to rawlogs described
in `this paper <https://www.mrpt.org/malaga_dataset_2009>`_.

Instructions:

- Load the rawlog.
- Click the “Raw map” button.
- If desired, mark the desired range of entries to process in the controls on the top.
- Also set a decimation>1 if you don’t mind not to insert all laser scans in
the 3D map, making the process a bit faster.
- Click “Map from RTK GPS”.
- The map should appear in the main area at the bottom. By hitting
“Save vehicle path…”, the reconstructed ground truth will be dumped to text files.
2 changes: 1 addition & 1 deletion doc/source/applications.rst
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,7 @@ also provides many ready-to-use applications:
page_app_ptg-configurator.rst
page_app_rawlog-edit.rst
page_app_rawlog-grabber.rst
page_app_RawLogViewer.rst
app_RawLogViewer.rst
page_app_rbpf-slam.rst
page_app_ReactiveNav3D-Demo.rst
page_app_ReactiveNavigationDemo.rst
Expand Down
4 changes: 2 additions & 2 deletions doc/source/conf.py
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
# -- Project information -----------------------------------------------------

project = u'MRPT'
copyright = u'{year} MRPT authors.'.format(year=datetime.now().year)
copyright = u'{year} MRPT authors'.format(year=datetime.now().year)

# The short X.Y version
version = u'v{VER}'.format(VER=os.environ['MRPT_VERSION_STR'])
Expand Down Expand Up @@ -162,7 +162,7 @@
# (source start file, name, description, authors, manual section).
man_pages = [
(master_doc, 'MRPT', u'MRPT Documentation',
[u'The MOLA Authors.'], 1)
[u'The MRPT Authors.'], 1)
]

# -- Options for Texinfo output ----------------------------------------------
Expand Down
3 changes: 0 additions & 3 deletions doc/source/doxygen-docs/app_RawLogViewer.md

This file was deleted.

2 changes: 1 addition & 1 deletion doc/source/env-vars.rst
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
.. env_vars:
.. _env_vars:

====================================================
Environment variables that MRPT looks for
Expand Down
Binary file added doc/source/images/RawlogViewerRole.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/source/images/Screenshot-GenRandomPaths1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/source/images/Screenshot-GenRandomPaths2.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/source/images/Screenshot-RawMap-odo-icp.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/source/images/Screenshot-RawMap-odo.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/source/images/rawlogviewer_UI_details.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion doc/source/mrpt_from_cmake.rst
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
.. _mrpt_from_cmake:

####################################
Using MRPT from your CMake project
Using MRPT in your CMake project
####################################

.. note::
Expand Down
2 changes: 1 addition & 1 deletion doc/source/mrpt_git_branches.rst
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
MRPT git branches
########################

MRP follows the `git-flow pattern <https://nvie.com/posts/a-successful-git-branching-model/>`_:
MRPT follows the `git-flow pattern <https://nvie.com/posts/a-successful-git-branching-model/>`_:

.. image:: images/git-flow-pattern.png
:alt: git-flow pattern
73 changes: 73 additions & 0 deletions doc/source/robotics_file_formats.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,73 @@
.. _robotics_file_formats:

########################
Robotics file formats
########################

MRPT defines a set of standard file formats with the intention of easing
the exchange of robotic raw datasets and, also, of already-built maps, between
different programs and C++ classes.

.. contents:: :local:

1. Datasets
------------

**Typical extension**: ``.rawlog``

Description:MRPT defines a binary format for robotic datasets, or rawlogs,
which can store the raw observations gathered by an arbitrary mix of sensors
for its posterior processing. The format is described in detail in the
Rawlog format page, among associated software tools and converters.

Related applications:

- :ref:`app_RawLogViewer`
- All offline SLAM programs.

2. Graph SLAM maps
--------------------

**Typical extension(s)**: ``.graph``, ``.graphbin``

Description: MRPT adopted the text format for 2D and 3D graphs (edges & nodes)
used by TORO, G2O, and others.

Related applications:

- :ref:`app_graph-slam`

3. “Simple maps”
------------------

**Typical extension(s)**: ``.simplemap``, ``.simplemap.gz``

Description: Sometimes called “view-based maps” in the literature: a set of
pairs of poses and their associated observations. Implemented in the type
mrpt::maps::CSimpleMap. Files can be transparently saved/loaded
with gzip-compression to save disk space.

Related applications:

- :ref:`app_robot-map-gui`
- :ref:`app_observations2map`

4. Occupancy grid maps
------------------------

**Typical extension(s)**: ``.gridmap``, ``.gridmap.gz``

Description: The serialization of an ``mrpt::maps::COccupancyGridMap2D`` object.

5. Scenes in 3D
-----------------

**Typical extension**: ``.3dscene``

Description: Files are usually transparently saved/loaded with
gzip-compression to save disk space.

Related applications:

- :ref:`doxid-app__scene_viewer3_d`.
- See: :ref:`doxid-tutorial_3_d_scenes`.
Loading

0 comments on commit 171942e

Please sign in to comment.