Skip to content

Releases: osmcode/libosmium

Version 2.13.1

25 Aug 11:29
Compare
Choose a tag to compare

Added

  • New "blackhole" file format which throws away all data written into it. Used for benchmarking.

Changed

  • When reading OPL files, CRLF file endings are now handled correctly.
  • Reduce the max number of threads allowed for the Pool to 32. This should still be plenty and might help with test failures on some architectures.

Fixed

  • Tests now run correctly independent of git core.autocrlf setting.
  • Set binary mode for all files on Windows in example code.
  • Low-level file functions now set an invalid parameter handler on Windows to properly handle errors.
  • Restore earlier behaviour allowing zero-length mmap. It is important to allow zero-length memory mapping, because it is possible that such an index is empty, for instance when one type of object is missing from an input file as in osmcode/osmium-tool#65. Drawback is that files must be opened read-write for this to work, even if we only want to read from them.
  • Use Approx() to compare floating point values in tests.
  • Fix broken Item test on 32 bit platforms.

Version 2.13.0

15 Aug 12:43
Compare
Choose a tag to compare

Added

  • New RelationsManager class superseeds the relations::Collector class. The new class is much more modular and easier to extend. If you are using the Collector class, you are encouraged to switch.
  • New MultipolygonManager based on the RelationsManager class superseeds the MultipolygonCollector class. The examples have been changed to use the new class and all users are encouraged to switch. There is also a MultipolygonManagerLegacy class if you still need old-style multipolygon support (see below).
  • New FlexMem index class that works with input files of any size and stores the index in memory. This should now be used as the default index for node location stores. Several example programs now use this index.
  • New CallbackBuffer class, basically a convenient wrapper around the Buffer class with an additional callback function that is called whenever the buffer is full.
  • Introduce new ItemStash class for storing OSM objects in memory.
  • New osmium::geom::overlaps() function to check if two Box objects overlap.
  • Add function IdSet::used_memory() to get estimate of memory used in the set.
  • New is_defined() and is_undefined() methods on Location class.
  • Tests for all provided example programs. (Some tests currently fail on Windows for the osmium_index_lookup program.)

Changed

  • The area Assembler now doesn't work with old-style multipolygons (those are multipolygon relations with the tags on the outer ways(s) instead of on the relation) any more. Because old-style multipolygons are now (mostly) gone from the OSM database this is usually what you want. The new AssemblerLegacy class can be used if you actually need support for old-style multipolygons, for instance if you are working with historical data. (In that case you also need to use the MultipolygonManagerLegacy class instead of the MultipolygonManager class.)
  • Changes for consistent ordering of OSM data: OSM data can come in any order, but usual OSM files are ordered by type, ID, and version. These changes extend this ordering to negative IDs which are sometimes used for objects that have not been uploaded to the OSM server yet. The negative IDs are ordered now before the positive ones, both in order of their absolute value. This is the same ordering as JOSM uses.
  • Multipolygon assembler now checks for three or more overlapping segments which are always an error and can report them.
  • Enable use of user-provided thread::Pool instances in Reader and Writer for special use cases.
  • Growing a Buffer will now work with any capacity parameter, it is always rounded up for proper alignment. Buffer constructor with three arguments will now check that commmitted is not larger than capacity.
  • Updated embedded protozero to 1.5.2.
  • Update version of Catch unit test framework to 1.9.7.
  • And, as always, lots of small code cleanups and more tests.

Fixed

  • Buffers larger than 2^32 bytes do now work.
  • Output coordinate with value of -2^31 correctly.
  • Changeset comments with more than 2^16 characters are now allowed. The new maximum size is 2^32.
  • ChangesetDiscussionBuilder::add_comment_text() could fail silently instead of throwing an exception.
  • Changeset bounding boxes are now always output to OSM files (any format) if at least one of the corners is defined. This is needed to handle broken data from the main OSM database which contains such cases. The OPL reader has also been fixed to handle this case.
  • In the example osmium_location_cache_create, the index file written is always truncated first.

Version 2.11.4

15 Aug 15:37
Compare
Choose a tag to compare

This is a bugfix-only release for a stable branch.

Fixed

  • Output coordinate with value of -2^31 correctly.
  • Buffers larger than 2^32 bytes do now work.

Version 2.12.2

03 May 08:18
Compare
Choose a tag to compare

Added

  • Add two argument (key, value) overload of TagMatcher::operator().

Changed

  • Detect, report, and remove duplicate ways in multipolygon relations.
  • Change EOF behaviour of Reader: The Reader::read() function will now always return an invalid buffer exactly once to signal EOF.
  • Update QGIS multipolygon project that is part of the test suite to show more problem types.
  • Copy multipolygon QGIS file for tests to build dir in cmake step.
  • Some code cleanups and improved debug output in multipolygon code.
  • Refactor I/O code to simplify code.
  • Disable some warnings on MSVC.
  • Various small code and build script changes.

Fixed

  • Two bugs in area assembler affecting very complex multipolygons and multipolygons with overlapping or nearly overlapping lines.
  • Invalid use of iterators leading to undefined behaviour in area assembler code.
  • Area assembler stats were not correctly counting inner rings that are areas in their own right.
  • Fix a thread problem valgrind found that might or might not be real.
  • Read OPL file correctly even if trailing newline in file is missing.
  • Include order for osmium/index/map headers and osmium/index/node_locations_map.hpp (or osmium/handler/node_locations_for_ways.hpp) doesn't matter any more.

Version 2.11.3

03 May 12:03
Compare
Choose a tag to compare

Fixed

  • Two bugs in area assembler affecting very complex multipolygons and multipolygons with overlapping or nearly overlapping lines.
  • Invalid use of iterators leading to undefined behaviour in area assembler code.
  • Read OPL file correctly even if trailing newline in file is missing.

Version 2.12.1

10 Apr 06:49
Compare
Choose a tag to compare

Added

  • New TagsFilter::set_default_result() function.

Changed

  • Use larger capacity for Buffer if necessary for alignment instead of
    throwing an exception. Minimum buffer size is now 64 bytes.
  • Check order of input data in relations collector. The relations collector
    can not deal with history data or a changes file. This was documented as a
    requirement, but often lead to problems, because this was ignored by users.
    So it now checks that the input data it gets is ordered and throws an
    exception otherwise.
  • When writing an OSM file, set generator to libosmium if not set by app.

Fixed

  • Infinite loop in Buffer::reserve_space(). (Issue #202.)
  • ObjectPointerCollection::unique() now removes elements at end.
  • Tests comparing double using == operator.
  • Build on Cygwin.

Version 2.11.2

10 Apr 06:55
Compare
Choose a tag to compare

Fixed

  • Use minimum size of 64 bytes for buffers. This fixes an infinite loop
    when buffer size is zero.

Version 2.12.0

07 Mar 12:52
Compare
Choose a tag to compare

Added

  • TagMatcher and TagsFilter classes for more flexibly matching tags and
    selecting objects based on tags. This obsoletes the less flexible classes
    based on osmium::tags::Filter classes.
  • Extended index::RelationsMap(Stash|Index) classes to also allow
    parent-to-member lookups.
  • New nrw_array helper class.
  • ObjectPointerCollection::unique() function.

Changed

  • Area assembler can now detect invalid locations and report them in the
    stats and through the problem reporter. If the new config option
    ignore_invalid_locations is set, the Assembler will pretend they weren't
    even referenced in the ways. (Issue #195.)
  • osmium::area::Assembler::operator() will now return a boolean reporting
    whether building of the area(s) was successful.
  • Split up area Assembler class into three classes: The
    detail::BasicAssembler is now the parent class. Assembler is the child
    class for usual use. The new GeomAssembler also derives from
    BasicAssembler and builds areas without taking tags into account at all.
    This is to support osm2pgsql which does tag handling itself. (Issue #194.)
  • The Projection class can do any projection supported by the Proj.4
    library. As a special case it now uses our own Mercator projection
    functions when the web mercator projection (EPSG 3857) is used. This is
    much faster than going through Proj.4.
  • Better error messages for low-level file utility functions.
  • Mark build_tag_list* functions in builder_helper.hpp as deprecated. You
    should use the functions from osmium/builder/attr.hpp instead.
  • Improved performance of the osmium::tags::match_(any|all|none)_of
    functions.
  • Improved performance of string comparison in tags::Filter.
  • Update version of Catch unit test framework to 1.8.1. This meant some
    tests had to be updated.
  • Use get_noexcept() in NodeLocationsForWays handler.
  • And lots of code and test cleanups...

Fixed

  • Terminate called on full non-auto-growing buffer. (Issue #189.)
  • When file formats were used that were not compiled into the binary, it
    terminated instead of throwing. (Issue #197.)
  • Windows build problem related to including two different winsock versions.
  • Windows build problem related to forced build for old Windows versions.
    (Issue #196.)
  • Clear stream contents in ProblemReporterException correctly.
  • Add -pthread compiler and linker options on Linux/OSX. This should fix
    a problem where some linker versions will not link binaries correctly when
    the --as-needed option is used.
  • The Filter::count() method didn't compile at all.
  • XML reader doesn't fail on relation member ref=0 any more.

Version 2.11.1

07 Mar 12:55
Compare
Choose a tag to compare

Fixed

  • Terminate called on full non-auto-growing buffer. (Issue #189.)
  • When file formats were used that were not compiled into the binary, it
    terminated instead of throwing. (Issue #197.)
  • The Filter::count() method didn't compile at all.

Version 2.11.0

14 Jan 10:51
Compare
Choose a tag to compare

Added

  • New index::RelationsMap(Stash|Index) classes implementing an index for
    looking up parent relation IDs given a member relation ID.
  • Add get_noexcept() method to all index maps. For cases where ids are
    often not in the index using this can speed up a program considerably.
  • New non-const WayNodeList::operator[].
  • Default constructed "invalid" Coordinates.
  • Tile constructor from web mercator coordinates and some helper
    functions for tile arithmetic.
  • Tag matcher matching keys using a regex.
  • New envelope() functions on NodeRefList, Way, and Area returning a
    Box object with the geometric envelope of the object.
  • Add amenity_list example.

Changed

  • Replaced the implementation for the web mercator projection using the usual
    tan-formula with a polynomial approximation which is much faster and good
    enough for OSM data which only has ~1cm resolution anyway. See
    https://github.com/osmcode/mercator-projection for all the details and
    benchmarks. You can disable this by defining the macro
    OSMIUM_USE_SLOW_MERCATOR_PROJECTION before including any of the Osmium
    headers.
  • Removed the outdated Makefile. Always use CMake directly to build.
  • Refactoring of osmium::apply() removing the resursive templates for faster
    compile times and allowing rvalue handlers.
  • Lots of code and test cleanups and more documentation.

Fixed

  • Handle endianess on FreeBSD properly.
  • Fixed doxygen config for reproducible builds.