Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"14/0/0" as expiretile even its not in the limitto area #298

Open
mrclBIE opened this issue Jan 29, 2025 · 12 comments
Open

"14/0/0" as expiretile even its not in the limitto area #298

mrclBIE opened this issue Jan 29, 2025 · 12 comments

Comments

@mrclBIE
Copy link

mrclBIE commented Jan 29, 2025

With the newest version of Imposm (v0.14.0) we are facing an issue in the expire directory. The expire tile "14/0/0" is often created, which just can be a bug. Did anyone have an idea what can be the reason?

As a result, mapproxy becomes a problem caching a WMS because an incorrect BBOX is calculated from this tile.

@olt
Copy link
Member

olt commented Jan 29, 2025

I don't see 14/0/0 in the last 30 days. There are changes at 14/0/* and 14/16383/*, things crossing the dateline.

@mrclBIE
Copy link
Author

mrclBIE commented Jan 29, 2025

But we have had it several times now: For example:
14/0/0
14/8647/5410
or
14/0/0
14/8575/5417
or
14/0/0
14/8574/5416
I think they are generated after processing the sequenceNumber´s #6450345 till #6450566.

@pnorman
Copy link
Contributor

pnorman commented Jan 29, 2025

As a result, mapproxy becomes a problem caching a WMS because an incorrect BBOX is calculated from this tile

14/0/0 is a valid tile to expire, so if the rest of your toolchain can't handle it, that's a bug.

Without enough details to reproduce, it's not possible to say if 14/0/0 showing up in the expire list is an error or not.

@mrclBIE
Copy link
Author

mrclBIE commented Jan 29, 2025

You´re right, sorry. But our WMS is not valid in this location, so this is the reason why the error appears in mapproxy.

This is the BBOX of the limitto geometry [7.1 ,51.2 ,9.9 ,52.5]. Because it is limited to this extent, I assume that the 14/0/0 tile can not be laying in this extent, doesn´t it?
What can be furhter details I need to give to reproduce the issue?

@olt
Copy link
Member

olt commented Jan 29, 2025

Please always provide as much information as you can. That you are using -limitto, and that it only occurred in the last hours and not often is important information.

I suggest that you try another smaller import with a -limitto and try to import the changesets from this night. Let me know if and how you can reproduce the issue.

@mrclBIE
Copy link
Author

mrclBIE commented Jan 30, 2025

I have made a new data import and furthermore I have made a new imposm_cache directory to exclude the possibility of version incompatibilities. Despite it I have this 14/0/0 expire tiles again.
I imported the germany-latest.osm.pbf from yesterday with the timestamp 2025-01-28T21:21:00Z and the sequenceNumber 6449915. Currently the sequenceNumber 6452115 has been processed and I have 35 times this 14/0/0 expire tile again.

This is our import command:

 imposm import \
    -mapping /opt/etc/import/imposm_mapping.yml \
    -read /opt/var/osm_data/germany-latest.osm.pbf \
    -write \
    -diff \
    -quiet \
    -cachedir /opt/var/imposm_cache/ \
    -connection postgis://${DB_USERNAME}@${DB_HOST}:${DB_PORT}/${DB_NAME} \
    -dbschema-import osm_import \
    -dbschema-production osm \
    -dbschema-backup osm_backup \
    -srid 3857 \
    -limittocachebuffer 1.0 \
    -limitto /opt/etc/import/imposm_limitto.geojson \
    -overwritecache \
    -deployproduction

This is the import log:

{"log":"[2025-01-29T14:03:54Z] 0:00:00 [step] Starting: Reading limitto geometries\r\n","stream":"stdout","time":"2025-01-29T14:03:54.923489529Z"}
{"log":"[2025-01-29T14:03:54Z] 0:00:00 [step] Finished: Reading limitto geometries in 2.82972ms\r\n","stream":"stdout","time":"2025-01-29T14:03:54.926228935Z"}
{"log":"[2025-01-29T14:03:54Z] 0:00:00 [step] Starting: Imposm\r\n","stream":"stdout","time":"2025-01-29T14:03:54.931607618Z"}
{"log":"[2025-01-29T14:03:54Z] 0:00:00 [step] Starting: Reading OSM data\r\n","stream":"stdout","time":"2025-01-29T14:03:54.931627186Z"}
{"log":"[2025-01-29T14:03:54Z] 0:00:00 [info] reading /opt/var/osm_data/germany-latest.osm.pbf with data till 2025-01-28 21:21:00 +0000 UTC\r\n","stream":"stdout","time":"2025-01-29T14:03:54.990611614Z"}
{"log":"[2025-01-29T14:04:54Z] 0:01:00 [progress]   1m0s C: 2822000/s (169304000) N:   97500/s (5849766) W:       0/s (0) R:      0/s (0)\r\n","stream":"stdout","time":"2025-01-29T14:04:54.990169228Z"}
{"log":"[2025-01-29T14:05:54Z] 0:02:00 [progress]   2m0s C: 2895000/s (347376000) N:  118800/s (14259603) W:       0/s (0) R:      0/s (0)\r\n","stream":"stdout","time":"2025-01-29T14:05:54.989834897Z"}
{"log":"[2025-01-29T14:06:54Z] 0:03:00 [progress]   3m0s C: 2280000/s (410377899) N:  105500/s (18990397) W:  330900/s (12232000) R:      0/s (0)\r\n","stream":"stdout","time":"2025-01-29T14:06:54.989870661Z"}
{"log":"[2025-01-29T14:07:54Z] 0:04:00 [progress]   4m0s C: 2280000/s (410377899) N:  105500/s (18990397) W:  415700/s (40312000) R:      0/s (0)\r\n","stream":"stdout","time":"2025-01-29T14:07:54.990644364Z"}
{"log":"[2025-01-29T14:08:54Z] 0:05:00 [progress]   5m0s C: 2280000/s (410377899) N:  105500/s (18990397) W:  425400/s (66776991) R: 127700/s (319999)\r\n","stream":"stdout","time":"2025-01-29T14:08:54.990347245Z"}
{"log":"[2025-01-29T14:08:59Z] 0:05:04 [progress]   5m4s C: 2280000/s (410377899) N:  105500/s (18990397) W:  425400/s (66776991) R: 338410/s (847986)\r\n","stream":"stdout","time":"2025-01-29T14:08:59.196460771Z"}
{"log":"[2025-01-29T14:08:59Z] 0:05:04 [step] Finished: Reading OSM data in 5m4.348370943s\r\n","stream":"stdout","time":"2025-01-29T14:08:59.280107519Z"}
{"log":"[2025-01-29T14:08:59Z] 0:05:04 [step] Starting: Importing OSM data\r\n","stream":"stdout","time":"2025-01-29T14:08:59.843180947Z"}
{"log":"[2025-01-29T14:08:59Z] 0:05:04 [step] Starting: Writing OSM data\r\n","stream":"stdout","time":"2025-01-29T14:08:59.84320407Z"}
{"log":"[2025-01-29T14:09:59Z] 0:06:04 [progress]   1m0s C:       0/s ( 0.0%) N:       0/s ( 0.0%) W:       0/s ( 0.0%) R:   3590/s (24.6%)\r\n","stream":"stdout","time":"2025-01-29T14:09:59.843426624Z"}
{"log":"[2025-01-29T14:10:59Z] 0:07:04 [progress]   2m0s C:       0/s ( 0.0%) N:       0/s ( 0.0%) W:   52400/s ( 3.7%) R:   2400/s (33.5%)\r\n","stream":"stdout","time":"2025-01-29T14:10:59.843496201Z"}
{"log":"[2025-01-29T14:11:59Z] 0:08:04 [progress]   3m0s C:       0/s ( 0.0%) N:       0/s ( 0.0%) W:   67300/s (10.8%) R:   2400/s (33.5%)\r\n","stream":"stdout","time":"2025-01-29T14:11:59.843297733Z"}
{"log":"[2025-01-29T14:12:59Z] 0:09:04 [progress]   4m0s C:       0/s ( 0.0%) N:       0/s ( 0.0%) W:   82500/s (20.6%) R:   2400/s (33.5%)\r\n","stream":"stdout","time":"2025-01-29T14:12:59.843352195Z"}
{"log":"[2025-01-29T14:13:59Z] 0:10:04 [progress]   5m0s C:       0/s ( 0.0%) N:       0/s ( 0.0%) W:   87000/s (29.6%) R:   2400/s (33.5%)\r\n","stream":"stdout","time":"2025-01-29T14:13:59.843236027Z"}
{"log":"[2025-01-29T14:14:59Z] 0:11:04 [progress]   6m0s C:       0/s ( 0.0%) N:  286700/s (19.5%) W:   85600/s (36.8%) R:   2400/s (33.5%)\r\n","stream":"stdout","time":"2025-01-29T14:14:59.843358029Z"}
{"log":"[2025-01-29T14:15:08Z] 0:11:14 [progress]   6m9s C:       0/s ( 0.0%) N:  482300/s (32.9%) W:   85600/s (36.8%) R:   2400/s (33.5%)\r\n","stream":"stdout","time":"2025-01-29T14:15:08.979380092Z"}
{"log":"[2025-01-29T14:15:09Z] 0:11:14 [step] Finished: Writing OSM data in 6m10.079254792s\r\n","stream":"stdout","time":"2025-01-29T14:15:09.9224167Z"}
{"log":"[2025-01-29T14:15:09Z] 0:11:15 [step] Starting: Creating generalized tables\r\n","stream":"stdout","time":"2025-01-29T14:15:09.922439179Z"}
{"log":"[2025-01-29T14:15:09Z] 0:11:15 [step] Starting: Generalizing osm_landusages into osm_landusages_gen38\r\n","stream":"stdout","time":"2025-01-29T14:15:09.922891659Z"}
{"log":"[2025-01-29T14:15:09Z] 0:11:15 [step] Starting: Generalizing osm_roads into osm_roads_gen9\r\n","stream":"stdout","time":"2025-01-29T14:15:09.92290316Z"}
{"log":"[2025-01-29T14:15:09Z] 0:11:15 [step] Starting: Generalizing osm_waterways into osm_waterways_gen9\r\n","stream":"stdout","time":"2025-01-29T14:15:09.922926543Z"}
{"log":"[2025-01-29T14:15:12Z] 0:11:17 [step] Finished: Generalizing osm_waterways into osm_waterways_gen9 in 2.710717493s\r\n","stream":"stdout","time":"2025-01-29T14:15:12.633697818Z"}
{"log":"[2025-01-29T14:15:25Z] 0:11:30 [step] Finished: Generalizing osm_roads into osm_roads_gen9 in 15.942131312s\r\n","stream":"stdout","time":"2025-01-29T14:15:25.865120272Z"}
{"log":"[2025-01-29T14:16:25Z] 0:12:30 [step] Finished: Generalizing osm_landusages into osm_landusages_gen38 in 1m15.643375584s\r\n","stream":"stdout","time":"2025-01-29T14:16:25.566411616Z"}
{"log":"[2025-01-29T14:16:25Z] 0:12:30 [step] Starting: Generalizing osm_roads into osm_roads_gen75\r\n","stream":"stdout","time":"2025-01-29T14:16:25.567212369Z"}
{"log":"[2025-01-29T14:16:25Z] 0:12:30 [step] Starting: Generalizing osm_waterways into osm_waterways_gen38\r\n","stream":"stdout","time":"2025-01-29T14:16:25.567226017Z"}
{"log":"[2025-01-29T14:16:26Z] 0:12:31 [step] Finished: Generalizing osm_waterways into osm_waterways_gen38 in 928.607063ms\r\n","stream":"stdout","time":"2025-01-29T14:16:26.49585073Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Finished: Generalizing osm_roads into osm_roads_gen75 in 1.568386865s\r\n","stream":"stdout","time":"2025-01-29T14:16:27.135631294Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Starting: Generalizing osm_roads into osm_roads_gen300\r\n","stream":"stdout","time":"2025-01-29T14:16:27.135651525Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Starting: Generalizing osm_waterways into osm_waterways_gen150\r\n","stream":"stdout","time":"2025-01-29T14:16:27.135653729Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Finished: Generalizing osm_waterways into osm_waterways_gen150 in 69.662465ms\r\n","stream":"stdout","time":"2025-01-29T14:16:27.205442003Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Finished: Generalizing osm_roads into osm_roads_gen300 in 294.057658ms\r\n","stream":"stdout","time":"2025-01-29T14:16:27.429826741Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Starting: Generalizing osm_roads into osm_roads_gen1200\r\n","stream":"stdout","time":"2025-01-29T14:16:27.429851307Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Finished: Generalizing osm_roads into osm_roads_gen1200 in 75.615616ms\r\n","stream":"stdout","time":"2025-01-29T14:16:27.505468288Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Finished: Creating generalized tables in 1m17.583077831s\r\n","stream":"stdout","time":"2025-01-29T14:16:27.505488871Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Starting: Creating geometry indices\r\n","stream":"stdout","time":"2025-01-29T14:16:27.5054913Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Starting: Creating geometry index on osm_transport_areas\r\n","stream":"stdout","time":"2025-01-29T14:16:27.505540522Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Starting: Creating geometry index on osm_amenity_points\r\n","stream":"stdout","time":"2025-01-29T14:16:27.505542818Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Starting: Creating geometry index on osm_waterways\r\n","stream":"stdout","time":"2025-01-29T14:16:27.50564779Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Starting: Creating geometry index on osm_admin\r\n","stream":"stdout","time":"2025-01-29T14:16:27.505666364Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Starting: Creating geometry index on osm_master_routes\r\n","stream":"stdout","time":"2025-01-29T14:16:27.505668599Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Starting: Creating geometry index on osm_roads\r\n","stream":"stdout","time":"2025-01-29T14:16:27.505670021Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Starting: Creating geometry index on osm_places\r\n","stream":"stdout","time":"2025-01-29T14:16:27.505747131Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Starting: Creating geometry index on osm_route_members\r\n","stream":"stdout","time":"2025-01-29T14:16:27.505875074Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Finished: Creating geometry index on osm_transport_areas in 2.718671ms\r\n","stream":"stdout","time":"2025-01-29T14:16:27.50826887Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Starting: Creating geometry index on osm_transport_points\r\n","stream":"stdout","time":"2025-01-29T14:16:27.508275595Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Finished: Creating geometry index on osm_places in 104.71329ms\r\n","stream":"stdout","time":"2025-01-29T14:16:27.610409192Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Starting: Creating geometry index on osm_landusages_overlay\r\n","stream":"stdout","time":"2025-01-29T14:16:27.610428039Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Finished: Creating geometry index on osm_master_routes in 319.271504ms\r\n","stream":"stdout","time":"2025-01-29T14:16:27.824949902Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Starting: Creating geometry index on osm_landusages\r\n","stream":"stdout","time":"2025-01-29T14:16:27.82504161Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Finished: Creating geometry index on osm_landusages_overlay in 234.933922ms\r\n","stream":"stdout","time":"2025-01-29T14:16:27.84541645Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Starting: Creating geometry index on osm_amenity_areas\r\n","stream":"stdout","time":"2025-01-29T14:16:27.845438404Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Finished: Creating geometry index on osm_admin in 364.555826ms\r\n","stream":"stdout","time":"2025-01-29T14:16:27.87021165Z"}
{"log":"[2025-01-29T14:16:27Z] 0:12:32 [step] Starting: Creating OSM id index on osm_landusages_gen38\r\n","stream":"stdout","time":"2025-01-29T14:16:27.870226835Z"}
{"log":"[2025-01-29T14:16:28Z] 0:12:33 [step] Finished: Creating OSM id index on osm_landusages_gen38 in 710.550815ms\r\n","stream":"stdout","time":"2025-01-29T14:16:28.580807802Z"}
{"log":"[2025-01-29T14:16:28Z] 0:12:33 [step] Starting: Creating geometry index on osm_landusages_gen38\r\n","stream":"stdout","time":"2025-01-29T14:16:28.580826181Z"}
{"log":"[2025-01-29T14:16:30Z] 0:12:35 [step] Finished: Creating geometry index on osm_waterways in 3.066093765s\r\n","stream":"stdout","time":"2025-01-29T14:16:30.571748149Z"}
{"log":"[2025-01-29T14:16:30Z] 0:12:35 [step] Starting: Creating OSM id index on osm_roads_gen1200\r\n","stream":"stdout","time":"2025-01-29T14:16:30.571769932Z"}
{"log":"[2025-01-29T14:16:30Z] 0:12:35 [step] Finished: Creating OSM id index on osm_roads_gen1200 in 19.489772ms\r\n","stream":"stdout","time":"2025-01-29T14:16:30.59128458Z"}
{"log":"[2025-01-29T14:16:30Z] 0:12:35 [step] Starting: Creating geometry index on osm_roads_gen1200\r\n","stream":"stdout","time":"2025-01-29T14:16:30.591301304Z"}
{"log":"[2025-01-29T14:16:30Z] 0:12:35 [step] Finished: Creating geometry index on osm_transport_points in 3.098674361s\r\n","stream":"stdout","time":"2025-01-29T14:16:30.607018996Z"}
{"log":"[2025-01-29T14:16:30Z] 0:12:35 [step] Starting: Creating OSM id index on osm_roads_gen300\r\n","stream":"stdout","time":"2025-01-29T14:16:30.607035085Z"}
{"log":"[2025-01-29T14:16:30Z] 0:12:35 [step] Finished: Creating geometry index on osm_roads_gen1200 in 52.067253ms\r\n","stream":"stdout","time":"2025-01-29T14:16:30.643402181Z"}
{"log":"[2025-01-29T14:16:30Z] 0:12:35 [step] Starting: Creating OSM id index on osm_roads_gen75\r\n","stream":"stdout","time":"2025-01-29T14:16:30.64341915Z"}
{"log":"[2025-01-29T14:16:30Z] 0:12:35 [step] Finished: Creating OSM id index on osm_roads_gen300 in 41.259052ms\r\n","stream":"stdout","time":"2025-01-29T14:16:30.648309482Z"}
{"log":"[2025-01-29T14:16:30Z] 0:12:35 [step] Starting: Creating geometry index on osm_roads_gen300\r\n","stream":"stdout","time":"2025-01-29T14:16:30.648323435Z"}
{"log":"[2025-01-29T14:16:30Z] 0:12:35 [step] Finished: Creating OSM id index on osm_roads_gen75 in 103.965323ms\r\n","stream":"stdout","time":"2025-01-29T14:16:30.74741443Z"}
{"log":"[2025-01-29T14:16:30Z] 0:12:35 [step] Starting: Creating geometry index on osm_roads_gen75\r\n","stream":"stdout","time":"2025-01-29T14:16:30.74743241Z"}
{"log":"[2025-01-29T14:16:30Z] 0:12:36 [step] Finished: Creating geometry index on osm_roads_gen300 in 340.645787ms\r\n","stream":"stdout","time":"2025-01-29T14:16:30.989015799Z"}
{"log":"[2025-01-29T14:16:30Z] 0:12:36 [step] Starting: Creating OSM id index on osm_roads_gen9\r\n","stream":"stdout","time":"2025-01-29T14:16:30.989033392Z"}
{"log":"[2025-01-29T14:16:31Z] 0:12:36 [step] Finished: Creating OSM id index on osm_roads_gen9 in 604.212844ms\r\n","stream":"stdout","time":"2025-01-29T14:16:31.593276952Z"}
{"log":"[2025-01-29T14:16:31Z] 0:12:36 [step] Starting: Creating geometry index on osm_roads_gen9\r\n","stream":"stdout","time":"2025-01-29T14:16:31.593295586Z"}
{"log":"[2025-01-29T14:16:32Z] 0:12:37 [step] Finished: Creating geometry index on osm_roads_gen75 in 1.982345511s\r\n","stream":"stdout","time":"2025-01-29T14:16:32.729813413Z"}
{"log":"[2025-01-29T14:16:32Z] 0:12:37 [step] Starting: Creating OSM id index on osm_waterways_gen150\r\n","stream":"stdout","time":"2025-01-29T14:16:32.729832173Z"}
{"log":"[2025-01-29T14:16:32Z] 0:12:37 [step] Finished: Creating OSM id index on osm_waterways_gen150 in 43.495871ms\r\n","stream":"stdout","time":"2025-01-29T14:16:32.773456972Z"}
{"log":"[2025-01-29T14:16:32Z] 0:12:37 [step] Starting: Creating geometry index on osm_waterways_gen150\r\n","stream":"stdout","time":"2025-01-29T14:16:32.773481384Z"}
{"log":"[2025-01-29T14:16:32Z] 0:12:37 [step] Finished: Creating geometry index on osm_waterways_gen150 in 8.279161ms\r\n","stream":"stdout","time":"2025-01-29T14:16:32.781665007Z"}
{"log":"[2025-01-29T14:16:32Z] 0:12:37 [step] Starting: Creating OSM id index on osm_waterways_gen38\r\n","stream":"stdout","time":"2025-01-29T14:16:32.781684527Z"}
{"log":"[2025-01-29T14:16:32Z] 0:12:37 [step] Finished: Creating OSM id index on osm_waterways_gen38 in 68.790619ms\r\n","stream":"stdout","time":"2025-01-29T14:16:32.850489763Z"}
{"log":"[2025-01-29T14:16:32Z] 0:12:37 [step] Starting: Creating geometry index on osm_waterways_gen38\r\n","stream":"stdout","time":"2025-01-29T14:16:32.850511361Z"}
{"log":"[2025-01-29T14:16:34Z] 0:12:39 [step] Finished: Creating geometry index on osm_waterways_gen38 in 1.338396679s\r\n","stream":"stdout","time":"2025-01-29T14:16:34.188937478Z"}
{"log":"[2025-01-29T14:16:34Z] 0:12:39 [step] Starting: Creating OSM id index on osm_waterways_gen9\r\n","stream":"stdout","time":"2025-01-29T14:16:34.188961542Z"}
{"log":"[2025-01-29T14:16:34Z] 0:12:39 [step] Finished: Creating OSM id index on osm_waterways_gen9 in 190.257853ms\r\n","stream":"stdout","time":"2025-01-29T14:16:34.379200038Z"}
{"log":"[2025-01-29T14:16:34Z] 0:12:39 [step] Starting: Creating geometry index on osm_waterways_gen9\r\n","stream":"stdout","time":"2025-01-29T14:16:34.379217698Z"}
{"log":"[2025-01-29T14:16:35Z] 0:12:40 [step] Finished: Creating geometry index on osm_waterways_gen9 in 1.123898888s\r\n","stream":"stdout","time":"2025-01-29T14:16:35.503152871Z"}
{"log":"[2025-01-29T14:16:37Z] 0:12:42 [step] Finished: Creating geometry index on osm_amenity_points in 9.804049119s\r\n","stream":"stdout","time":"2025-01-29T14:16:37.309666358Z"}
{"log":"[2025-01-29T14:16:39Z] 0:12:45 [step] Finished: Creating geometry index on osm_landusages_gen38 in 11.369776751s\r\n","stream":"stdout","time":"2025-01-29T14:16:39.950606765Z"}
{"log":"[2025-01-29T14:16:40Z] 0:12:45 [step] Finished: Creating geometry index on osm_landusages in 12.447657545s\r\n","stream":"stdout","time":"2025-01-29T14:16:40.272740155Z"}
{"log":"[2025-01-29T14:16:44Z] 0:12:49 [step] Finished: Creating geometry index on osm_roads_gen9 in 13.121974113s\r\n","stream":"stdout","time":"2025-01-29T14:16:44.715363268Z"}
{"log":"[2025-01-29T14:16:48Z] 0:12:53 [step] Finished: Creating geometry index on osm_roads in 20.614764154s\r\n","stream":"stdout","time":"2025-01-29T14:16:48.120512055Z"}
{"log":"[2025-01-29T14:17:01Z] 0:13:06 [step] Finished: Creating geometry index on osm_route_members in 34.267169937s\r\n","stream":"stdout","time":"2025-01-29T14:17:01.772889184Z"}
{"log":"[2025-01-29T14:17:26Z] 0:13:31 [step] Finished: Creating geometry index on osm_amenity_areas in 58.973693263s\r\n","stream":"stdout","time":"2025-01-29T14:17:26.819430372Z"}
{"log":"[2025-01-29T14:17:26Z] 0:13:31 [step] Finished: Creating geometry indices in 59.313802571s\r\n","stream":"stdout","time":"2025-01-29T14:17:26.819455967Z"}
{"log":"[2025-01-29T14:17:26Z] 0:13:31 [step] Finished: Importing OSM data in 8m26.976260052s\r\n","stream":"stdout","time":"2025-01-29T14:17:26.819459684Z"}
{"log":"[2025-01-29T14:17:26Z] 0:13:31 [step] Starting: Rotating tables\r\n","stream":"stdout","time":"2025-01-29T14:17:26.819462049Z"}
{"log":"[2025-01-29T14:17:26Z] 0:13:31 [info] Rotating osm_roads from osm_import -\u003e osm -\u003e osm_backup\r\n","stream":"stdout","time":"2025-01-29T14:17:26.822142297Z"}
{"log":"[2025-01-29T14:17:26Z] 0:13:31 [info] backup of osm_roads, to osm_backup\r\n","stream":"stdout","time":"2025-01-29T14:17:26.825613858Z"}
{"log":"[2025-01-29T14:17:26Z] 0:13:31 [step] Finished: Rotating tables in 23.045705ms\r\n","stream":"stdout","time":"2025-01-29T14:17:26.842433965Z"}
{"log":"[2025-01-29T14:17:26Z] 0:13:31 SQL Error: pq: cannot drop table osm_backup.osm_roads because other objects depend on it in query SELECT DropGeometryTable('osm_backup', 'osm_roads');\r\n","stream":"stdout","time":"2025-01-29T14:17:26.842441886Z"}

This is our run command to keep the data up to date:

imposm run \
    -mapping imposm_mapping.yml \
    -cachedir /opt/var/imposm_cache/ \
    -connection postgis://${DB_USERNAME}@${DB_HOST}:${DB_PORT}/${DB_NAME} \
    -dbschema-production ${DB_SCHEMA} \
    -srid ${SRID} \
    -limittocachebuffer 1.0 \
    -limitto /opt/etc/import/imposm_limitto.geojson \
    -config /opt/etc/import/imposm_config.json

This is the imposm_config.json:

{
    "diffdir": "/opt/var/imposm_cache/diff",
    "expiredir": "/opt/var/imposm_cache/expire",
    "expiretiles_dir": "/opt/var/imposm_cache/expire",
    "replication_url": "https://planet.openstreetmap.org/replication/minute/",
    "replication_interval": "1m",
    "changesdir": "/opt/var/imposm_cache/changes",
    "changeset_url": "https://planet.openstreetmap.org/replication/changesets/",
    "connection": "postgis://${DB_USERNAME}@${DB_HOST}:${DB_PORT}/${DB_NAME}",
    "changes_bbox": [7.1 ,51.2 ,9.9 ,52.5],
    "initial_history": "32h",
    "schemas": {
        "changes": "changes"
    }
}

Do you need some more informations @olt?

@mrclBIE mrclBIE changed the title "14/0/0" as expiretile "14/0/0" as expiretile even its not in the limitto area Jan 30, 2025
@mrclBIE
Copy link
Author

mrclBIE commented Feb 7, 2025

The error occurs permanently, every day. Yesterday with nearly 500 occurences. I exit the program at the end of the day, delete all occurrences of the string and restart the program in the morning. Were you able to reproduce the error @olt ?

@olt
Copy link
Member

olt commented Feb 7, 2025

I haven't found a single 14/0/0 on our servers. It's on my list to check for any obvious errors in the tile expire lists in combination with limitto. But please note that I won't be able to do a full countrywide import to hunt down this issue.

@mrclBIE
Copy link
Author

mrclBIE commented Feb 7, 2025

Ok, thanks. Notice, that the import isn´t countrywide, just Bielefeld and the surrounding area. Until then we will switch back to the older version.

@mrclBIE
Copy link
Author

mrclBIE commented Feb 24, 2025

We switched back to an older version and now the error doesn´t occur anymore.

@olt
Copy link
Member

olt commented Feb 24, 2025

I checked the implementation, and the generated expire tiles are not checked for -limitto. So it is correct that there are tiles outside of -limitto (from larger ways and relations).

There was a bug where it created expire tiles for points outside of the valid Web Mercator boundaries. This is now fixed. It is still possible to see 14/0/0 tiles, as it is a valid tile.

@mrclBIE
Copy link
Author

mrclBIE commented Feb 24, 2025

Thank you. I'll let you know when we've tested the new version. I'm aware that the 14/0/0 tile can appear. But in this frequency it was definitely wrong.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants