Tag: OSM

How did you contribute the *last couple of months* to OpenStreetMap?

I think most of you know my website: “How did you contribute to OpenStreetMap?“. It is a website where you can find information about OpenStreetMap contributors. You can see the first/last node the contributor placed and the amount of created nodes, ways, relations and other things.

Today I added a new diagram (1). It shows your monthly contributions to OpenStreetMap for the past 12 months as a chart and it’s based on the latest Full OSM History Planet Dump. In the following picture you can see the updates.

By clicking at “Get more Information …” (below the chart) you can see your past contributions in more detail. Separated into different categories such as created, touched and your “last modifier” OSM objects (nodes, ways and relations).

As a second update you can now see your first OSM way and OSM relation at the website (2). Check it out here: http://hdyc.neis-one.org

thx @ maɪˈæmɪ Dennis 🙂

Edit Stats for OSM Japan

Kate created some editing stats for OpenStreetMap Japan last Thursday. You can find her blog post here: “Quick Japan Editing Stats for OpenStreetMap”

During the creation of the layers for the “Road Status in Japan”, I log some editing information of OpenStreetMap too. As I mentioned in my blog post, I use the Geofabrik extracts for Japan (Sendai region only). They have the following bounding box (thx Frederik):

polygon
1
1.412259E+02 3.663895E+01
1.427964E+02 4.038643E+01
1.411296E+02 4.038351E+01
1.394639E+02 3.665750E+01
1.412259E+02 3.663895E+01
END
END

And here are several diagrams of the editing in Japan (Sendai region only):

In numbers (March 20th, 2011 12:50):

  • Overall amount of OSM Nodes: 5138123
  • Overall amount of OSM Ways: 149978
  • Overall amount of Highways: 47156
  • Number of Barrier Nodes: 528
  • Impassable Ways: 463
  • Number of Users (Contributors): 308
  • Length of OSM Ways [km]: 29049,71
  • Length of impassable Ways [km]: 222,58

thx @ Dennis and best of luck for tomorrow!

[Update #1 – March 25th, 2011 21.00] – I have updated all diagrams above !

  • Overall amount of OSM Nodes: 5258135
  • Overall amount of OSM Ways: 169557
  • Overall amount of Highways: 59120
  • Number of Barrier Nodes: 549
  • Impassable Ways: 801
  • Number of Users (Contributors): 414
  • Tsunami:Damage Polygons: 608
  • Length of OSM Ways [km]: 32408,75
  • Length of impassable Ways [km]: 371,67

[Update #2 – April 08th, 2011] – I have updated all diagrams above !

  • Overall amount of OSM Nodes: 6304539
  • Overall amount of OSM Ways: 271768
  • Overall amount of Highways: 150556
  • Number of Barrier Nodes: 597
  • Impassable Ways: 879
  • Number of Users (Contributors): 435
  • Tsunami:Damage Polygons: 622
  • Length of OSM Ways [km]: 58700,66
  • Length of impassable Ways [km]: 387,60

Road Status after the Earthquake in Japan based on OSM

Yesterday, Bing Maps has announced a map for Japan, which shows the “Road-Status after the Earthquake”. The information seems to be from Honda (footer: “Status of Roads provided by Honda”).

My first thought: with OpenStreetMap it is possible too!
So here we go: The Geofabrik generates hourly new files for Japan (Sendai region only). It’s available here. I have written a small script that only gets the highways out of these files and after that I imported them in a PostGIS/PostgreSQL database. Finally they are available in a Geoserver WMS/WFS.

The processing steps with its time range are:

  1. Download OSM file from the Geofabrik Server: ca. 25sec.
  2. Generate an *.osm file from the *.pbf with Osmosis: ca. 40sec.
  3. Create and import WMS PostGIS table: ca. 25sec.
  4. Overall: ca. *1min 30sec* (A cronjob is running every 30min at 20 and 50 on the hour!)

You can use the WMS Layer in your own application. If you have an OpenLayers client, the following lines of code adds the overlay:
var wms = new OpenLayers.Layer.WMS(
"Road Status Japan (OSM) (impassabel=yes)",
"http://openls.geog.uni-heidelberg.de/geoserver/wms",
{'layers':'osm_japan:roads', transparent: "true", format: "image/png"} );
map.addLayer(wms);

The layer has only two colors: green and red. The green color symbolizes all the roads which can be used for traffic. The red color symbolizes the roads which have an “impassable=yes”-tag in the OpenStreetMap database and which can NOT be used for traffic!

I put a small example of the overlay with an OpenStreetMap map online here:
http://resultmaps.neis-one.org/japan.html

You can find further information about OpenStreetMap and the Sendai earthquake/tsunami in the OpenStreetMap Wiki. Additional information you can find in the German OpenStreetMap Blog.

I hope this overlay is useful for some people!
If you run into problems or you have questions, do not hesitate to contact me …

thx @ All OpenStreetMap contributors !!1!
thx @ University of Heidelberg for the Web Mapping Service
thx @ Frederik from The Geofabrik for the Japan OSM files
thx @ *Fab*

[Update 1. – March 18th, 2011]
Last nigth I’ve added a second layer with node barriers (barrier=*). You can used it with the following lines of code:
var osm_japan_barriers = new OpenLayers.Layer.WMS(
"Node Barriers Japan (OSM) (barrier=*)",
"http://openls.geog.uni-heidelberg.de/geoserver/wms",
{'layers':'osm_japan:barriers', transparent: "true", format: "image/png"} );
map.addLayer(osm_japan_barriers);

[Update 2. – March 21th, 2011]
I’ve added a third layer with tsunami:damage polygons (key=”tsunami:damage” ; value=”flooded”, “yes”, “scoured”, “flood”, “debris”, “debris_field” or “destroyed”). You can used it with the following lines of code:
var osm_japan_tsunami_damage = new OpenLayers.Layer.WMS(
"Tsunami Damage Japan (OSM) (tsunami:damage)",
"http://openls.geog.uni-heidelberg.de/geoserver/wms",
{'layers':'osm_japan:tsunami_damage', transparent: "true", format: "image/png"} );
map.addLayer(osm_japan_tsunami_damage);

[Update 3. – March 24th, 2011]
You can now find the Honda Sanriku layer on the “Status Map after the Earthquake in Japan” too (update daily!). Further I have added some Japanese translations and a Bing Aerial layer to the site. You can use the Honda Layer with the following lines of code:
var honda_sanriku = new OpenLayers.Layer.WMS(
"Honda Sanriku Layer",
"http://openls.geog.uni-heidelberg.de/geoserver/wms",
{'layers':'osm_japan:honda_sanriku', transparent: "true", format: "image/png"} );
map.addLayer(honda_sanriku);

Again, my example site can be found here: http://resultmaps.neis-one.org/japan.html

The Return of “Unmapped Places in OSM EU”

My last blog post about “Unmapped Places in Europe” was read by more then 800 people. So I think it’s time to redo the analyses a second time after three months. At the moment (March 11th, 2011) we have (according to the Geofabrik extract) 505091 places in OpenStreetmap Europe. They can be separated into the following place-types:

  • city=1055 (as of Dec. 5th, 2010 it was 1045 -> +1%)
  • town=16106 (as of Dec. 5th, 2010 it was 16032 -> +0.5%)
  • suburb=24913 (as of Dec. 5th, 2010 it was 23563 -> +6%)
  • village=278691 (as of Dec. 5th, 2010 it was 271147 -> +3%)
  • hamlet=184326 (as of Dec. 5th, 2010 it was 165804 -> +11%)

During my last and also during this analysis I *only* used those places that had a corresponding “village”-value. My tool works so far as followed:

  1. Get only places with a village-tag.
  2. Search nearby (ca. 600m distance) for a street with one of the following highway-types: residential, service, living_street, cycleway, footway, pedestrian, steps or platform.
  3. If no street can be found, mark the place as “unmapped”!

Why did I only use villages? Well for the case of Germany it can be assumed that places with “higher” place-type tags such as “town” or “city” have already been mapped.

What are the “false=positives” and why is your village marked as unmapped? A village should usually have at least one of the roads mentioned above otherwise the place should be mapped as a hamlet. Would you agree with this?

The results showed that of the total 278691 villages, about 152337 (55%) (in Dec. 2010 it was 58%) who are located within “Europe”, have not been detected or mapped yet. The following diagram shows the distribution of the numbers by country.

YAY, Germany!!!

The results can again be displayed as a GPX-overlay on a map which can be found here http://resultmaps.neis-one.org :

(Remarks for http://resultmaps.neis-one.org: Not each and every country is available as an overlay. Some countries such as France, Poland and Ukraine showed longer browser loading times to display the GPX-overlays!)

thx @ Dennis

Growing agreement & relicensing OSM -Update-

My last blog post about the growing agreement to the new CTs is now nearly three months ago. Time for a short update: During the aforementioned time frame, about 32 contributors accepted the new CTs every day. Overall this means that since October 21 2010 there are about 43 contributors each day who accepted the new CTs. I updated my diagram with the latest numbers:

In December I conducted an analysis about the “Change of OSM object numbers through relicensing”. This time I only declared the last modifier of an OSM object (node/way/relation) as the owner of the object! The last and the new results can be seen in the following diagrams:

In my OSM-user-database of March 9th, 2011 a total of 120456* members are the “owners” of the following OSM objects (* Notice: Not every member of the OSM project (>350000 members) has contributed!):

  • Number of nodes: 1007604532
  • Number of ways: 85365727
  • Number of relations: 899145

As of March 9th, 2011, 8124 Users have accepted the new license. 35678 new OSM members (uid >= 286582) have accept the new contributor terms automatically. I created the following numbers of OSM objects, which will be available for relicensing (if you assume that the last modifier is the owner of the object):

  • Number of nodes: 801700665 (79,56%) (as of Dec. 15th, 2010 it was 66,52%)
  • Number of ways: 66236798 (77,59%) (as of Dec. 15th, 2010 it was 61,68%)
  • Number of relations: 716130 (79,65%) (as of Dec. 15th, 2010 it was 62,14%)

Are you still interested in any analysis regarding this topic?

thx @ Dennis

[Update – March 24th, 2011]
The following diagramm shows the above numbers of March 9th, 2011 in percent:

Updated Error Summary for Europe

This month I tried something new. But first we will start with the usual monthly stats of the OSM Inspector Routing for Europe, this time for the middle of February 2011. Overall the following amount of errors appears for “Europe”: Unconnected Roads: ca. 107000 and Duplicate Ways (number of duplicate segments): ca. 109000 (in the OSM Wiki you can find more information about the error-types). This means that altogether there are 2600 unconnected streets and 16900 duplicate way segment errors have been fixed. In total we have an increment of 1111000 new OSM way segments for routing during the past 4 weeks in Europe (01/20/2011: 30600000, 02/20/2011: 31710000).

The following image shows the amount of errors divided by country for today’s Europe OpenStreetMap dataset:

In the past month several other countries were able to reduce the amount of errors, such as in: France (-1600), Italy (-1600), Poland (-1900), Sweden (-2300) and United Kingdom (-8000!!!). So congratulation to the UK, this is your month 🙂

Now let’s take a look at the new diagram: The following image shows the amount of errors per 100 km OpenStreetMap streetnetwork data for each country.

Do you have any other ideas for additional diagrams? I think dividing the amount of errors for each country by the number of OSM ways or segments could be an interesting approach, what do you think? The last image shows the amount of errors divided by country:

thx @ Dennis

Routing View EU 2011-01

Overall the following amount of errors appears for “Europe” at the middle of January 2011:

  • Unconnected Roads: ca. 109600
  • Duplicate Ways (number of duplicate segments): ca. 125900
  • (read more about the error-types here)

This means that altogether there are 3000 unconnected streets and 13400 duplicate way segment errors have been fixed (last month we had 112600 unconnected roads and 139000 duplicate ways errors). In total we have an increment of 1139000 (+3.8%) new OSM way segments for routing during the past 4 weeks in Europe!

  • 12/23/2010: 29400000
  • 01/20/2011: 30600000

The following image shows the amount of errors divided by country for today’s Europe OpenStreetMap dataset:

In the past month several other countries were able to reduce the amount of errors, such as in: France (-2900), Portugal (-2900) and Romania (-2200). So I think the award for this month goes to Portugal 🙂 (Is the reduction a result of this action? However, nice work!). But further countries such as Albania, Belgium, Bosnia and Herzegovina, Bulgaria, Germany, Greece, Slovakia and Sweden were able to reduce more than 1000 errors each. Only Spain (+1200) and the United Kingdom (+2000) have a gained more errors!

The following diagram shows the total amount of errors for 1m, 2m, 5m unconnected & duplicate way segments:

As usual for Germany, the comparison of federal states (includes the error type “Unconnected 1m”):

Yay, nearly all federal states could reduce their amount of errors!

thx @ Dennis

Routing View EU 2010-12

Short update with new statistics for the “Routing View EU“. Overall the following amount of errors appears for “Europe” at the middle of December 2010:

  • Unconnected Roads: ca. 112600
  • Duplicate Ways (number of duplicate segments): ca. 139000
  • read more about the error-types here

This means that altogether there are 5100 new unconnected streets and 20000 duplicate way segment errors have been fixed (last month we had 107500 unconnected roads and 160000 duplicate way errors). In total we have an increment of 1300000 (+4.6%) new OSM way segments for routing in the past 5 weeks in “Europe” (this is nearly twice the number in comparison to one month ago)!

The following image shows the amount of errors divided by country for today’s Europe dataset:

In the past month several other countries were able to reduce the amount of errors, such as in: Austria (-3200), France (-4400), Italy (-2100), Portugal (-1200), Sweden (-2000), Switzerland (-4828 !!) and the United Kingdom (-3700). So I think the award for this month goes to Switzerland 🙂 . Germany keeps going on with its negative trend: A gain of about 2700 errors! It seems like the German OSM community is primarly tracing from Bing-imagerys, doesn´t it?

In the following diagram the bars for each country shows the total amount of errors for 1m, 2m, 5m unconnected & duplicate way segments:

As usual for Germany, the comparison of federal states (includes the error type “Unconnected 1m”):

(Nearly all federal states have a positive value regarding the amount of errors, except Rheinland-Pfalz, Sachsen, Schleswig-Holstein & Hamburg)

This was my last blog post for this year, so Merry Christmas and a Happy New Year 2011!
Bye for now …

Growing agreement to CT & relicensing OSM Data

In the past I did some blog posts about the “Growing agreement to contributor terms” here and here. Both posts showed the amount of OpenStreetMap contributors who accepted the new CTs every day during each time frame (about 55 contributors a day). I created a new diagram that includes the past four weeks:

Overall for the past month about 57 accepted the new CT every day. This is nearly the same amount as during the months that have been analyzed before. But what does this exactly mean for the relicensable OSM data? Almost 2 months ago I did a post about the “Change of OSM object numbers through relicensing”. At this time there were about 55% of all OSM Nodes and 47% of all OSM Ways available for relicensing (you can find my post here).

I repeated this analysis with the current OSM data: In the first attempt I used the last modifier of an OSM object (node/way/relation) as the owner of the object. During the second analysis I used the creator (version=”1″) as the owner of the object.

In my OSM-user-database of 12/15/2010 a total of 111310* members are the “owners” of the following OSM objects (* Notice: Not every member of the OSM project has contributed!):

  • Number of nodes: 878201891
  • Number of ways: 73825397
  • Number of relations: 790100

(Current status of the OSM database statistics are here)

As of Dec. 19 th, 2010 (16:00), 6076 Users have accepted the new license. 25487 new OSM members (uid >= 286582) have accept the new contributor terms automatically. I created the following numbers of OSM objects, which will be available for relicensing (at the above mentioned date of my data). If you assume that the last modifier is the owner of the object: (the numbers in brackets represent the percentage of the total objects!)

  • Number of nodes: 584163816 (66,52%) (as of 10/10/2010 it was 55,89%)
  • Number of ways: 45536248 (61,68%) (as of 10/10/2010 it was 47,56%)
  • Number of relations: 491014 (62,14%) (as of 10/10/2010 it was 31,06%)

I did the same analysis with a second dataset in which the creator (version=”1″) is also the owner of the OSM object (my table is based on the full-history-dump of October 22, 2010). A total of 109005 members created:

  • Number of nodes: 911411022
  • Number of ways: 75235513
  • Number of relations: 1151219

And the following numbers of OSM objects (version=”1″) will be available for relicensing:

  • Number of nodes: 586598103 (64,36%) (as of 08/01/2010 it was 54,24%)
  • Number of ways: 44844834 (59,60%) (as of 08/01/2010 it was 46,78%)
  • Number of relations: 480370 (41,73%)

Notice: The last numbers of OSM objects could contain deleted objects too. I only checked and counted the version=”1″ of a object. So probably the numbers for relicensing OSM objects (version=”1″) should be smaller!

However, in my opinion the results are interesting enough to publish them here anyway.
Can anyone confirm these absolute numbers?

thx @ dennis !

What is your OSM Rank ?

And again, I did a small update to “How did you contribute to OpenStreetMap ?” (http://hdyc.neis-one.org).

You can now see your ranks within the OSM World, depending on how you have been contributing to the project!

Besides the regular OSM data update, implemented by applying the planet- & changeset-dump (dated 2010-12-15), I also added two additional rows with some information about your data. In the picture below you can see your rank in OpenStreetMap (1) separated by different OSM objects such as Nodes, Ways or Relations. The rank refers to the amount of objects that have been lastly modified by you (see also row: “… are the last modifier of:”). The percentage in the brackets gives you an impression of how big your contribution to the project has been so far in comparison to the whole OSM database.

Some more information about my current database (dated 2010-12-15):

  • At the moment about 111000 different users* are the last modifier in the OSM database
  • Overall about 149000 contributors have created a changeset
  • In the OSM database there are about 878000000 nodes, 73800000 ways and 790000 relations

*Remember: Not every member of the OSM project, which are currently more then 330000, has contributed!

I think a regular contributor should have a rank better then #14000. A really active one could have a rank better then #1000 and probably only bots are in the Top Ten. However, what is your OSM Rank ? >> http://hdyc.neis-one.org
Have fun !

Thx @ “AFK” Dennis 😉