The OpenStreetMap project will possibly finalize its license change on April 1st 2012. There are certain concerns in the community about possible data losses and to keep them as little as possible, several remapping activities have been started. A really nice overview of “Remapping principles” and “Tools to help you” can be found here.

Frederik’s OSMInspector (OSMI) and Simon’s CLEANMAP are two very handy remapping tools. Both display data that will likely be removed after April 1st due to the fact that this data was collected by contributors that did not accept the license change. In Germany you will find several areas that are affected by these changes and might even leave some new blank spots in the map. But what impact do these changes have on the total length in kilometers per street category in Germany?

You can find several files regarding the OSMI license change view at a Geofabrik server here. Based on the “ways” shape file that you can find there it is possible to calculate the total length of the ways, which will likely be removed with the license change. However, sadly the “ways” shape file does not include any “highway” attribute, but luckily it includes the OSM IDs. This means that to be able to do a Germany street network analysis you will have to download the Geofabrik Germany OSM *.pbf file. By applying a short script you can get all OSM way IDs in Germany with their highway=* key/value pair. Combining these with the “ways” shapefile allows us to calculate the total lengths of each highway type for “Germany” (based on the Geofabrik extract!).

The following image shows the results of a first attempt to visualize the values per street category. Overall this means that based on the current (January 15th 2012) license agreement/disagreement situation about 5.4% (94000 km) of the current street network in Germany will be removed after the license change in April. The relative difference for each highway type lies between 3-8%. Last week (Jan. 7th, 2012) the total amount in Germany was 5.9% and 103000 km.

The OSMI License Change view contains not only the data that will potentially be removed in the future but also some information on two additional feature-types: Features, which have been modified and features which have been modified in some minor way by a contributor that declines the license change. In the first case we have a total street network length of about 58000 km that is affected and in the second case about 17000 km. Remember, these numbers only reflect the situation in Germany! You can find more information about the different feature types here: “Understanding the Colour Scheme“.

Notice: This was a short hack done last night, but I think those numbers look realistic. Can anyone confirm this for Germany? I am very curious how and if these numbers will decrease in the next few weeks. What do you guys think?

thx @ maɪˈæmɪ Dennis

Last weekend Frederik and Richard asked me if I could give some additional information on the „How did you contribute to OpenStreetMap?“ webpage. So here we go. Below the prior, familiar chart which shows the contributions per month, you will find two new charts. The first one shows the number of changesets per weekday and the second one the number of changesets per hour.

Additionally I added an output that roughly estimates what type of mapper the contributor is, based on his/her number of contributions (changesets). However, I will give no warranty regarding the group or type of mapper that each individual contributor falls into and I think you will figure out the different groups of mappers by yourself anyway 😉

The following picture highlights the new things on my webpage:

Most of you already know it, you will find “How Did You Contribute to OpenStreetMap?” here: http://hdyc.neis-one.org

thx @ Frederik & Richard for the idea
thx @ maɪˈæmɪ Dennis

*Update* (2020-06-11) What are the different requirements for your #HDYC type of #mapper? See

Due to some requests by some German OpenStreetMap contributors, here a German blogpost about the results of the article: “The Street Network Evolution of Crowdsourced Maps: OpenStreetMap in Germany 2007–2011.” By Pascal Neis, Dennis Zielstra & Alexander Zipf. 2012. Future Internet 4, no. 1: 1-21. (doi:10.3390/fi4010001) Link: http://www.mdpi.com/1999-5903/4/1/1/

Bemerkung: Im Folgenden sind ausgewählte Ergebnisse und Diagramme aus dem englischen Artikel dargestellt/zusammengefasst. Bei weiterem Interesse bitte das Original Journal Paper lesen. Es beinhaltet bei weitem mehr Informationen und Abbildungen!

Das OpenStreetMap (OSM) Projekt ist das bekannteste Projekt im Bereich Volunteered Geographic Information (VGI). Weltweit beteiligen sich mehrere hundert tausend Mitglieder um Informationen für eine „freie“ Geodatenbank zu sammeln. Der Zuwachs der Daten ist weltweit recht heterogen, Deutschland zählt aber global zu eine der aktivsten Länder und die Anzahl der Projektbeteiligten steigt von Jahr zu Jahr. Aktuell (Juni 2011) haben insgesamt mehr als 40000 unterschiedliche Mitglieder zum Deutschland Datensatz beigetragen. Wie in der folgenden Abbildung zu sehen, haben unterschiedliche Mengen von Mitgliedern, die drei OSM Objektarten (Node, Way & Relation) in Deutschland erzeugt. Eine weitere wichtige Information ist in der Abbildung ebenfalls zu sehen: 98% der Punkte wurden von ca. 8500 Mitgliedern, 98% der Linien von ca. 7500 und 98% der Relations auf ca. 2600 Mitglieder generiert (wenn man den letzten Eigentümer als Ersteller bewertet).

(c) MDPI

In folgender Abbildung ist die Entwicklung des Gesamtstraßennetzes für Deutschland für die vergangenen vier Jahre (2007-2011) zu sehen. Die vielen unterschiedlichen Straßenkategorien wurden aus Übersichtsgründen und für bessere Untersuchungs- und Vergleichsmethoden in vier Gruppen zusammengefasst (Autobahn/Schnellstraßen, Kreisstraße/Gemeidestraße, Straßen an/in Wohngebieten und sonstige wie Service oder Feld-/Waldwege).

(c) MDPI

Verfolgt man den Wachstum der unterschiedlichen Kategorien, ist zu erkennen, dass ab einem bestimmten Zeitpunkt manche Kategorien nicht mehr weiter zunehmen. Daraus lässt sich ableiten, ab wann eine Kategorie annährend „komplett“ erfasst gewesen sein dürfte oder wo noch neue Straßen hinzukommen. Bei diesem ersten Vergleich ist aber folgendes zu beachten: Der Datensatz von TomTom eignet sich nur für einen Vergleich des Wegenetzes für die Autonavigation (also drei der vier Kategorien). Die Kategorie „Sonstige Wege“kann nur bedingt im Vergleich berücksichtigt werden. In der vierten Kategorie hat OSM ein bereits viel höheres Wegenetz als der kommerzielle Anbieter. Basierend auf den eben erwähnten Annahmen und dem Vergleich mit den TomTom Kategoriestraßenlängen kommen wir zu folgenden Ergebnissen:

1. Autobahnen/Schnellstraßen waren bereits Mitte 2008 komplett erfasst
2. Mitte 2009 waren Kreisstraßen/Gemeindestraßen in Deutschland erfasst
3. Straßen in/an Wohngebieten sind noch nicht vollständig erfasst
4. Ende 2009 hatte OSM bereits mehr „Sonstige Wege“ als der kommerzielle Datensatz von TomTom
5. In der Gesamtsumme des Wegenetzes hat OSM seit Mitte 2010 TomTom übertroffen. Wobei hier sicherlich die vielen Feld- und Waldwege für OSM ein Vorteil sind.
6. Aktuell (Juni 2011) wird in OSM Deutschland größtenteils nur noch vereinzelt am Wegennetz an und in Wohngebieten und vermehrt am sonstigen Wegenetz gearbeitet (Wald-, Wiesen- und Feldwegen).

Die Entwicklung der einzelnen Straßenkategorien im Vergleich zum TomTom Datensatz ist in der folgenden Abbildung zu sehen.

(c) MDPI

Damit hat sich in Deutschland aktuell (Juni 2011) das OSM Straßennetz für die Autonavigation bis auf 9% an vergleichbare Datensätze herangearbeitet und besitzt im Bereich des Gesamtwegenetzes sogar über 27% mehr Informationen. Durch den aktuellen Zuwachs in den fehlenden Straßenkategorien dürfte OSM die noch offene Differenz im Straßennetz bis Mitte/Ende 2012 ausgleichen.

Neben dem Wegenetz wurden auch die Gesamtzahlen der Abbiegevorschriften pro Straßenkategorie miteinander verglichen.

(c) MDPI

Wie im oberen Bild zu sehen ist, ist die Differenz zwischen TomTom und OSM nicht gering. Damit sind aktuell mehr als fünfmal so viele Abbiegevorschriften bei TomTom für Deutschland verfügbar im Vergleich zu OSM. Die Anzahl von Abbiegevorschriften steigt zwar stetig bei OSM, trotzdem dürfte es vermutlich nach jetzigem Stand und Zuwachs noch mehrere Jahre dauern bis OSM hier aufschließen kann.

Der komplette (englische) Artikel mit weiteren Untersuchungen und Abbildungen ist hier kostenfrei herunterladbar: http://www.mdpi.com/1999-5903/4/1/1/

thx @ maɪˈæmɪ Dennis

The German OpenStreetMap project webpage has been online for three years now. During these years several small updates have been made to the page. But it is about time to create a complete new webpage with a “state of the art” layout and style. Jonas created the first drafts of a possible new design of the site a while ago. Unfortunately he hasn’t had enough time to finish his work, but luckily Fabian and Pascal came up with a new webpage. Both of them considered Jonas first draft during the development and expanded it with their own ideas.

The new site is based on HTML, CSS and Twitter-bootstrap. Most of the content has been taken from the old webpage with minor improvements. In their opinion the biggest change lies within the way the users are welcomed to the page with information such as: “What is OpenStreetMap?“, “How can I help?” or “How can I use the data?“. The following image shows the important changes made to the welcome-page:

The map has moved to a different web location, but on the welcome-page you will find a large icon that is linked to the map. Similar to the old map, all German local groups are displayed as an overlay. Furthermore, they integrated the OSM Nominatim address search and two buttons in the header of the page, so users can notify the community about bugs or edit the map.

A big shout out to all the people who gave us their feedback (Jonas, Jochen, Frederik, Marc, Matthias & the WN-Team). Special thanks to Fabian who implemented most of the new site.

You can find the new webpage starting from today at the old URL: http://openstreetmap.de
We hope that you like it! What do you think?

Einen deutschen Blog Post findet ihr hier: http://blog.openstreetmap.de/2011/11/neue-osmde-webseite/

thx @ maɪˈæmɪ Dennis

Really great news for all our non-European OpenStreetMap.org Mappers: Since last month, the OSM Routing View is available for the whole world. You can read more in Frederik’s blog post. Yesterday he sent me the latest results of the view and I did some analysis with it. To all new readers: you can find more information about the OSM Inspector (OSMI) here. The Routing View within the OSMI “shows problems in the data, related to routing and navigation” (direct link).

However, here are the new *worldwide* stats for November 2011: we have a total of about 1,3 Mio errors. We can divide them into the following groups:

• Unconnected 1 meter: 248000
• Unconnected 2 meter: 62000
• Unconnected 5 meter: 170000
• Duplicate (number of duplicate segments): 833000

The following diagram shows the amount of errors per continent:

In the following charts you can see the amount of errors separated by country and the amount of errors in detail per country for “Europe”:

*NEW*: All other non-European countries with more then 5000 errors are listed in the following chart:

The “big three” countries with the highest amount of errors are in the last chart:

As you can see it in the charts, especially the United States need a lot of work. Furthermore it seems that in Ethiopia something went wrong. Was there any data-import or something similar? Frederik does not have a sponsor for running this routing view world-wide on a daily basis right now, so please contact him if you would support us! The last Routing View blog post is online here.

thx @ *Fab*

The last unmapped places analysis for OpenStreetMap that I conducted is nearly eight months ago. So I figured it was about time to create a new one. You can read in the last blog post how my algorithm exactly works.

However, at the moment (Nov. 4th. 2011) we have (according to the Geofabrik extract) about 597 000 entries in OSM for places that are located within “Europe“. This means we have an overall increase of about 90 000 places within the past eight months. We can separate them into several types with different values:

• City: 1093 (as of March 11th, 2011 it was 1055 ; +3.6%)
• Town: 16213 (as of March 11th, 2011 it was 16106 ; +0.7%)
• Suburb: 29642 (as of March 11th, 2011 it was 24913 ; +19.0%)
• Village: 301638 (as of March 11th, 2011 it was 278691 ; +8.2%)
• Hamlet: 238717 (as of March 11th, 2011 it was 184326 ; 29.5%)
• Isolated dwelling: 9064 (new in my stats)

The results showed that of the total 301638 village entries for Europe in the database, about 154445 (51%) (in March 2011 it was 55%) have not been detected or mapped yet. Further it is possible that the places are tagged incorrectly (e.g. villages vs. hamlet). Anyway, the following figures show the distribution of the values for each country (in different scales).

It is nice to see, that Austria (-688), Czech Republic (-633), France (-1978), Georgia (-721), Germany (-1192), Italy (-926), Poland (-2364), Spain (-1472) and the United Kingdom (-829) were able to reduce their “unmapped places” in a quite solid way. As usual you can find my results as a GPX-overlay here: http://resultmaps.neis-one.org

(Remarks for http://resultmaps.neis-one.org: Not each and every country is available as an overlay. Some countries such as France or Poland showed longer browser loading times to display the GPX-overlays!)

UPDATE: Download the complete GPX-files of this analysis here.

thx @ maɪˈæmɪ Dennis

During my really great vacation in Sweden I had some time to do some further adjustments to the well-known “Your OSM Heatmap“-webpage. For the new readers: “Your OSM Heatmap” shows the contributions of an OpenStreetMap user as a heatmap overlay. You can find my blog post with some more information here.

However, I think it would be a fantastic idea to add a time slider to the webpage. You can find it now below the map! The year of your first and last contribution is on the left and right end of the slider. With the slider you can visualize your OSMtastic-work over time. The following image shows the webpage including the time slider:

As a second feature you can now use, beside your OSM heatmap-link, the permalink of the map to point to an individual position of your heatmap! Finally I have updated the data for the webpage with the latest OSM changesets. Overall the heatmaps for about 150 000 contributors are available. Remember: Not *every* registered OSM member did contribute to the project.

So, who has an awesome OSM HeatMap time-travel? >> http://yosmhm.neis-one.org

thx @ maɪˈæmɪ Dennis

Last week Stephan released the neat “Where Did You Edit?” webpage. A world map indicates where in the world you have been editing OpenStreetMap (OSM) nodes. Unfortunately it is based on a full history OSM planet dump which is nearly two months old. Also, the map does not include any tools to zoom into or drag the map. However, Stephan mentioned that he is working on these functions. Keep up the good work, Stephan!

Based on my OSM changeset table of “How did you contribute to OpenStreetMap ?” I created a slightly different webpage and used a different approach. I used the weekly OSM changeset files and I presented the results in an OpenStreetMap including zoom and drag functions. Your contributions are indicated by a “Heat-Map-Overlay”. For this overlay I am using Bjoern’s OpenLayers addon. For better performance I generalized the total changesets of each OSM contributor. This means that it is possible that not every little contribution from a member is taken into account and displayed in the map. Anyway, I think the results are quite impressive, aren’t they?

The following picture shows the heat map of Harry’s OSM contributions. Really nice! But honestly: Harry, did you visit all places in person? 🙂

I think you will find other incredible OSM Contributors Heat Map stories?! You can find “Your OSM Heat Map” (aka Where did you contribute to OpenStreetMap?) here: http://yosmhm.neis-one.org . I can update this website every week if you like …

thx @ maɪˈæmɪ Dennis

Most of you might already know that the OpenStreetMap project will celebrate its 7th Anniversary this month. Several events will take place on Saturday, 20 August 2011 at different locations around the world! You can read more about it here.

A small gift that I would like to contribute is a website which allows you to get some information about your “OSM-Age“. The functionality is similar to “How did you contribute to OpenStreetMap ?“. Type in your or any other OSM username and your or the corresponding user’s OSM-Birthday will be displayed. To be more specific the website will show your OSM-Age and your rank within the OSM contributors list. Remember: Not every OSM member contributed to OSM (cf. „Nominal Members“ of OSM). So it is possible that your rank is better than you might have expected. The date of a user’s birthday was collected from each users OSM User Wiki page (“Mapper since: …”).

The following image shows an example search result:

Additionally you can find the oldest and newest contributors in the boxes below the search results. Further you can see whose birthday it is on that specific day, or within the previous or following three days.

Soooo, what is your birthday? Check it out here: http://osmbirthday.neis-one.org

Additional information: Today (Aug. 2011) the OSM project has about 143 000 contributors with at least one edit in the database. Remember that officially the project has over 446 000 registered members (cf. OpenStreetMap stats report). I will announce more about this topic here in my blog in the near future … so stay tuned! Or you can read the blog post from last year (2010): „Nominal Members“ of OSM

thx @ *Fab* for the user-interface
and thx @ maɪˈæmɪ Dennis

Maybe some of you remember that I conducted a comparison analysis between three OpenStreetMap (OSM) routing engine APIs (CloudMade, MapQuest Open and OSRM) and G**gle Maps API last week. You can find the results in my blog post here. As I mentioned in the article, I wanted to try to do a second analysis with more routing engines.

Thus, I added Bing Maps and two OSM engines (YourNavigation/YOURS and Routino/Roadeeno) to the comparison. All services have a continental coverage with the exception of OSRM. The following table shows an overview of (1) the request-response time of the service, (2) the calculated distance for the test-route and (3) the file size of the service response:

As you can see in the following diagram does the OSM routing engine (OSRM) give the fastest results. A little bit strange is that the Routino/Roadeeno service returns no valid route responses for requests which are longer than 600 km.

The same diagram in a more detailed view:

The routing engines have different ping times (round-trip time). Almost all services have a round-trip time off about 25 ms. You can see the times for each engine in the following diagram:

If you take those ping times into account and use a logarithmic transformation, the result look as shown below:

The above diagram shows in a quite impressive way the results of this comparison that allow the following conclusions: OSRM (OSM) shows the fastest results followed by G**gle Maps (Tele Atlas). Bing (Navteq), MapQuest (OSM) and CloudMade (OSM) are nearly equal in most cases. YOURS (OSM) and Routino (OSM) seem not to be the right choices at least for long route calculations (>600km). Maybe a second comparison with several routes between 10 and 500 km could be an enhancement?

thx @ maɪˈæmɪ Dennis 🙂