Tag: Stats

Welcome to an additional family member – OSMstats

Maybe some of you are already familiar with “OSMstats”, a website that provides numerous statistics about the OpenStreetMap (OSM) project. The site was created and is maintained by the two guys at altogetherlost.com. However, OSMstats has now been moved to the ResultMaps domain at osmstats.neis-one.org. I added several new features too. First of all, you can now select a specific date for your stats. Secondly, the main menu panel has been extended with a new entry for statistical information about OSM changesets.

osmstats

Additionally, the graphs for the country statistics, the active members and daily edits are also available in a “year”-overview. I hope you like the new extensions. A big thanks to both guys at altogetherlost.com who originally created OSMstats!

OSMstats is now available at: http://osmstats.neis-one.org
Feel free to check out my Resultmaps too which offer many helpful and funny OSM tools: http://resultmaps.neis-one.org

Notice: OSMstats was introduced in 2011, this means the webpage cannot provide statistics prior to that year. Also, the newly created Changeset-Tab has only data for July, 2014 and after.

Thanks to maɪˈæmɪ Dennis

The OSM Contributor Activity Report – Edition 2014

The OpenStreetMap (OSM) project celebrated its 10th anniversary in August 2014. For almost 10 years it has increased its number of registered members. Even though some contributors stopped their contributions to the project, each day new mappers start collecting features for the free wiki world map (aka database).

In my last contributor report in 2013, the OSM project had a total of 1.3 Mio registered members. For July 2014 this number has increased to almost 1.6 Mio registered members. Similarly to last year, I checked how many contributors created one or more than ten changesets or performed more than 10 map edits. This information can be retrieved from the changeset dump.

NewContributorsPerMonth.201408

The figure above reveals a similar trend to the ones we saw in the past few years: Less than 1/3 of the 1.6 Mio registered members actively contribute to the project (450,000 members). Furthermore, only a small group of 16% (270,000) or respectively 6% (100,000) of the contributors performed more than 10 edits or 10 changesets.

The long-term motivation of the contributors is quite important too. Therefore, similarly to the methods that we presented in our open access publication, I created a figure, which visualizes the increase in monthly volunteer numbers over the past few years and the consistencies in data contributions.

Activity.Stats.201408

As we already revealed in our study, only half of the monthly active members in OSM are also long-term contributors. Also, the previously discussed pattern which depicts a contributor loss of almost 70% over the years is again visible. However, it is good to see that at least some “senior” mappers still keep contributing to the OSM project.

Thanks to maɪˈæmɪ Dennis

The State of the Map. United States. Street Network. 2013

Last year we wrote a journal paper in which we analyzed the OpenStreetMap (OSM) dataset of the United States which was published on May 28th, 2013 in the Transactions in GIS Journal. You can download a free pre-print version here. This paper has been published just on time to add to the discussion at the upcoming State of the Map United States conference which will take place in San Francisco and includes some presentations about data imports to OSM. Unfortunately, Dennis and I cannot attend the conference this year, so we decided to write a blog post with some additional and up-to-date numbers.

In January there was an announcement on the OSM mailing list that in the past few months many connectivity errors in the United States OSM dataset had been fixed. Probably a lot of these fixes can be attributed to Martijn’s Maproulette website or to Geofabrik’s OSM Inspector (OSMI) Routing View. However, a short discussion started on the mailing list about the total number of errors that are left and how long it would take to fix all those errors. Thus, we downloaded four OSM planet files dated Jan 4th 2012, June 13th 2012, Jan 2nd 2013 and Jun 2nd 2013 to get some new results. After cutting the United States dataset from the planet files, we used the same algorithm as utilized in OSMI’s Routing View, to receive some stats about the street network of the US datasets.

First of all the, the following image shows the number of errors for each dataset that we included in the analysis. The errors that were detected are separated into unconnected and duplicate ways. You can find some additional information about both error types here.

As you can see, the number of unconnected OSM ways has been rapidly reduced in the past 17 months from around 141,000 to 19,000. The number of “duplicate way” errors has been reduced from 17,500 to 11,500. You can find the exact numbers in the following table and an updated error layer on the mentioned OSMI website. In certain cases the duplicate way error created several errors for one and the same way. For these particular cases the number of unique OSM way IDs were counted.

Date – Unconnected Ways – Duplicate Ways

  • Jan 4th, 2012 – 141,578 – unique 17,563 (overall errors: 535,923)
  • June 13th, 2012 – 145,468 – unique 17,977 (overall errors: 518,536)
  • Jan 2nd, 2013 – 15,911 – unique 12,287 (overall errors: 257,388)
  • Jun 2nd, 2013 – 19,073 – unique 11,582 (overall errors: 220,451)

Overall the length of the US street network did not really change a lot. At the beginning of 2012 it was around 11.07 million km while in 2013 it is 11.1 million km, which means an increase of around 30,000 km. The following image shows the distribution of the US street network divided by different OSM road classes.

The length of the residential roads is still decreasing (-496,000 km), similar to what we saw during the analysis for our paper, while the length of the other road types (+276,000 km) and secondary/tertiary roads (+205,000 km) is increasing. This is the result of a massive retagging process of the imported TIGER/Line dataset in OSM. Dennis mentioned this already in his SotM US 2012 presentation. Motorways also experienced an increase of around +44,000 km in 2012. You will find some additional, quite interesting statistics, charts and of course maps in the aforementioned journal publication. In particular a few more thoughts and facts about the effect and impact of data imports on OSM can be found in our research study about the United States OSM dataset.

Add a Note in OSM … Stats & Personal Profiles

Since April 23th, 2013 each visitor, user or contributor of the OpenStreetMap (OSM) project can “add a note” to the map in order to easily mark an error or missing object in the map data. You can find more information about this new feature in the OSM wiki. It is a great new way for people to contribute to the project by improving the data in a simple way. To provide a better overview I created a new webpage which shows some statistics about the new feature. You can find it here: resultmaps.neis-one.org/osm-notes

Besides some general information the webpage also shows the overall, opened and closed number of notes per country. The second table illustrates the OSM contributors who already opened, commented or closed a note. All tables on the page are sortable by clicking on the column headers.

Additionally I integrated the individual contributor note stats to the OSM personal profiles @ “How did you contribute to OpenStreetMap?“. The following image shows the new add-on, of course with Harry, our guinea pig No. 1, and as always, great work here too! 🙂

¡Muchas gracias maɪˈæmɪ Dennis

Introducing OpenStreetMap Contributor Activity Areas

One month ago I wrote a blog post about a new website which allows you to see other OpenStreetMap contributors in your area. Overall the feedback was very positive, thank you very much for that! However, now it is time for a new extension to the “How did you contribute to OpenStreetMap?” (HDYC) webpage. As I mentioned in my last blog post, I used an algorithm (which is described in a paper that I wrote here) to compute and determine the activity area of a contributor based on her/his changeset centers. The following figure shows the new function that was added to the HDYC website visualizing the activity area of a contributor! Sorry Harry, as always you have to be our guinea pig, but you have a really awesome activity area 🙂

Next to the visualization of the overall activity area of a contributor, you can also click on a link at the bottom of the map to switch to the contributors’ activity area of the past six months. Furthermore, all maps on HDYC now use the great Leaflet map library instead of Openlayers. Also, your activity areas’ first and last Nodes have a direct link to the “Overview of OpenStreetMap Contributors aka Who’s around me?” webpage. This provides an easy way to locate other contributors in your area. I have to mention that not every contributor has an activity area for the past six months. It highly depends on the activity of the contributor within this time frame!

One more thing: The aforementioned “Who’s around me?” webpage has three new overlays. Two overlays show the contributors of the past six months with their first and last Nodes and one additional layer shows the activity areas also based on the past six months for each contributor. You can find all new layers in the upper right corner in the so-called “Layerswitcher”.

My HDYC database is updated more or less on a daily basis. The information about your changeset activities is updated once a week (based on the weekly changeset dumps from here). “The Created Nodes per Country”-section can only be updated when a new full history dump is available, but you can always find the latest date in the section-label. The “Who’s around me?” webpage uses almost the same database as HDYC, so the data up-to-dateness is similar.

Have fun with the new gadgets!

¡Muchas gracias maɪˈæmɪ Dennis

OSM-Gravatar, Changeset changes & Way-Tags @ HDYC

After my latest updates to the “How did you contribute to OpenStreetMap?” website, some users asked me if I could add the new OSM gravatar to it. Starting today, you can find your OSM-gravatar from your OSM user website on HDYC too. If your HDYC-profile doesn’t show a gravatar yet, please be patient. It will be automatically updated as soon as you make any type of OSM edit to the OSM database. The following figure contains all updates that were made to the website marked with a circle. As always, Harry is our example 😉

As a second update, I added the number of changes that were made in a user’s changeset and grouped them into three classes. This way the website shows if a user only makes a lot of changesets with 15 or less edits, more than 150 edits or something in between. Last but not least, you can find some additional information about the number of ways of which the user is the last modifier, including its way tag. This provides some information about the data collection tendency of the contributor, for instance if the user only creates a lot of buildings or large landuse areas.

Check all updates here: How did you contribute to OpenStreetMap?

Ps: You can also find the total number of countries in your profile in which you contributed at least one node.

Muchas Gracias @ maɪˈæmɪ aka Oleta River State Park Dennis 🙂

Overhauling “How did you contribute to OpenStreetMap?”

My last update about the HDYC website is a few months old now. For those readers who do not know what HDYC is: “How did you contribute to OpenStreetMap?” is a webpage which shows you in detail how long, when, where a member of the OSM project contributed to the project and which tools she/he used.

This time I added some new stats and graphs to the site. One of my favorite new features is the location information which shows the countries in which a contributor created at least one OSM Node:

A second new feature shows how long the mapper is already registered with the project and how many *active* mapping days she/he had:

You can also find some more information about the changesets of the user e.g. the number of changesets with a comment, the number of unique changeset comments and the median character length of the comments. Additionally, you will also see some information about deleted nodes, ways or relations:

Some of you might know about Richard Weait’s “Mapper Baseball Cards” idea. I added a similar graph to the end of the page to show which editors have been used by the mapper (thx Richard for the idea).

You will also see some facts about how many traces a user has uploaded to the OSM project and how many user blocks he received or if a user block is still active. Most of the stats are updated on a daily basis while the changeset stats will be updated once per week (which depend on the changeset dump).

Maybe we should create a “Hall of Fame” of OSM Contributors?

  1. Contributor with most visited countries? -> mikelmaron ?
  2.  Most active contributor? -> Zambelli Limitada ?
  3.  … any other ideas?

However, I hope you like it!? Have fun …
>> http://hdyc.neis-one.org <<

thx @ maɪˈæmɪ Dennis for proofreading

I Like OpenStreetMap (OpenLayers Plugin)

A few months ago, Frederik Ramm posted an idea on the German OpenStreetMap mailing list about a new (stochastic) approach to OSM data quality assurance. You can find his original German post here. His idea was to create a way to allow users to “like” or “dislike” a specific region on the OSM map, a function that other popular websites such as YouTube or Facebook implemented to allow users to provide feedback to videos or status updates. For OSM this particular function could give some indicators or trends about the OSM map data.

I really liked his idea and in collaboration with Frederik I created an Open Source OpenLayers plugin. For all new readers: OpenLayers is an Open Source library which can implement a dynamic (OSM) map into more or less any webpage. One of our goals was to make the integration of the ILikeOSM plugin as easy as adding a tile server to your OpenLayers map.

The following image shows the plugin in more detail, including the “like” and “dislike” buttons to provide feedback about the area on the map.

An additional feature of the plugin shows how many users have been viewing the same area of the map that the current user is taking a look at. More precisely: How many other users have been viewing a similar area of the map within the past two minutes with a zoom level of +-3 to yours. All components of the plugin are Open Source and available on github. The database which saves the likes and dislikes is running on a German OSM Dev server. A database dump file can be downloaded on a daily basis. It is important to note at this point that no private data is saved in the database when a user leaves his or her feedback. The plugin only saves an independent, randomly generated user ID, the feedback type i.e. thumbs up/down, the zoom level, the layer name and the bounding box of the map section. A map view is generally not saved to the database until the user accepts to do so via a pop up window.

Do you like this feature?
It is quite easy to integrate it into your own webpage. Here is how it works:
1. Add the following line below your OpenLayers script-tag:
<script src=”http://ilike.openstreetmap.de/ILikeOSM.min.js” type=”text/javascript”></script>
2. Then add the following lines to your OpenLayers Controls:
new OpenLayers.ILikeOSM()
3. Styling
<style type="text/css">
div.olILikeOSM { position: absolute; top: 15px; left: 50px; padding: 7px; color:white; border-radius: 10px; background: rgba(0, 0, 0, 0.6); }
div.olILikeOSM a { color: white; font-size:12px; text-decoration: underline; }
</style>
4. That’s it!

What is the benefit of this plugin or of the saved ILikeOSM data?
Based on the saved likes, dislikes and map views we can generate some statistics to provide you with information about the number of people who like or dislike your particular area of interest. Maybe we can even see some prove of Linu’s law “given enough eyeballs, all bugs are shallow”; meaning in this case, that a larger number of users that check a certain region of the map, results in “better” OSM data quality. As a first prototype, I generated a static webpage which shows an example result map.

Further ideas?
The plugin could potentially be expanded with an additional textbox in which a user could leave a comment why the area is not well represented in OSM. This information could then be saved e.g. in OpenStreetBugs. Anyway, we think that the current version of the plugin could provide some very useful information. You will find a webpage with all information, examples and downloads here: http://ilike.openstreetmap.de As a first step we integrated the plugin into the OpenStreetMap Germany webpage.

Frederik will give a short talk about the ILikeOSM plugin at the upcoming State of the Map 2012 in Tokyo. If our proposed session abstract about another topic for the State of the Map 2012 US gets accepted, Dennis will try to present it there too.

Thank you very much for your feedback: Frederik, Jonas, Dennis, Sven & Marc

Where are the new OpenStreetMap Contributors?

Since past Friday the OpenStreetMap project has more than 600 000 registered members. As many of you may know, not every new registered member starts contributing to the project right away. Based on my “How did you contribute to OSM?” database I created a small (but neat) webpage which shows where the newest registered OpenStreetMap (OSM) members made one of their first edits. The following image shows a screenshot of the new webpage:

The visualized data will be updated on a daily basis. At the moment there are two layers available: one layer displays the latest members of the past two days, while the other layer does the same for the past seven days. At lower zoom-levels the icons are clustered and only show the number of new members. However, on higher zoom-levels you can click on the individual icons to get further information about the new project member. Thanks to Stamen for their really nice looking watercolor map. Would you like to see more statistics about the number of new contributors for each individual country?

The new webpage is online here: http://resultmaps.neis-one.org/newestosm.php

thx @ maɪˈæmɪ Dennis

What type of Mapper are You?

Last weekend Frederik and Richard asked me if I could give some additional information on the „How did you contribute to OpenStreetMap?“ webpage. So here we go. Below the prior, familiar chart which shows the contributions per month, you will find two new charts. The first one shows the number of changesets per weekday and the second one the number of changesets per hour.

Additionally I added an output that roughly estimates what type of mapper the contributor is, based on his/her number of contributions (changesets). However, I will give no warranty regarding the group or type of mapper that each individual contributor falls into and I think you will figure out the different groups of mappers by yourself anyway 😉

The following picture highlights the new things on my webpage:

Most of you already know it, you will find “How Did You Contribute to OpenStreetMap?” here: http://hdyc.neis-one.org

thx @ Frederik & Richard for the idea
thx @ maɪˈæmɪ Dennis

*Update* (2020-06-11) What are the different requirements for your #HDYC type of #mapper? See