Tag: Planet

The Average Age of OpenStreetMap Objects

Joseph Reeves asked me on twitter the other day if “anyone knows the average age of @openstreetmap objects?“. Here we go: Based on the complete OSM data history file from here (June 14th, 2014) and some additional lines of code, I conducted a simple analysis.

Overall 400,000 mappers of the more than 1.7 million registered members contributed to the OSM project. Almost 375,000 contributors created at least one Node, 325,000 one Way and 70,000 one Relation object. In total the contributors collected more than 2.7 billion Nodes, 263 million Ways and 3 million relations. The percentage of newly created OSM objects (Nodes, Ways & Relations) has been more or less at the same level for the past few years (2010 to 2014): with17% to 20%. The following diagram shows the percentage of each created OSM object type.

created_objects

Additionally, I evaluated the number of objects based on the date of their last modification. Utilizing the object timestamps of the last modification, we see a slightly different result for the last 4 years. 55% of the Nodes, 67% of the Ways and 74% of the Relations in the OSM database do not have a timestamp dated before 2012.

last_modifier

However, I guess it would be an interesting visualization, if we could put those numbers on a world map similar to the “OpenStreetMap availability” by Stefano De Sabbata. You can also find some up to date OSM statistics here.

Thanks to maɪˈæmɪ Dennis

Filtering OpenStreetMap Changesets by a Specific Comment

In my last blog post I showed that OpenStreetMap (OSM) changesets offer a great opportunity to visualize the latest changes to the OSM map or to compute some up to date descriptive statistics of a particular region (Typhoon Haiyan OSM Response Map). Oftentimes OSM contributors use tags, comments or hashtags in their changesets to provide additional information about the features they mapped. For example it is quite common to add a specific hashtag, such as #notlm (Night of the living maps), to the changeset comment to link to a mapping party or another event. To filter or collect changesets with these notations, I developed a new webpage: http://resultmaps.neis-one.org/osm-changesets

osm-changesets

The newly created website allows you to search for specific terms that have been used in a changeset’s comment section within the past 7 days. The changesets are based on an hourly updated OSM database. Every colored rectangle that is visualized on the map depicts one changeset. Additional descriptive statistics, such as the total number of contributors or map changes, are displayed on the left side of the website. Furthermore, charts illustrate the history of the number of changesets and contributors for the most recent 7 days. At the bottom of the left pane the TOP 5 countries with the most map changes that include the searched term are listed (for this computation the center of the changesets’ rectangle is used).

It is quite interesting to search for “bing” or “survey” (or “gps”). Give it a try and see which tags have been used in recent days. I hope that this tool is quite useful for any type of event or mapping party. It is available here: http://resultmaps.neis-one.org/osm-changesets

Thanks to maɪˈæmɪ Dennis

Typhoon Haiyan OSM Response Map

As you may know by now, the Philippines have been struck by one of the largest Super Typhoons ever recorded. Many casualties are expected (especially in Tacloban) and even more people are in need of help. While some of us have been busy working with the “Stand By Task Force” to analyze and geolocate tweets with useful information, the Humanitarian OpenStreetMap Team (HOT) has been making progress as well.
I have spent some time to develop a website that visualizes the latest changes to the OSM map (utilizing changesets) in the Philippines and hope that it helps to determine areas that might be already worked on, while other areas are lacking any new information. You can find the map here: http://resultmaps.neis-one.org/osm-typhoon-haiyan-2013

osm-activities

Additional information can also be found in the OSM Wiki and for all German fellows at the Wochennotiz blog, in case you are interested in actively contributing and helping the disaster response teams. Any mapping efforts are much appreciated!

Some statistics: Until midnight between Saturday and Sunday (November 9th/10th), almost 180 contributors made more than 245,000 map changes. On Sunday evening 6pm UTC (November 10th, 2013) the values increased to 245 volunteers who created nearly 440,000 map changes within the aforementioned extent. AWESOME, keep up that great work! Thank you.

Link to the website: http://resultmaps.neis-one.org/osm-typhoon-haiyan-2013

Some technical background information: The minutely changeset diff files are imported in a PostgreSQL database. The created website only visualizes the changesets which are within a predefined extent, i.e. the Philippines and some parts of the Vietnam coast. This extent is illustrated by a black line on the website. The OSM changeset data is updated on an hourly basis.

Thanks to maɪˈæmɪ Dennis

It’s about time – OpenStreetMap Contributor Activity Report 2013

One and a half years ago (end of 2011), one of my open access publications (“Analyzing the Contributor Activity of a Volunteered Geographic Information Project — The Case of OpenStreetMap“) was published. It contained several interesting findings about the contributions made by the community of the OSM project. The results showed that the community follows a particular pattern that many other online community based projects tend to struggle with too. Only a small number of the members really contribute in a meaningful way to the project. Additionally, the publication illustrated how many contributors are located in Europe and other areas of the world and how and where mappers contribute data over a certain period time.

I thought it was time to update this information with some new statistics. Between the end of 2011 and July 2013 the number of registered OSM members has increased more than two-an-a-half times to almost 1.34 Mio. Based on the freely available changeset dump of the project it is quite easy to check how many members created at least one changeset and thus hopefully made an edit to the database. The following figure shows the increase of registered members and the aforementioned results of the analysis of the changeset dump of July 31st, 2013.

2013_Members

By the end of 2011 almost 43% of the 505,000 registered members created at least one changeset. This number decreased by July 2013 to only 26% (355,000) of the 1.34 Mio registered members. As some of you already know, the real-number of actual contributors is also far below this. I decided to look into this in a little bit more detail and created some diagrams that show the number of changesets and active contributors per month. We can see a few events that had an impact on the numbers in the diagrams. First, the license-change in April 2012 followed by the run of the redaction bot in July 2012 (HDYC-profile) and at the end the release of the new OSM iD editor in May 2013. The number of changesets has not changed a lot when comparing current (July, 2013) numbers with prior months of last year.

2013_Changesets

The last diagram of this blog post shows the active contributors per month. The collected information tells us that the total number of “long-time” contributors is increasing whereas the number of “new” contributors is more or less on the same level in recent months.

2013_Contributors

It is also interesting to see an impact of “new” members in the month before the license change (March, 2012). Anyway, for the last one and a half years the number of active contributors per month is consistent with a total number between 19,000 and 23,000. What do you think?

You will find additional OSM editor usage statistics (by Oli-Wan) in the OSM Wiki. Also, it is interesting to see that currently the number of newly registered members is only growing between 700 and 900 per day. In the time before August, 2013 is was between 3,000 and 4,000 per day! Did anyone change something in the registration process at OSM.org, e.g. a new security/login mechanism during account creation?

Thanks to maɪˈæmɪ Dennis

PS: Happy 9th Birthday OpenStreetMap!

Add a Note in OSM … Stats & Personal Profiles

Since April 23th, 2013 each visitor, user or contributor of the OpenStreetMap (OSM) project can “add a note” to the map in order to easily mark an error or missing object in the map data. You can find more information about this new feature in the OSM wiki. It is a great new way for people to contribute to the project by improving the data in a simple way. To provide a better overview I created a new webpage which shows some statistics about the new feature. You can find it here: resultmaps.neis-one.org/osm-notes

Besides some general information the webpage also shows the overall, opened and closed number of notes per country. The second table illustrates the OSM contributors who already opened, commented or closed a note. All tables on the page are sortable by clicking on the column headers.

Additionally I integrated the individual contributor note stats to the OSM personal profiles @ “How did you contribute to OpenStreetMap?“. The following image shows the new add-on, of course with Harry, our guinea pig No. 1, and as always, great work here too! 🙂

¡Muchas gracias maɪˈæmɪ Dennis

Introducing OpenStreetMap Contributor Activity Areas

One month ago I wrote a blog post about a new website which allows you to see other OpenStreetMap contributors in your area. Overall the feedback was very positive, thank you very much for that! However, now it is time for a new extension to the “How did you contribute to OpenStreetMap?” (HDYC) webpage. As I mentioned in my last blog post, I used an algorithm (which is described in a paper that I wrote here) to compute and determine the activity area of a contributor based on her/his changeset centers. The following figure shows the new function that was added to the HDYC website visualizing the activity area of a contributor! Sorry Harry, as always you have to be our guinea pig, but you have a really awesome activity area 🙂

Next to the visualization of the overall activity area of a contributor, you can also click on a link at the bottom of the map to switch to the contributors’ activity area of the past six months. Furthermore, all maps on HDYC now use the great Leaflet map library instead of Openlayers. Also, your activity areas’ first and last Nodes have a direct link to the “Overview of OpenStreetMap Contributors aka Who’s around me?” webpage. This provides an easy way to locate other contributors in your area. I have to mention that not every contributor has an activity area for the past six months. It highly depends on the activity of the contributor within this time frame!

One more thing: The aforementioned “Who’s around me?” webpage has three new overlays. Two overlays show the contributors of the past six months with their first and last Nodes and one additional layer shows the activity areas also based on the past six months for each contributor. You can find all new layers in the upper right corner in the so-called “Layerswitcher”.

My HDYC database is updated more or less on a daily basis. The information about your changeset activities is updated once a week (based on the weekly changeset dumps from here). “The Created Nodes per Country”-section can only be updated when a new full history dump is available, but you can always find the latest date in the section-label. The “Who’s around me?” webpage uses almost the same database as HDYC, so the data up-to-dateness is similar.

Have fun with the new gadgets!

¡Muchas gracias maɪˈæmɪ Dennis

The OpenStreetMap Contributors Map aka Who’s around me?

The wait is over! As I mentioned in December, I have been working on an interactive online map, which shows you all volunteers of the OpenStreetMap world on a map. The first three layers contain the activity center of a contributor, her or his first created and latest modified node. The algorithm to determine the activity area of an OSM volunteer has been described in my publication here. I should mention that I used all changeset centers instead of all created nodes of a contributor. This way the computations don’t take as long and the process can be repeated every week based on the weekly OSM changeset dump.

The above image shows the created map for the center of London. As you can see, there are several Mapper-Types to choose from on the left side. Each mapper type is distinguished by the number of changesets that were created (shown in parentheses). However, most of the time you will see many orange or red figures on the map , which means that the OSM project has a lot of members who only made a few changes. This “issue” or “phenomenon” has also been mentioned in the publication.

Below the map you can find additional information which shows the current number of mappers in your map’s bbox. Sometimes the number is a little bit larger than the real number of contributors in your area. This depends on the method that Openlayers uses to load the mappers from my server onto the map. For the next update, I maybe plan to add the dates of the latest contribution of a member. This way you can get current information about the number of (active) contributors for your area.

The data will be updated on a daily and weekly base. It is also important to mention that each layer has a limit of 1.000 contributors to show on the map. Thus, if you zoom out, you will always see contributors, but sometimes the real number is much higher than the number of mapper icons you see on the map.

Last but not least some stats: Today (Jan 6th, 2012) the OpenStreetMap project has  reached 1 000 000 registered members. Around 300 000 (30%) of all contributors created at least one changeset and about 200 000 (20%) volunteers created at least one Node.  Of the 300 000 contributors who created at least one changeset, around 240 000 created less than 10 changesets, 45 000 (4.5%) between 10 and 100 changesets and 17 000 more than 100 changesets. I think this amount of 17 000 mappers or 1.7% of all registered members is obviously the amount of active OSM members. This is also comparable with the official OSM “highly active users” stats from here.

The map is online here:
Overview of OpenStreetMap Contributors aka Who’s around me?

¡Muchas gracias maɪˈæmɪ Dennis!

OSM-Gravatar, Changeset changes & Way-Tags @ HDYC

After my latest updates to the “How did you contribute to OpenStreetMap?” website, some users asked me if I could add the new OSM gravatar to it. Starting today, you can find your OSM-gravatar from your OSM user website on HDYC too. If your HDYC-profile doesn’t show a gravatar yet, please be patient. It will be automatically updated as soon as you make any type of OSM edit to the OSM database. The following figure contains all updates that were made to the website marked with a circle. As always, Harry is our example 😉

As a second update, I added the number of changes that were made in a user’s changeset and grouped them into three classes. This way the website shows if a user only makes a lot of changesets with 15 or less edits, more than 150 edits or something in between. Last but not least, you can find some additional information about the number of ways of which the user is the last modifier, including its way tag. This provides some information about the data collection tendency of the contributor, for instance if the user only creates a lot of buildings or large landuse areas.

Check all updates here: How did you contribute to OpenStreetMap?

Ps: You can also find the total number of countries in your profile in which you contributed at least one node.

Muchas Gracias @ maɪˈæmɪ aka Oleta River State Park Dennis 🙂

Distribution of Active Users in OpenStreetMap – Oct-Nov 2012

Two years ago, we created some maps which showed you the number of users per country for a timeframe of one month. Maybe some of you remember that the highest concentration of active contributors in relation to the countries’ population could be found in Europe. We thought it was about time to make some new maps to see if things have changed. The following map shows you the number of active contributors per day per country.

Similar to our results two years ago, the above map only gives some general information about the total number of users per country and does not consider the population for each country. Therefore we created a second map which shows you the relation between active users and the population in each country per day.

Overall the maps show a slightly similar activity pattern of the OSM users as in our previous results two years ago. The major concentration of the project still lies in Europe expanding more and more to the east. However, you can see certain changes in other areas of the world too. First improvements have been made in Africa, South America and South-East Asia. Greenland of course is looking quite exceptional due to the low population value.

So, what do you think? Where are you located and how would you describe the mapping activity development in your country?

***Update: Nov. 20th, 2012***

Overhauling “How did you contribute to OpenStreetMap?”

My last update about the HDYC website is a few months old now. For those readers who do not know what HDYC is: “How did you contribute to OpenStreetMap?” is a webpage which shows you in detail how long, when, where a member of the OSM project contributed to the project and which tools she/he used.

This time I added some new stats and graphs to the site. One of my favorite new features is the location information which shows the countries in which a contributor created at least one OSM Node:

A second new feature shows how long the mapper is already registered with the project and how many *active* mapping days she/he had:

You can also find some more information about the changesets of the user e.g. the number of changesets with a comment, the number of unique changeset comments and the median character length of the comments. Additionally, you will also see some information about deleted nodes, ways or relations:

Some of you might know about Richard Weait’s “Mapper Baseball Cards” idea. I added a similar graph to the end of the page to show which editors have been used by the mapper (thx Richard for the idea).

You will also see some facts about how many traces a user has uploaded to the OSM project and how many user blocks he received or if a user block is still active. Most of the stats are updated on a daily basis while the changeset stats will be updated once per week (which depend on the changeset dump).

Maybe we should create a “Hall of Fame” of OSM Contributors?

  1. Contributor with most visited countries? -> mikelmaron ?
  2.  Most active contributor? -> Zambelli Limitada ?
  3.  … any other ideas?

However, I hope you like it!? Have fun …
>> http://hdyc.neis-one.org <<

thx @ maɪˈæmɪ Dennis for proofreading