Tag: ChangeSets

OpenStreetMap Crowd Report – Season 2015

Almost one year has passed again. This means it’s time for the fourth OpenStreetMap (OSM) member activity analysis. The previous editions are online here: 2014, 2013 and 2012. Simon Poole already posted some interesting stats about the past few years. You can find all his results on the OSM wiki page. However, similar to last year, I try to dig a little deeper in some aspects.

Overall the OSM project has officially more than 2.2 million registered members (Aug, 9th 2015). For several of my OSM related webpages I create a personal OSM contributor database, based on the official OSM API v0.6. Anyway, when using this API, the final table will show a list with more than 3 million individual OSM accounts (Aug, 9th 2015). I’m not sure what the cause for this gap of almost 1 million members between the official number and the member number extracted with the API could be. Maybe some of you have a possible explanation? However, I think many accounts are created by spammers or bots.

The following chart shows a trend similar to the one of previous years: The project attracts a large number of newly registered members, but the sum of contributors that actively work on the project is fairly small. As mentioned in earlier posts, this phenomenon is nothing special for an online community project and has been analyzed for previous years already.

2015OSMMembers

Described in numbers (July 31st, 2015):

  • Registered OSM Members (OSM API): 3,032,954
  • Registered OSM Members (Official): 2,201,519
  • Members who created 1 Changeset: 562,670
  • Members who performed >= 10 Edits: 343,523
  • Members who created >=10 Changesets: 137,591

Personally, I really like the following diagram: It shows the increase in monthly contributor numbers over the past few years and their consistencies in collecting OSM data based on the first and latest contributed changeset of an OSM member. It’s great to see that at least some experienced mappers are still contributing to the project after more than five years.

2015OSMMembersSince

Some background information on how I created the stats: To retrieve the registration date of the members, I used the aforementioned OSM API. The other numbers are based on the OSM changeset dump, which is available for download here.

Next to the presented results above, you can find some daily updated statistics about the OSM project on OSMstats.

Thanks to maɪˈæmɪ Dennis.

Counting changes per Country – A different approach

OSMstats contains several statistics about the OpenStreetMap (OSM) project, such as daily-created objects, the amount of active contributors or detailed numbers for individual countries. One way to determine the sum of created or modified Node objects, is to use the minutely, hourly or daily OSM replication change files and counting the values for each country of the world. Sadly, this approach has some drawbacks. Firstly, the official files do not contain, for example, all Nodes of a modified way, which is required, when trying to find the country where the change took place. Furthermore, the determination of the country for a specific OSM object really depends on the border’s level of detail: More detailed country borders make the processing quite time-consuming. Some of you probably experienced this problem before when using Osmosis or a different OSM processing tool. Anyway, for calculating additional country statistics I tried a new approach:

  1. Determine the country of a changset based on its center position
  2. Use the changeset country information for all objects within this changeset.

map

Of course, the determined country of the changeset can “only” be generalized for the entire changeset content, but how does it compare with the current method utilized in OSMstats? I compared last week’s numbers of OSMstats for each country of the world with the newly introduced approach. In total, the number of active members per country differs for each weekday by around 3% (min. 1% and max. 5%). The average difference of created, modified and deleted Nodes per country is quite similar with 4% (min. 2% and max. 9%). The presented approach could produce partially incorrect results whenever a changeset contains border changes of two or more countries or if the center of the changeset is in the wrong country. But IMHO the assumption to use the changeset centers is sufficient to calculate results and determine changes per country. As you can see in the figure above, most OSM changesets happen in a manageable area within one country. Yes I know, exceptions prove the rule.

So, why am I doing this? The main idea behind this approach is to change the entire processing task for OSMstats within the coming weeks. The changes per country will then be based on the introduced approach. Another advantage will be, that this newly created information, gathered from the changesets, can be utilized to create additional contributor statistics.

Thanks to maɪˈæmɪ Dennis.

Visualizing the #MissingMaps OpenStreetMap Contributions

The Missing Maps project is a collaboration between the Humanitarian OpenStreetMap Team (HOT) and various partner agencies, such as the American or the British Red Cross. One of their main objectives is “to map the most vulnerable places in the developing world, in order that international and local NGOs and individuals can use the maps and data to better respond to crises affecting the areas.” You can find additional information about the Missing Maps Project on the OpenStreetMap (OSM) wiki and their project page.

A year ago, I created a webpage where you can filter OSM changesets by a specific comment. Sadly the webpage provides only a search for the latest seven days. However, the Missing Maps project asked me, if it’s possible to “look over a longer time scale”? Here we go, based on a similar concept that I used for a webpage that I created for the HOT Ebola Response, I made a Map that displays all OSM changesets which have the hashtag #MissingMaps in the comment attribute and have been created since August 1st, 2014. It’s online here and being updated on an hourly basis: http://resultmaps.neis-one.org/osm-missingmaps

http://resultmaps.neis-one.org/osm-missingmaps

The webpage also contains overall information about the number of OSM Contributors and map changes. So far more than 800 contributors created more than 1.5 Mio map changes in almost 22,000 changesets. The volunteers contributed in more than 30 countries such as Congo-Kinshasa, Sudan, Central African Republic, Indonesia, Ethiopia, Chad, Zimbabwe or Rwanda. Additionally the number of created changesets and contributors of the last seven days are displayed in two charts at the left-hand side. The time slider at the bottom of the map can be used to show the changesets between two specific dates. Finally an overview page lists the names of all OSM contributors who used the hashtag #MissingMaps in their changesets comment. Same as last time: Thank you & keep up the good work!

Thanks to maɪˈæmɪ Dennis.

Your Explored OSM World

Gregory Marler had the great idea to implement an “explored” map, based on a concept that some of you might know as “fog of war” from strategy video games. So here you go: I extended my OSM Heat Map with the “Explored Map Style”. It essentially reveals the contribution areas of an OpenStreetMap member in a “fog of war” style. The following figure shows Gregory’s amazing “explored” OSM map.

ExploredMapStyleToner

The Heat & Explored Maps are available for almost all OSM members who contributed at least several changesets here: http://yosmhm.neis-one.org (The new “Explored Map Style” can be selected in the layer panel (upper right corner). Additionally, I added the awesome looking and well known Watercolor and Toner map styles from Stamen design)

Thanks to maɪˈæmɪ Dennis

Welcome to an additional family member – OSMstats

Maybe some of you are already familiar with “OSMstats”, a website that provides numerous statistics about the OpenStreetMap (OSM) project. The site was created and is maintained by the two guys at altogetherlost.com. However, OSMstats has now been moved to the ResultMaps domain at osmstats.neis-one.org. I added several new features too. First of all, you can now select a specific date for your stats. Secondly, the main menu panel has been extended with a new entry for statistical information about OSM changesets.

osmstats

Additionally, the graphs for the country statistics, the active members and daily edits are also available in a “year”-overview. I hope you like the new extensions. A big thanks to both guys at altogetherlost.com who originally created OSMstats!

OSMstats is now available at: http://osmstats.neis-one.org
Feel free to check out my Resultmaps too which offer many helpful and funny OSM tools: http://resultmaps.neis-one.org

Notice: OSMstats was introduced in 2011, this means the webpage cannot provide statistics prior to that year. Also, the newly created Changeset-Tab has only data for July, 2014 and after.

Thanks to maɪˈæmɪ Dennis

The OSM Contributor Activity Report – Edition 2014

The OpenStreetMap (OSM) project celebrated its 10th anniversary in August 2014. For almost 10 years it has increased its number of registered members. Even though some contributors stopped their contributions to the project, each day new mappers start collecting features for the free wiki world map (aka database).

In my last contributor report in 2013, the OSM project had a total of 1.3 Mio registered members. For July 2014 this number has increased to almost 1.6 Mio registered members. Similarly to last year, I checked how many contributors created one or more than ten changesets or performed more than 10 map edits. This information can be retrieved from the changeset dump.

NewContributorsPerMonth.201408

The figure above reveals a similar trend to the ones we saw in the past few years: Less than 1/3 of the 1.6 Mio registered members actively contribute to the project (450,000 members). Furthermore, only a small group of 16% (270,000) or respectively 6% (100,000) of the contributors performed more than 10 edits or 10 changesets.

The long-term motivation of the contributors is quite important too. Therefore, similarly to the methods that we presented in our open access publication, I created a figure, which visualizes the increase in monthly volunteer numbers over the past few years and the consistencies in data contributions.

Activity.Stats.201408

As we already revealed in our study, only half of the monthly active members in OSM are also long-term contributors. Also, the previously discussed pattern which depicts a contributor loss of almost 70% over the years is again visible. However, it is good to see that at least some “senior” mappers still keep contributing to the OSM project.

Thanks to maɪˈæmɪ Dennis

Filtering OpenStreetMap Changesets by a Specific Comment

In my last blog post I showed that OpenStreetMap (OSM) changesets offer a great opportunity to visualize the latest changes to the OSM map or to compute some up to date descriptive statistics of a particular region (Typhoon Haiyan OSM Response Map). Oftentimes OSM contributors use tags, comments or hashtags in their changesets to provide additional information about the features they mapped. For example it is quite common to add a specific hashtag, such as #notlm (Night of the living maps), to the changeset comment to link to a mapping party or another event. To filter or collect changesets with these notations, I developed a new webpage: http://resultmaps.neis-one.org/osm-changesets

osm-changesets

The newly created website allows you to search for specific terms that have been used in a changeset’s comment section within the past 7 days. The changesets are based on an hourly updated OSM database. Every colored rectangle that is visualized on the map depicts one changeset. Additional descriptive statistics, such as the total number of contributors or map changes, are displayed on the left side of the website. Furthermore, charts illustrate the history of the number of changesets and contributors for the most recent 7 days. At the bottom of the left pane the TOP 5 countries with the most map changes that include the searched term are listed (for this computation the center of the changesets’ rectangle is used).

It is quite interesting to search for “bing” or “survey” (or “gps”). Give it a try and see which tags have been used in recent days. I hope that this tool is quite useful for any type of event or mapping party. It is available here: http://resultmaps.neis-one.org/osm-changesets

Thanks to maɪˈæmɪ Dennis

It’s about time – OpenStreetMap Contributor Activity Report 2013

One and a half years ago (end of 2011), one of my open access publications (“Analyzing the Contributor Activity of a Volunteered Geographic Information Project — The Case of OpenStreetMap“) was published. It contained several interesting findings about the contributions made by the community of the OSM project. The results showed that the community follows a particular pattern that many other online community based projects tend to struggle with too. Only a small number of the members really contribute in a meaningful way to the project. Additionally, the publication illustrated how many contributors are located in Europe and other areas of the world and how and where mappers contribute data over a certain period time.

I thought it was time to update this information with some new statistics. Between the end of 2011 and July 2013 the number of registered OSM members has increased more than two-an-a-half times to almost 1.34 Mio. Based on the freely available changeset dump of the project it is quite easy to check how many members created at least one changeset and thus hopefully made an edit to the database. The following figure shows the increase of registered members and the aforementioned results of the analysis of the changeset dump of July 31st, 2013.

2013_Members

By the end of 2011 almost 43% of the 505,000 registered members created at least one changeset. This number decreased by July 2013 to only 26% (355,000) of the 1.34 Mio registered members. As some of you already know, the real-number of actual contributors is also far below this. I decided to look into this in a little bit more detail and created some diagrams that show the number of changesets and active contributors per month. We can see a few events that had an impact on the numbers in the diagrams. First, the license-change in April 2012 followed by the run of the redaction bot in July 2012 (HDYC-profile) and at the end the release of the new OSM iD editor in May 2013. The number of changesets has not changed a lot when comparing current (July, 2013) numbers with prior months of last year.

2013_Changesets

The last diagram of this blog post shows the active contributors per month. The collected information tells us that the total number of “long-time” contributors is increasing whereas the number of “new” contributors is more or less on the same level in recent months.

2013_Contributors

It is also interesting to see an impact of “new” members in the month before the license change (March, 2012). Anyway, for the last one and a half years the number of active contributors per month is consistent with a total number between 19,000 and 23,000. What do you think?

You will find additional OSM editor usage statistics (by Oli-Wan) in the OSM Wiki. Also, it is interesting to see that currently the number of newly registered members is only growing between 700 and 900 per day. In the time before August, 2013 is was between 3,000 and 4,000 per day! Did anyone change something in the registration process at OSM.org, e.g. a new security/login mechanism during account creation?

Thanks to maɪˈæmɪ Dennis

PS: Happy 9th Birthday OpenStreetMap!

The OpenStreetMap Contributors Map aka Who’s around me?

The wait is over! As I mentioned in December, I have been working on an interactive online map, which shows you all volunteers of the OpenStreetMap world on a map. The first three layers contain the activity center of a contributor, her or his first created and latest modified node. The algorithm to determine the activity area of an OSM volunteer has been described in my publication here. I should mention that I used all changeset centers instead of all created nodes of a contributor. This way the computations don’t take as long and the process can be repeated every week based on the weekly OSM changeset dump.

The above image shows the created map for the center of London. As you can see, there are several Mapper-Types to choose from on the left side. Each mapper type is distinguished by the number of changesets that were created (shown in parentheses). However, most of the time you will see many orange or red figures on the map , which means that the OSM project has a lot of members who only made a few changes. This “issue” or “phenomenon” has also been mentioned in the publication.

Below the map you can find additional information which shows the current number of mappers in your map’s bbox. Sometimes the number is a little bit larger than the real number of contributors in your area. This depends on the method that Openlayers uses to load the mappers from my server onto the map. For the next update, I maybe plan to add the dates of the latest contribution of a member. This way you can get current information about the number of (active) contributors for your area.

The data will be updated on a daily and weekly base. It is also important to mention that each layer has a limit of 1.000 contributors to show on the map. Thus, if you zoom out, you will always see contributors, but sometimes the real number is much higher than the number of mapper icons you see on the map.

Last but not least some stats: Today (Jan 6th, 2012) the OpenStreetMap project has  reached 1 000 000 registered members. Around 300 000 (30%) of all contributors created at least one changeset and about 200 000 (20%) volunteers created at least one Node.  Of the 300 000 contributors who created at least one changeset, around 240 000 created less than 10 changesets, 45 000 (4.5%) between 10 and 100 changesets and 17 000 more than 100 changesets. I think this amount of 17 000 mappers or 1.7% of all registered members is obviously the amount of active OSM members. This is also comparable with the official OSM “highly active users” stats from here.

The map is online here:
Overview of OpenStreetMap Contributors aka Who’s around me?

¡Muchas gracias maɪˈæmɪ Dennis!

What type of Mapper are You?

Last weekend Frederik and Richard asked me if I could give some additional information on the „How did you contribute to OpenStreetMap?“ webpage. So here we go. Below the prior, familiar chart which shows the contributions per month, you will find two new charts. The first one shows the number of changesets per weekday and the second one the number of changesets per hour.

Additionally I added an output that roughly estimates what type of mapper the contributor is, based on his/her number of contributions (changesets). However, I will give no warranty regarding the group or type of mapper that each individual contributor falls into and I think you will figure out the different groups of mappers by yourself anyway 😉

The following picture highlights the new things on my webpage:

Most of you already know it, you will find “How Did You Contribute to OpenStreetMap?” here: http://hdyc.neis-one.org

thx @ Frederik & Richard for the idea
thx @ maɪˈæmɪ Dennis

*Update* (2020-06-11) What are the different requirements for your #HDYC type of #mapper? See