Tag: World

Typhoon Haiyan OSM Response Map

As you may know by now, the Philippines have been struck by one of the largest Super Typhoons ever recorded. Many casualties are expected (especially in Tacloban) and even more people are in need of help. While some of us have been busy working with the “Stand By Task Force” to analyze and geolocate tweets with useful information, the Humanitarian OpenStreetMap Team (HOT) has been making progress as well.
I have spent some time to develop a website that visualizes the latest changes to the OSM map (utilizing changesets) in the Philippines and hope that it helps to determine areas that might be already worked on, while other areas are lacking any new information. You can find the map here: http://resultmaps.neis-one.org/osm-typhoon-haiyan-2013

osm-activities

Additional information can also be found in the OSM Wiki and for all German fellows at the Wochennotiz blog, in case you are interested in actively contributing and helping the disaster response teams. Any mapping efforts are much appreciated!

Some statistics: Until midnight between Saturday and Sunday (November 9th/10th), almost 180 contributors made more than 245,000 map changes. On Sunday evening 6pm UTC (November 10th, 2013) the values increased to 245 volunteers who created nearly 440,000 map changes within the aforementioned extent. AWESOME, keep up that great work! Thank you.

Link to the website: http://resultmaps.neis-one.org/osm-typhoon-haiyan-2013

Some technical background information: The minutely changeset diff files are imported in a PostgreSQL database. The created website only visualizes the changesets which are within a predefined extent, i.e. the Philippines and some parts of the Vietnam coast. This extent is illustrated by a black line on the website. The OSM changeset data is updated on an hourly basis.

Thanks to maɪˈæmɪ Dennis

It’s about time – OpenStreetMap Contributor Activity Report 2013

One and a half years ago (end of 2011), one of my open access publications (“Analyzing the Contributor Activity of a Volunteered Geographic Information Project — The Case of OpenStreetMap“) was published. It contained several interesting findings about the contributions made by the community of the OSM project. The results showed that the community follows a particular pattern that many other online community based projects tend to struggle with too. Only a small number of the members really contribute in a meaningful way to the project. Additionally, the publication illustrated how many contributors are located in Europe and other areas of the world and how and where mappers contribute data over a certain period time.

I thought it was time to update this information with some new statistics. Between the end of 2011 and July 2013 the number of registered OSM members has increased more than two-an-a-half times to almost 1.34 Mio. Based on the freely available changeset dump of the project it is quite easy to check how many members created at least one changeset and thus hopefully made an edit to the database. The following figure shows the increase of registered members and the aforementioned results of the analysis of the changeset dump of July 31st, 2013.

2013_Members

By the end of 2011 almost 43% of the 505,000 registered members created at least one changeset. This number decreased by July 2013 to only 26% (355,000) of the 1.34 Mio registered members. As some of you already know, the real-number of actual contributors is also far below this. I decided to look into this in a little bit more detail and created some diagrams that show the number of changesets and active contributors per month. We can see a few events that had an impact on the numbers in the diagrams. First, the license-change in April 2012 followed by the run of the redaction bot in July 2012 (HDYC-profile) and at the end the release of the new OSM iD editor in May 2013. The number of changesets has not changed a lot when comparing current (July, 2013) numbers with prior months of last year.

2013_Changesets

The last diagram of this blog post shows the active contributors per month. The collected information tells us that the total number of “long-time” contributors is increasing whereas the number of “new” contributors is more or less on the same level in recent months.

2013_Contributors

It is also interesting to see an impact of “new” members in the month before the license change (March, 2012). Anyway, for the last one and a half years the number of active contributors per month is consistent with a total number between 19,000 and 23,000. What do you think?

You will find additional OSM editor usage statistics (by Oli-Wan) in the OSM Wiki. Also, it is interesting to see that currently the number of newly registered members is only growing between 700 and 900 per day. In the time before August, 2013 is was between 3,000 and 4,000 per day! Did anyone change something in the registration process at OSM.org, e.g. a new security/login mechanism during account creation?

Thanks to maɪˈæmɪ Dennis

PS: Happy 9th Birthday OpenStreetMap!

Introducing OpenStreetMap Contributor Activity Areas

One month ago I wrote a blog post about a new website which allows you to see other OpenStreetMap contributors in your area. Overall the feedback was very positive, thank you very much for that! However, now it is time for a new extension to the “How did you contribute to OpenStreetMap?” (HDYC) webpage. As I mentioned in my last blog post, I used an algorithm (which is described in a paper that I wrote here) to compute and determine the activity area of a contributor based on her/his changeset centers. The following figure shows the new function that was added to the HDYC website visualizing the activity area of a contributor! Sorry Harry, as always you have to be our guinea pig, but you have a really awesome activity area 🙂

Next to the visualization of the overall activity area of a contributor, you can also click on a link at the bottom of the map to switch to the contributors’ activity area of the past six months. Furthermore, all maps on HDYC now use the great Leaflet map library instead of Openlayers. Also, your activity areas’ first and last Nodes have a direct link to the “Overview of OpenStreetMap Contributors aka Who’s around me?” webpage. This provides an easy way to locate other contributors in your area. I have to mention that not every contributor has an activity area for the past six months. It highly depends on the activity of the contributor within this time frame!

One more thing: The aforementioned “Who’s around me?” webpage has three new overlays. Two overlays show the contributors of the past six months with their first and last Nodes and one additional layer shows the activity areas also based on the past six months for each contributor. You can find all new layers in the upper right corner in the so-called “Layerswitcher”.

My HDYC database is updated more or less on a daily basis. The information about your changeset activities is updated once a week (based on the weekly changeset dumps from here). “The Created Nodes per Country”-section can only be updated when a new full history dump is available, but you can always find the latest date in the section-label. The “Who’s around me?” webpage uses almost the same database as HDYC, so the data up-to-dateness is similar.

Have fun with the new gadgets!

¡Muchas gracias maɪˈæmɪ Dennis

The OpenStreetMap Contributors Map aka Who’s around me?

The wait is over! As I mentioned in December, I have been working on an interactive online map, which shows you all volunteers of the OpenStreetMap world on a map. The first three layers contain the activity center of a contributor, her or his first created and latest modified node. The algorithm to determine the activity area of an OSM volunteer has been described in my publication here. I should mention that I used all changeset centers instead of all created nodes of a contributor. This way the computations don’t take as long and the process can be repeated every week based on the weekly OSM changeset dump.

The above image shows the created map for the center of London. As you can see, there are several Mapper-Types to choose from on the left side. Each mapper type is distinguished by the number of changesets that were created (shown in parentheses). However, most of the time you will see many orange or red figures on the map , which means that the OSM project has a lot of members who only made a few changes. This “issue” or “phenomenon” has also been mentioned in the publication.

Below the map you can find additional information which shows the current number of mappers in your map’s bbox. Sometimes the number is a little bit larger than the real number of contributors in your area. This depends on the method that Openlayers uses to load the mappers from my server onto the map. For the next update, I maybe plan to add the dates of the latest contribution of a member. This way you can get current information about the number of (active) contributors for your area.

The data will be updated on a daily and weekly base. It is also important to mention that each layer has a limit of 1.000 contributors to show on the map. Thus, if you zoom out, you will always see contributors, but sometimes the real number is much higher than the number of mapper icons you see on the map.

Last but not least some stats: Today (Jan 6th, 2012) the OpenStreetMap project has  reached 1 000 000 registered members. Around 300 000 (30%) of all contributors created at least one changeset and about 200 000 (20%) volunteers created at least one Node.  Of the 300 000 contributors who created at least one changeset, around 240 000 created less than 10 changesets, 45 000 (4.5%) between 10 and 100 changesets and 17 000 more than 100 changesets. I think this amount of 17 000 mappers or 1.7% of all registered members is obviously the amount of active OSM members. This is also comparable with the official OSM “highly active users” stats from here.

The map is online here:
Overview of OpenStreetMap Contributors aka Who’s around me?

¡Muchas gracias maɪˈæmɪ Dennis!

Distribution of Active Users in OpenStreetMap – Oct-Nov 2012

Two years ago, we created some maps which showed you the number of users per country for a timeframe of one month. Maybe some of you remember that the highest concentration of active contributors in relation to the countries’ population could be found in Europe. We thought it was about time to make some new maps to see if things have changed. The following map shows you the number of active contributors per day per country.

Similar to our results two years ago, the above map only gives some general information about the total number of users per country and does not consider the population for each country. Therefore we created a second map which shows you the relation between active users and the population in each country per day.

Overall the maps show a slightly similar activity pattern of the OSM users as in our previous results two years ago. The major concentration of the project still lies in Europe expanding more and more to the east. However, you can see certain changes in other areas of the world too. First improvements have been made in Africa, South America and South-East Asia. Greenland of course is looking quite exceptional due to the low population value.

So, what do you think? Where are you located and how would you describe the mapping activity development in your country?

***Update: Nov. 20th, 2012***

I Like OpenStreetMap (OpenLayers Plugin)

A few months ago, Frederik Ramm posted an idea on the German OpenStreetMap mailing list about a new (stochastic) approach to OSM data quality assurance. You can find his original German post here. His idea was to create a way to allow users to “like” or “dislike” a specific region on the OSM map, a function that other popular websites such as YouTube or Facebook implemented to allow users to provide feedback to videos or status updates. For OSM this particular function could give some indicators or trends about the OSM map data.

I really liked his idea and in collaboration with Frederik I created an Open Source OpenLayers plugin. For all new readers: OpenLayers is an Open Source library which can implement a dynamic (OSM) map into more or less any webpage. One of our goals was to make the integration of the ILikeOSM plugin as easy as adding a tile server to your OpenLayers map.

The following image shows the plugin in more detail, including the “like” and “dislike” buttons to provide feedback about the area on the map.

An additional feature of the plugin shows how many users have been viewing the same area of the map that the current user is taking a look at. More precisely: How many other users have been viewing a similar area of the map within the past two minutes with a zoom level of +-3 to yours. All components of the plugin are Open Source and available on github. The database which saves the likes and dislikes is running on a German OSM Dev server. A database dump file can be downloaded on a daily basis. It is important to note at this point that no private data is saved in the database when a user leaves his or her feedback. The plugin only saves an independent, randomly generated user ID, the feedback type i.e. thumbs up/down, the zoom level, the layer name and the bounding box of the map section. A map view is generally not saved to the database until the user accepts to do so via a pop up window.

Do you like this feature?
It is quite easy to integrate it into your own webpage. Here is how it works:
1. Add the following line below your OpenLayers script-tag:
<script src=”http://ilike.openstreetmap.de/ILikeOSM.min.js” type=”text/javascript”></script>
2. Then add the following lines to your OpenLayers Controls:
new OpenLayers.ILikeOSM()
3. Styling
<style type="text/css">
div.olILikeOSM { position: absolute; top: 15px; left: 50px; padding: 7px; color:white; border-radius: 10px; background: rgba(0, 0, 0, 0.6); }
div.olILikeOSM a { color: white; font-size:12px; text-decoration: underline; }
</style>
4. That’s it!

What is the benefit of this plugin or of the saved ILikeOSM data?
Based on the saved likes, dislikes and map views we can generate some statistics to provide you with information about the number of people who like or dislike your particular area of interest. Maybe we can even see some prove of Linu’s law “given enough eyeballs, all bugs are shallow”; meaning in this case, that a larger number of users that check a certain region of the map, results in “better” OSM data quality. As a first prototype, I generated a static webpage which shows an example result map.

Further ideas?
The plugin could potentially be expanded with an additional textbox in which a user could leave a comment why the area is not well represented in OSM. This information could then be saved e.g. in OpenStreetBugs. Anyway, we think that the current version of the plugin could provide some very useful information. You will find a webpage with all information, examples and downloads here: http://ilike.openstreetmap.de As a first step we integrated the plugin into the OpenStreetMap Germany webpage.

Frederik will give a short talk about the ILikeOSM plugin at the upcoming State of the Map 2012 in Tokyo. If our proposed session abstract about another topic for the State of the Map 2012 US gets accepted, Dennis will try to present it there too.

Thank you very much for your feedback: Frederik, Jonas, Dennis, Sven & Marc

New OSM Contributor Feed

The OpenStreetMap project keeps attracting more and more new members that register and start contributing their data to the project. In one of my last blog posts I presented a website which shows the location of each new and active member based on one of their first edits. Since the launch of this website, some of you asked me about a potential opportunity to feed this information for a particular area. Well, there you go!

You can create your own bbox of interest to determine the area in which you would like to be informed about new members. All you need is the center coordinates (lon & lat) of your area. The following URL is an example for Berlin (Germany):
http:// resultmaps.neis-one.org/newestosmfeed.php?lon=13.3&lat=52.5&deg=1

The “deg” parameter is used to specify the length (degrees) of your bbox. This means that with a “deg” value of 1, a distance of about 111km in each direction from your center point will be determined to create the bbox. This value of 1 degree also represents the maximum distance possible. The resulting Atom feed contains all new members of the past 7 days that made at least one change in you predefined area [1]. Some additional information about each new member was added too [2]. The database will be updated every morning between 6 and 7am CET.

*Update*
On the following webpage you can create your own personal osm feed in a few simple steps: http://resultmaps.neis-one.org/newestosmcreatefeed.php

Enjoy!

thx @ maɪˈæmɪ Dennis

OSM-GPS-Grid-Map

More than 6 weeks ago, I wrote a blog post about “Which country has the most OpenStreetMap GPS Points?“. You might remember that Russia and Germany provide the most OSM GPS points, as mentioned in the blog post.

Now, in a second step I created a worldwide grid, with an edge length of 15km, to show in more detail where the GPS points are located. The rendering of the tiles has been accomplished with the great TileMill software. Usually you would see some GPS noise in the grid cells above the equator. Thus, to eliminate this noise and to create a better overview, grid cells with less than 5 GPS points are made transparent. The following image shows an overview of Europe and the corresponding OSM GPS density. Of course you can also see some quite interesting and funny airplane, ferry or cruise routes.

However, I think the map overlay looks great and shows where the OSM GPS points are located. This information will also be published in the OSMatrix (thanks to Oliver Roick) within the next few days.

You can find my map here: http://resultmaps.neis-one.org/osmgps.html

PS: Below the map you will find a slider for the opacity of the GPS Grid Overlay, Enjoy!

thx @ maɪˈæmɪ Dennis for proofreading
thx @ *Fab* for creating the tiles/mapkey with MapBox’s TileMill

Which country has the most OpenStreetMap GPS Points?

Some of you might already know that OpenStreetMap released a first bulk GPS point dataset last weekend. It contains almost 2.8 milliard (or for readers in the US 2.8 billion) points and is provided in its raw format, which means that only coordinate information is available for each point. Unfortunately it does not include any additional information or metadata. You can read more about it at the OSM Foundation Blog.

The first idea that came to my mind was a simple comparison analysis to answer the following questions: Where are all those points located and which country has the most GPS points? In a first try I conducted some results that showed that all points are distributed over 238 countries. For my analysis I used the OSM Mapnik world boundaries from the wiki. As you can see in the following pie chart, nearly 21% of the points are located in Russia (about 570 million points) and another 18% in Germany (about 500 million points). Does Russia have so many GPS points because of the country size or is the community just exceptionally active with GPS devices? However, the strange thing is that Germany is, with about 18%, “only” on the second place this time, weird isn’t it? 😉

I think overall these are some quite interesting numbers. We all hope to see some more metadata information in the OSM GPS point dataset soon.

thx @ maɪˈæmɪ Dennis & Good luck for next week!

*UPDATE* April 11th, 2012
The following map shows the OSM GPS points per 1000km²:

The second map shows the OSM GPS points per 1000 inhabitans:

What type of Mapper are You?

Last weekend Frederik and Richard asked me if I could give some additional information on the „How did you contribute to OpenStreetMap?“ webpage. So here we go. Below the prior, familiar chart which shows the contributions per month, you will find two new charts. The first one shows the number of changesets per weekday and the second one the number of changesets per hour.

Additionally I added an output that roughly estimates what type of mapper the contributor is, based on his/her number of contributions (changesets). However, I will give no warranty regarding the group or type of mapper that each individual contributor falls into and I think you will figure out the different groups of mappers by yourself anyway 😉

The following picture highlights the new things on my webpage:

Most of you already know it, you will find “How Did You Contribute to OpenStreetMap?” here: http://hdyc.neis-one.org

thx @ Frederik & Richard for the idea
thx @ maɪˈæmɪ Dennis

*Update* (2020-06-11) What are the different requirements for your #HDYC type of #mapper? See