Category: HDYC

New metric for measuring the “qualitative nature” of OpenStreetMap activities @ How did you contribute ?

Back in June we had a twitter chat about potential new features for the “How did you contribute to OpenStreetMap” (HDYC) website. One suggestion was to “show more relevant information about skills, tagging system or the quality of contributions” of a project member (by J-Louis). Overall I really like the following summary by Claudius: “HDYC started off with a strong focus on quantitative metrics and you expanded it lately a lot to reflect the qualitative nature of contributions. I think there’s value to show more about which area of data someone contributed: Auto/bike/railway/water infrastructure, amenities…”.

So I finally started searching in the OpenStreetMap (OSM) wiki for any feasible information about “groups of tags” or “tag categories”. Altogether, I couldn’t discover any solution that fits perfectly to determine the areas of data a mapper contributed in. However, later I got a hint from the JOSM developers to use the presets of the well-known and popular editor. You may ask, ‘What are presets?’ “Presets in JOSM are menu-driven shortcuts to tag common object types in OpenStreetMap. They provide you with a user friendly interface to edit one or more objects at a time, suggest additional keys and values you may wish to add to those objects, and most importantly, prevent you from having to enter keys and values by hand.” You can find many different presets at the aforementioned JOSM page. However, during my data processing I utilized the “default presets”. The XML file contains many combinations of popular or established tag combinations, which contributors use when they are mapping.

So far so good, as a first step I released a new version of “Find Suspicious OpenStreetMap Changesets“. It shows the utilized presets for each changeset. This can already indicate some quality aspects such as attribute (tag) accuracy or completeness. Now, after some weeks and some minor adjustments, I started to use this collected information about applied presets to expand the metrics of a mapper’s profile. The HDYC-page now also lists which presets the mapper recently utilized during her/his contributions such as adding, modifying or removing map elements. I think this is a really useful next step towards an even more required aspect of quality assurance that we highly need with the OSM project.

Some technical details: The database behind the “Find Suspicious OpenStreetMap Changesets” webpage uses the augmented diff files of the Overpass-API. The utilized “default” preset list of the JOSM editor can be found here (Internal Preset list). The entire processing tool was developed with JAVA and uses a Postgres database to store the results. By now, only recently utilized presets of the past 60 days of the contributor’s activity are utilized and presented.

However, thank you very much for all your feedback. Hope that it helps.

Thanks to maɪˈæmɪ Dennis.

Public profiles on “How did you contribute to OSM?”

The web page How did you contribute to OpenStreetMap? (HDYC) provides individual detailed information about project members. Some time ago, the page has been revised, that member profiles can only be accessed, when users logged in with their OpenStreetMap (OSM) user account. This feature has been implemented, after a long and important discussion about “protecting user privacy in the OSM project”. The complete German discussion can be found here. However, I don’t want to continue the discussion here. I still support that any information, which are available about contributors, should not be hidden in project data dumps, APIs or on webpages. In my opinion, information such as contributor names or ids and modification timestamps are essential for doing quality analysis and assessments to protect the project against e.g. vandalism or unintended map edits.

Anyway, after the last modification, which required the mentioned user login on HDYC, I got positive and also negative feedback. Most negative feedback concerned that profiles are now hidden and not public anymore. But because contributors want to show their mapping efforts, I implemented a new feature, that profiles can be accessed without a user login on HDYC. So, if you want that anyone can access and see your OSM profile, just add a link to your HDYC profile on your OSM profile page. Similar as you did this maybe already for your OSM-related accounts (see blog post). The tool-chain checks the profiles of every contributor, who has been active within the last 24 hours.

Additionally, the HDYC web page got several small updates. The overall ranking has been switched to more meaningful recent country rankings. The “last modifier of” amounts have been temporary removed/replaced by detailed numbers of created and modified way elements. The changeset table now also contains some really useful hints about used words in the changesets comments and hashtags and their amounts. This feature has been requested by a German contributor, thanks “!i!”. Most of the displayed numbers should be updated on an hourly basis. Only the activity areas and information about changesets are “only” updated every 24 hours. Some numbers also contain links to further statistics such as detailed information about recent changesets, ranking lists of a country and commented or discussed changesets. Overall I tried to highlight further efforts and activities, such changeset discussions, related accounts or roles, and not “only” raw mapping element amounts.

Thanks to maɪˈæmɪ Dennis.

Verified OpenStreetMap contributor profiles?

The reputation of a contributor in OpenStreetMap (OSM) plays a significant role, especially when considering the quality assessment of the collected data. Sometimes it’s difficult to make a meaningful statement about a contributor by simply looking at the raw mapping work represented by the number of created objects or used tags. Therefore, it would be really helpful if we would have some additional information about the person who contributes to the project. For example: Does she/he help other contributors? Is her/his work somehow documented or based on one of the “discussed” proposals? Or does she/he work as a lone warrior in the OSM world?

In 2010 I created “How did you contribute to OpenStreetMap?” (HDYC) as a kind of fun side project. Nowadays many people use it to get some detailed information about OSM contributors. Some of you are probably familiar with the “verified” icon used on some celebrity Twitter accounts. I created a similar new feature for the aforementioned HDYC page. If you connect your related OSM accounts, your profile will be marked as “verified”.

verified

What do you have to do to get a verified contributor profile, you ask? First of all, you have to create at least 100 OSM changesets. Secondly, you need a login (username) for the OSM Help Forum, for the common OSM Forum and for the OSM Wiki. Last but not least, you have to list your OSM related accounts on your OSM profile page. After that, you should be able to see your accounts in your HDYC profile and your account will be automatically marked as verified.

Malenki already mentioned his usernames as an example in his profile. He also described it in a tiny OSM diary. Overall this feature is optional. So if you don’t want to “connect” or show your accounts for privacy protection, please don’t mention them on your OSM profile. My script checks the OSM profiles of the latest active OSM contributors every 24h. That’s it.

The HDYC profile now also shows the number of your changeset discussions and, if mentioned in your OSM profile, the page shows your Mapillary account as well.

Notice: If someone is trying to cheat with other people’s accounts, I will blacklist her/his username.

Thanks to maɪˈæmɪ Dennis.

Add a Note in OSM … Stats & Personal Profiles

Since April 23th, 2013 each visitor, user or contributor of the OpenStreetMap (OSM) project can “add a note” to the map in order to easily mark an error or missing object in the map data. You can find more information about this new feature in the OSM wiki. It is a great new way for people to contribute to the project by improving the data in a simple way. To provide a better overview I created a new webpage which shows some statistics about the new feature. You can find it here: resultmaps.neis-one.org/osm-notes

Besides some general information the webpage also shows the overall, opened and closed number of notes per country. The second table illustrates the OSM contributors who already opened, commented or closed a note. All tables on the page are sortable by clicking on the column headers.

Additionally I integrated the individual contributor note stats to the OSM personal profiles @ “How did you contribute to OpenStreetMap?“. The following image shows the new add-on, of course with Harry, our guinea pig No. 1, and as always, great work here too! 🙂

¡Muchas gracias maɪˈæmɪ Dennis

Introducing OpenStreetMap Contributor Activity Areas

One month ago I wrote a blog post about a new website which allows you to see other OpenStreetMap contributors in your area. Overall the feedback was very positive, thank you very much for that! However, now it is time for a new extension to the “How did you contribute to OpenStreetMap?” (HDYC) webpage. As I mentioned in my last blog post, I used an algorithm (which is described in a paper that I wrote here) to compute and determine the activity area of a contributor based on her/his changeset centers. The following figure shows the new function that was added to the HDYC website visualizing the activity area of a contributor! Sorry Harry, as always you have to be our guinea pig, but you have a really awesome activity area 🙂

Next to the visualization of the overall activity area of a contributor, you can also click on a link at the bottom of the map to switch to the contributors’ activity area of the past six months. Furthermore, all maps on HDYC now use the great Leaflet map library instead of Openlayers. Also, your activity areas’ first and last Nodes have a direct link to the “Overview of OpenStreetMap Contributors aka Who’s around me?” webpage. This provides an easy way to locate other contributors in your area. I have to mention that not every contributor has an activity area for the past six months. It highly depends on the activity of the contributor within this time frame!

One more thing: The aforementioned “Who’s around me?” webpage has three new overlays. Two overlays show the contributors of the past six months with their first and last Nodes and one additional layer shows the activity areas also based on the past six months for each contributor. You can find all new layers in the upper right corner in the so-called “Layerswitcher”.

My HDYC database is updated more or less on a daily basis. The information about your changeset activities is updated once a week (based on the weekly changeset dumps from here). “The Created Nodes per Country”-section can only be updated when a new full history dump is available, but you can always find the latest date in the section-label. The “Who’s around me?” webpage uses almost the same database as HDYC, so the data up-to-dateness is similar.

Have fun with the new gadgets!

¡Muchas gracias maɪˈæmɪ Dennis

OSM-Gravatar, Changeset changes & Way-Tags @ HDYC

After my latest updates to the “How did you contribute to OpenStreetMap?” website, some users asked me if I could add the new OSM gravatar to it. Starting today, you can find your OSM-gravatar from your OSM user website on HDYC too. If your HDYC-profile doesn’t show a gravatar yet, please be patient. It will be automatically updated as soon as you make any type of OSM edit to the OSM database. The following figure contains all updates that were made to the website marked with a circle. As always, Harry is our example 😉

As a second update, I added the number of changes that were made in a user’s changeset and grouped them into three classes. This way the website shows if a user only makes a lot of changesets with 15 or less edits, more than 150 edits or something in between. Last but not least, you can find some additional information about the number of ways of which the user is the last modifier, including its way tag. This provides some information about the data collection tendency of the contributor, for instance if the user only creates a lot of buildings or large landuse areas.

Check all updates here: How did you contribute to OpenStreetMap?

Ps: You can also find the total number of countries in your profile in which you contributed at least one node.

Muchas Gracias @ maɪˈæmɪ aka Oleta River State Park Dennis 🙂

Overhauling “How did you contribute to OpenStreetMap?”

My last update about the HDYC website is a few months old now. For those readers who do not know what HDYC is: “How did you contribute to OpenStreetMap?” is a webpage which shows you in detail how long, when, where a member of the OSM project contributed to the project and which tools she/he used.

This time I added some new stats and graphs to the site. One of my favorite new features is the location information which shows the countries in which a contributor created at least one OSM Node:

A second new feature shows how long the mapper is already registered with the project and how many *active* mapping days she/he had:

You can also find some more information about the changesets of the user e.g. the number of changesets with a comment, the number of unique changeset comments and the median character length of the comments. Additionally, you will also see some information about deleted nodes, ways or relations:

Some of you might know about Richard Weait’s “Mapper Baseball Cards” idea. I added a similar graph to the end of the page to show which editors have been used by the mapper (thx Richard for the idea).

You will also see some facts about how many traces a user has uploaded to the OSM project and how many user blocks he received or if a user block is still active. Most of the stats are updated on a daily basis while the changeset stats will be updated once per week (which depend on the changeset dump).

Maybe we should create a “Hall of Fame” of OSM Contributors?

  1. Contributor with most visited countries? -> mikelmaron ?
  2.  Most active contributor? -> Zambelli Limitada ?
  3.  … any other ideas?

However, I hope you like it!? Have fun …
>> http://hdyc.neis-one.org <<

thx @ maɪˈæmɪ Dennis for proofreading

Where are the new OpenStreetMap Contributors?

Since past Friday the OpenStreetMap project has more than 600 000 registered members. As many of you may know, not every new registered member starts contributing to the project right away. Based on my “How did you contribute to OSM?” database I created a small (but neat) webpage which shows where the newest registered OpenStreetMap (OSM) members made one of their first edits. The following image shows a screenshot of the new webpage:

The visualized data will be updated on a daily basis. At the moment there are two layers available: one layer displays the latest members of the past two days, while the other layer does the same for the past seven days. At lower zoom-levels the icons are clustered and only show the number of new members. However, on higher zoom-levels you can click on the individual icons to get further information about the new project member. Thanks to Stamen for their really nice looking watercolor map. Would you like to see more statistics about the number of new contributors for each individual country?

The new webpage is online here: http://resultmaps.neis-one.org/newestosm.php

thx @ maɪˈæmɪ Dennis

What type of Mapper are You?

Last weekend Frederik and Richard asked me if I could give some additional information on the „How did you contribute to OpenStreetMap?“ webpage. So here we go. Below the prior, familiar chart which shows the contributions per month, you will find two new charts. The first one shows the number of changesets per weekday and the second one the number of changesets per hour.

Additionally I added an output that roughly estimates what type of mapper the contributor is, based on his/her number of contributions (changesets). However, I will give no warranty regarding the group or type of mapper that each individual contributor falls into and I think you will figure out the different groups of mappers by yourself anyway 😉

The following picture highlights the new things on my webpage:

Most of you already know it, you will find “How Did You Contribute to OpenStreetMap?” here: http://hdyc.neis-one.org

thx @ Frederik & Richard for the idea
thx @ maɪˈæmɪ Dennis

*Update* (2020-06-11) What are the different requirements for your #HDYC type of #mapper? See

“Your OSM Heat Map” (aka Where did you contribute?)

Last week Stephan released the neat “Where Did You Edit?” webpage. A world map indicates where in the world you have been editing OpenStreetMap (OSM) nodes. Unfortunately it is based on a full history OSM planet dump which is nearly two months old. Also, the map does not include any tools to zoom into or drag the map. However, Stephan mentioned that he is working on these functions. Keep up the good work, Stephan!

Based on my OSM changeset table of “How did you contribute to OpenStreetMap ?” I created a slightly different webpage and used a different approach. I used the weekly OSM changeset files and I presented the results in an OpenStreetMap including zoom and drag functions. Your contributions are indicated by a “Heat-Map-Overlay”. For this overlay I am using Bjoern’s OpenLayers addon. For better performance I generalized the total changesets of each OSM contributor. This means that it is possible that not every little contribution from a member is taken into account and displayed in the map. Anyway, I think the results are quite impressive, aren’t they?

The following picture shows the heat map of Harry’s OSM contributions. Really nice! But honestly: Harry, did you visit all places in person? 🙂

I think you will find other incredible OSM Contributors Heat Map stories?! You can find “Your OSM Heat Map(aka Where did you contribute to OpenStreetMap?) here: http://yosmhm.neis-one.org . I can update this website every week if you like …

thx @ maɪˈæmɪ Dennis