Assessing interpretation variability among experts

  • Asked
  • Active
  • Viewed 2443 times
0

Hi,

I would like to assess the difference in interpretation among the experts who used Collect Earth to assess tree cover and distribution in two districts in Ethiopia for 2010 and 2015. I want to know how much they agree in assessing percent land use-land cover, percent tree cover, percent of roads with trees, …. To do so, we had 4-5% of the plots duplicated so that they would be assessed by two different people.

I would like to hear from anybody having done this kind of analysis. How did you assess the difference in interpretation? Through the standard variation, error matrix, ...?

Most interestingly, we had twice the same group of experts (in 2017 they collected data for 2010, in 2018 they collected data for 2015). We spent more time the second time around agreeing on image interpretation and consensus building. So, I really want to do the analysis based on these duplicates and then assess whether spending more time on image interpretation made a difference or not (i.e., decrease difference in interpretation).

Many thanks,

Florence

Be the first one to answer this question!

Markdown text. Shortcuts: Ctrl+B bold, Ctrl+I italic, Ctrl+K link, Ctrl+E code, Ctrl+Shift+V paste as plain text. Tab indents list items and code; press Escape, then Tab, to leave the text box.

Insert an image

Say what the image shows, for people who can't see it.

Keyboard shortcuts

Anywhere

?
Show this list
/
Search
g h
Go to the home page
g q
Go to the questions
g t
Go to the tags
g u
Go to the users
a
Ask a question

Lists of questions

j k
Next or previous question
Enter
Open the question

Question pages

j k
Next or previous post

Shortcuts never apply while you type in a text field. Members can turn them off in their preferences.