PHM11 Data Challenge – Scoring

This page describes how the score is calculated for challenge entries.

There are two types of data for the challenge problem: paired anemometer data at the same height, and arrays of anemometers are different heights. The goal of the problem is to determine if 1 or more of the anemometers have excessive error due to damage or wear.

Typically, the anemometers have a performance class. A class 1 anemometer is about 1.0% error. This data is from a class 2 anemometer, or error less than 2%. This type of anemometer is considered failed when the error is greater than 2%. This could be due to wear on the bearings, a failed shaft, or a missing cup.

Note that there are there are cases where the anemometers are not measuring correctly, for example, due to icing. When icing occurs, the anemometer is frozen or runs slow. This is not considered an error. Note also that these anemometers don’t measure below .4m/s wind speed.

Your task for the “pair” data is to determine which – if any – of the anemometers has failed. Correctly indicating which anemometers have failed gets you one point (total, i.e., if both have failed, you have to identify both to get any credit). Incorrectly identifying a good/failed anemometer gets you zero points. Correctly identifying a pair of good anemometers gets you one point.

Your task for the “shear” data is to determine if any of the anemometers in the group are bad. Correctly indicating the presence of a good/failed anemometer gets you one point. Incorrectly identifying a good/failed anemometer gets you zero points.

Submitting Results
Results must be submitted as a text file, with exactly 677 rows. Row one should be your username; row two should be your password.

Rows 3-422 should be your indication of which of the paired anemometers have failed, where,

  • 0 indicates “no failed anemometers”
  • 1 indicates “first anemometer ONLY has failed”
  • 2 indicates “second anemometer ONLY has failed”
  • 3 indicates “both anemometers have failed”

Rows 423-677 should be your indication of which of the sets of “shear” anemometers contain at least one failed anemometer, where,

  • 0 indicates “no failed anemometers”
  • 1 indicates “at least one has failed”

An example of a properly formatted scoring file can be found here.