Skip to content

ELIXIR evaluation evaluation

Draft

This is just a draft of a collection of scribbles

The goal of this exercise is to evaluate the ELIXIR evaluation.

“Not everything that counts can be counted, and not everything that can be counted, counts”. (Attributed to William Bruce Cameron)

Source: the ELIXIR paper [Melo et al., 2022]

  • Phase 1: collect ideal evaluation questions
  • Phase 2: Add the NBIS questions to the results. Then per question: comment
  • Phase 3: Collect the comments per question. Then per question: grade (-5 to +5)