Method evaluation poll 2005

From electowiki
(Redirected from Method evaluation poll)

This was a "method evaluation poll" that was conducted in starting in 2005. The participants were largely contributors to the election-methods mailing list, and responses largely faded out by 2006. This page remained unedited for many years after 2006.

The 2005 poll

Respondents were given the following instructions

Please rate the following single-winner methods on a scale from 0 to 10, on functional merit alone. That is, leaving the issue of public salability aside, how well will the method perform in a large, contentious electorate? Decimal ratings are allowed.

The answers you give on your first pass through the survey need not be final. Please feel free to change/update your answers as many times as you like. You may leave a question mark next to your score for a given method if you are particularly uncertain about that score, and you may also substitute a question mark for the number if you feel unable to evalute the method.

Feel free to add more methods to the poll, especially interesting ones! This goes without saying, but please don't change other people's ratings! Try to keep the columns tidy so that it's clear whose scores are whose. The format of this poll is based on that of the essential questions poll. Please identify yourself by your initials in the body of the poll, and in the participants section at the top of the poll. This poll will be ongoing; that is, it has no closing date. Also, there is no official tally method, and no official winner will be declared.

The results were collected in late 2005.

the participants

JG James Green-Armytage
CB Chris Benham
KV Kevin Venzke
DK Dave Ketchum
MO Mike Ossipoff 
RL Rob Lanphier
JF Jeff Fisher

the methods

binary input

   JG   CB   KV   DK   MO   RL   JF
Plurality
    2    0    2    2    0    0    0
Two round runoff
    3    3    3    3    0    2    2
Approval
    6    4    8    5    9    5    9
Random Ballot
    0    0    1    1    0    0    2

ranking input

not Condorcet-efficient

   JG   CB   KV   DK   MO   RL   JF
Borda count     
   1     0    0    0    0    0    4
IRV without equal rankings
   4     7    3    3    0    4    2
ER-IRV(whole)
   6     4    ?    ?    0    ?    2
ER-IRV(fractional)
   6     6    3    ?    0    ?    2
Bucklin without equal rankings
  3?     5    6    0         ?     6
ER-Bucklin(whole)
5.5?    6.5   7         2    ?    4
ER-Bucklin(fractional)
   ?    5?    5              ?    5
Descending Acquiescing Coalitions (DAC)
        3?    4                     
Descending Solid Coalitions
        2?    2

nearly Condorcet-efficient

   JG   CB   KV   DK   MO   RL   JF
minmax(pairwise opposition)
    5    3?   4    ?    0   ?    4
CDTT,IRV
    7    5?   5    ?    ?   ?    4
CDTT,minmax(pairwise opposition)
    ?    3?   6    ?    ?   ?    5
Improved Condorcet Approval (ICA), a.k.a. Condorcet//Approval with FBC tweak)
   6?    6?   9    ?    ?   ?    5
Majority Defeat Disqualification Approval (MDDA)
   6?    5?   8        10   ?    6
MDD,ER-Bucklin(whole)
         8?

Condorcet-efficient

   JG   CB   KV   DK   MO   RL   JF
ranked pairs(WV)
    7    7    8    8    8    9    8
ranked pairs(margins)
    2    4    3    3    0    6    ?
river(wv)
    7    7     8    7    8    ?    9
Schulze(WV)
    7    7    8    7    8    9    8
Schulze(margins)  
    2    4    3    3    0    5    ?
sequential dropping(WV)
    7    ?    7    ?    5    ?    8
minmax(WV)                  
    4   ?     7    7    4    5    7
minmax(margins)     
    1    ?    3    3    0    5    ?
Smith//minmax(WV)    
    6    ?    7    ?  4.5    9    8
Smith//minmax(margins)
    2    ?    3    ?    0    5    ?
Nanson
  5.5?   ?    3    ?    0    ?    5
Raynaud
   6?    3?    3    3    0    ?    6
Smith,IRV or Schwartz,IRV
         8

ranking input with approval cutoff

   JG   CB   KV   DK    MO   RL   JF
definite majority choice a.k.a. ranked approval voting
  6.5  9.5    6    3     1     ?    5
approval weighted pairwise (e.g. with ranked pairs base)
    9    8?    7    3     1    ?    4
approval margins
  5.5   8.5    ?    3     1    ?    ?
democratic fair choice (DFC)
   ?    5?     3    3      1     ?    4
Schwartz//Approval or Smith//Approval (See Condorcet//Approval)
        5?      4           1        10
Condorcet//Approval     
        4?      4            1        10
Definite Majority,IRV
        8

rating input

   JG  CB   KV   DK   MO    RL
range voting (ratings summation)
  5.5       5    2   9.1
median ratings
    3       4    2    2
ranked pairs(cardinal pairwise)
  9.5  8?   5    2    5
Schulze(cardinal pairwise)
  9.5  8?   5    2    5
Automated DMC
      10

other

   JG  CB   DK   MO
CWO-ER-IRV(whole)
    7  2?    1    4
CWO-ER-IRV(fractional)
    8  3?    1    3
CWO-ranked pairs(WV)
    8        1    5
CWO-ranked ballot plurality
    6  1?    1     1
minmax(pairwise opposition) with AERLO and ATLO
    4  3?     ?     0
MMPO with AERLO, ATLO, & Power Truncation
    ?  0??          0
MMPO with (only) Power Truncation 
    ?  0??          10
Schulze(WV) with AERLO and ATLO
    8  3?      ?    8.5
Schulze(WV) with strong/weak preference option
  7.5  5?      ?       ?
random jury method
    ?  0      1   1

See also