Method evaluation poll 2005: Difference between revisions

From electowiki
Content added Content deleted
(Added introduction to article, and highlighted that this poll is no longer active)
 
(26 intermediate revisions by 8 users not shown)
Line 1: Line 1:
This was a "method evaluation poll" that was conducted in starting in 2005. The participants were largely contributors to the [[election-methods mailing list]], and responses largely faded out by 2006. This page remained unedited for many years after 2006.
Please rate the following single-winner methods on a scale from 0 to 10, on '''functional merit alone'''. That is, leaving the issue of public salability aside, how well will the method perform in a large, contentious electorate? Decimal ratings are allowed.

== The 2005 poll ==
Respondents were given the following instructions<blockquote>Please rate the following single-winner methods on a scale from 0 to 10, on '''functional merit alone'''. That is, leaving the issue of public salability aside, how well will the method perform in a large, contentious electorate? Decimal ratings are allowed.


The answers you give on your first pass through the survey need not be final. Please feel free to change/update your answers as many times as you like. You may leave a question mark next to your score for a given method if you are particularly uncertain about that score, and you may also substitute a question mark for the number if you feel unable to evalute the method.
The answers you give on your first pass through the survey need not be final. Please feel free to change/update your answers as many times as you like. You may leave a question mark next to your score for a given method if you are particularly uncertain about that score, and you may also substitute a question mark for the number if you feel unable to evalute the method.


Feel free to add more methods to the poll, especially interesting ones! This goes without saying, but please don't change other people's ratings! Try to keep the columns tidy so that it's clear whose scores are whose. The format of this poll is based on that of the [[Essential Questions|essential questions]] poll. Please identify yourself by your initials in the body of the poll, and in the participants section at the top of the poll. This poll will be ongoing; that is, it has no closing date. Also, there is no official tally method, and no official winner will be declared.
Feel free to add more methods to the poll, especially interesting ones! This goes without saying, but please don't change other people's ratings! Try to keep the columns tidy so that it's clear whose scores are whose. The format of this poll is based on that of the [[Essential Questions|essential questions]] poll. Please identify yourself by your initials in the body of the poll, and in the participants section at the top of the poll. This poll will be ongoing; that is, it has no closing date. Also, there is no official tally method, and no official winner will be declared.</blockquote>The results were collected in late 2005.


== the participants ==
== the participants ==
Line 20: Line 23:
JG CB KV DK MO RL JF
JG CB KV DK MO RL JF
[[Plurality]]
[[Plurality]]
2 2 2 2 0 0 0
2 0 2 2 0 0 0
[[Runoff voting|Two round runoff]]
[[Runoff voting|Two round runoff]]
3 5 3 3 0 2 2
3 3 3 3 0 2 2
[[Approval voting|Approval]]
[[Approval voting|Approval]]
6 6 8 5 9 5 9
6 4 8 5 9 5 9
[[Random Ballot|Random Ballot]]
[[Random Ballot|Random Ballot]]
0 1 1 1 0 0 2
0 0 1 1 0 0 2


=== ranking input ===
=== ranking input ===
Line 34: Line 37:
JG CB KV DK MO RL JF
JG CB KV DK MO RL JF
[[Borda count]]
[[Borda count]]
1 3 0 0 0 0 4
1 0 0 0 0 0 4
[[IRV]] without equal rankings
[[IRV]] without equal rankings
4 7 3 3 0 4 2
4 7 3 3 0 4 2
Line 42: Line 45:
6 6 3 ? 0 ? 2
6 6 3 ? 0 ? 2
[[Bucklin voting|Bucklin]] without equal rankings
[[Bucklin voting|Bucklin]] without equal rankings
3? 6.5 6 0 ? 6
3? 5 6 0 ? 6
[[ER-Bucklin|ER-Bucklin(whole)]]
[[ER-Bucklin|ER-Bucklin(whole)]]
5.5? 7 2 ? 4
5.5? 6.5 7 2 ? 4
[[ER-Bucklin|ER-Bucklin(fractional)]]
[[ER-Bucklin|ER-Bucklin(fractional)]]
? 5 ? 5
? 5? 5 ? 5
[[Descending Acquiescing Coalitions]] (DSC)
[[Descending Acquiescing Coalitions]] (DAC)
4
3? 4
[[Descending Solid Coalitions]]
[[Descending Solid Coalitions]]
2
2? 2


==== nearly Condorcet-efficient ====
==== nearly Condorcet-efficient ====
Line 56: Line 59:
JG CB KV DK MO RL JF
JG CB KV DK MO RL JF
[[MMPO|minmax(pairwise opposition)]]
[[MMPO|minmax(pairwise opposition)]]
5 4 4 ? 0 ? 4
5 3? 4 ? 0 ? 4
[[CDTT|CDTT,IRV]]
[[CDTT|CDTT,IRV]]
7 9 5 ? ? ? 4
7 5? 5 ? ? ? 4
[[CDTT|CDTT,minmax(pairwise opposition)]]
[[CDTT|CDTT,minmax(pairwise opposition)]]
? 5 6 ? ? ? 5
? 3? 6 ? ? ? 5
[[Improved Condorcet Approval]] ([[ICA]]), a.k.a. [[Condorcet//Approval]] with [[FBC]] tweak)
[[Improved Condorcet Approval]] ([[ICA]]), a.k.a. [[Condorcet//Approval]] with [[FBC]] tweak)
6? 9 ? ? ? 5
6? 6? 9 ? ? ? 5
[[Majority Defeat Disqualification Approval]] ([[MDDA]])
[[Majority Defeat Disqualification Approval]] ([[MDDA]])
6? 7.5? 9 10 ? 6
6? 5? 8 10 ? 6
[[MDD,ER-Bucklin(whole)]]
8?


==== Condorcet-efficient ====
==== Condorcet-efficient ====
Line 74: Line 79:
2 4 3 3 0 6 ?
2 4 3 3 0 6 ?
[[river]](wv)
[[river]](wv)
7 8 7 8 ? 9
7 7 8 7 8 ? 9
[[beatpath]](WV)
[[Schulze method|Schulze]](WV)
7 7 8 7 8 9 8
7 7 8 7 8 9 8
[[beatpath]](margins)
[[Schulze method|Schulze]](margins)
2 4 3 3 0 5 ?
2 4 3 3 0 5 ?
[[sequential dropping]](WV)
[[sequential dropping]](WV)
Line 92: Line 97:
5.5? ? 3 ? 0 ? 5
5.5? ? 3 ? 0 ? 5
[[Raynaud]]
[[Raynaud]]
6? ? 3 3 0 ? 6
6? 3? 3 3 0 ? 6
[[Smith,IRV]] or [[Schwartz,IRV]]
8


=== ranking input with approval cutoff ===
=== ranking input with approval cutoff ===
Line 98: Line 105:
JG CB KV DK MO RL JF
JG CB KV DK MO RL JF
[[Definite Majority Choice|definite majority choice]] a.k.a. [[Ranked Approval Voting|ranked approval voting]]
[[Definite Majority Choice|definite majority choice]] a.k.a. [[Ranked Approval Voting|ranked approval voting]]
6.5 8.5 6 3 1 ? 5
6.5 9.5 6 3 1 ? 5
[[CWP|approval weighted pairwise]] (e.g. with ranked pairs base)
[[CWP|approval weighted pairwise]] (e.g. with ranked pairs base)
9 8 7 3 1 ? 4
9 8? 7 3 1 ? 4
[[approval margins]]
[[approval margins]]
5.5 9 ? 3 1 ? ?
5.5 8.5 ? 3 1 ? ?
[[Imagine Democratic Fair Choice|democratic fair choice (DFC)]]
[[Imagine Democratic Fair Choice|democratic fair choice (DFC)]]
? 3 3 1 ? 4
? 5? 3 3 1 ? 4
Schwartz//Approval or Smith//Approval (See [[Condorcet//Approval]])
Schwartz//Approval or Smith//Approval (See [[Condorcet//Approval]])
4 1 10
5? 4 1 10
[[Condorcet//Approval]]
[[Condorcet//Approval]]
4 1 10
4? 4 1 10
[[Definite Majority,IRV]]
8


=== rating input ===
=== rating input ===


JG KV DK MO RL
JG CB KV DK MO RL
[[range voting]] (ratings summation)
[[range voting]] (ratings summation)
5.5 5 2 9.1
5.5 5 2 9.1
[[Median Ratings|median ratings]]
[[Median Ratings|median ratings]]
3 4 2 2
3 4 2 2
ranked pairs([[cardinal pairwise]])
ranked pairs([[cardinal pairwise]])
9.5 5 2 5
9.5 8? 5 2 5
beatpath([[cardinal pairwise]])
[[Schulze method|Schulze]]([[cardinal pairwise]])
9.5 5 2 5
9.5 8? 5 2 5
[[Automated DMC]]
10


=== other ===
=== other ===


JG DK MO
JG CB DK MO
[[candidate withdrawal option|CWO]]-ER-IRV(whole)
[[candidate withdrawal option|CWO]]-ER-IRV(whole)
7 1 4
7 2? 1 4
[[candidate withdrawal option|CWO]]-ER-IRV(fractional)
[[candidate withdrawal option|CWO]]-ER-IRV(fractional)
8 1 3
8 3? 1 3
[[candidate withdrawal option|CWO]]-ranked pairs(WV)
[[candidate withdrawal option|CWO]]-ranked pairs(WV)
8 1 5
8 1 5
[[candidate withdrawal option|CWO]]-ranked ballot plurality
[[candidate withdrawal option|CWO]]-ranked ballot plurality
6 1 1
6 1? 1 1
[[MMPO|minmax(pairwise opposition)]] with [[AERLO]] and [[ATLO]]
[[MMPO|minmax(pairwise opposition)]] with [[AERLO]] and [[ATLO]]
4 ? 0
4 3? ? 0
[[MMPO]] with AERLO, ATLO, & [[Power Truncation]]
[[MMPO]] with AERLO, ATLO, & [[Power Truncation]]
? 0
? 0?? 0
[[MMPO]] with (only) [[Power Truncation]]
[[MMPO]] with (only) [[Power Truncation]]
? 10
? 0?? 10
[[beatpath]](WV) with AERLO and ATLO
[[Schulze method|Schulze]](WV) with AERLO and ATLO
8 ? 8.5
8 3? ? 8.5
[[beatpath]](WV) with [[strong/weak preference option]]
[[Schulze method|Schulze]](WV) with [[strong/weak preference option]]
7.5 ? ?
7.5 5? ? ?
[[random jury]] method
[[random jury]] method
? 1 1
? 0 1 1


== See also ==
== See also ==
Line 150: Line 161:
*[[Essential Questions]] poll
*[[Essential Questions]] poll
*[[Method support poll]]
*[[Method support poll]]
*[[Method evaluation poll 2008]]

[[Category:Advocacy]]

Latest revision as of 06:02, 22 April 2020

This was a "method evaluation poll" that was conducted in starting in 2005. The participants were largely contributors to the election-methods mailing list, and responses largely faded out by 2006. This page remained unedited for many years after 2006.

The 2005 poll

Respondents were given the following instructions

Please rate the following single-winner methods on a scale from 0 to 10, on functional merit alone. That is, leaving the issue of public salability aside, how well will the method perform in a large, contentious electorate? Decimal ratings are allowed.

The answers you give on your first pass through the survey need not be final. Please feel free to change/update your answers as many times as you like. You may leave a question mark next to your score for a given method if you are particularly uncertain about that score, and you may also substitute a question mark for the number if you feel unable to evalute the method.

Feel free to add more methods to the poll, especially interesting ones! This goes without saying, but please don't change other people's ratings! Try to keep the columns tidy so that it's clear whose scores are whose. The format of this poll is based on that of the essential questions poll. Please identify yourself by your initials in the body of the poll, and in the participants section at the top of the poll. This poll will be ongoing; that is, it has no closing date. Also, there is no official tally method, and no official winner will be declared.

The results were collected in late 2005.

the participants

JG James Green-Armytage
CB Chris Benham
KV Kevin Venzke
DK Dave Ketchum
MO Mike Ossipoff 
RL Rob Lanphier
JF Jeff Fisher

the methods

binary input

   JG   CB   KV   DK   MO   RL   JF
Plurality
    2    0    2    2    0    0    0
Two round runoff
    3    3    3    3    0    2    2
Approval
    6    4    8    5    9    5    9
Random Ballot
    0    0    1    1    0    0    2

ranking input

not Condorcet-efficient

   JG   CB   KV   DK   MO   RL   JF
Borda count     
   1     0    0    0    0    0    4
IRV without equal rankings
   4     7    3    3    0    4    2
ER-IRV(whole)
   6     4    ?    ?    0    ?    2
ER-IRV(fractional)
   6     6    3    ?    0    ?    2
Bucklin without equal rankings
  3?     5    6    0         ?     6
ER-Bucklin(whole)
5.5?    6.5   7         2    ?    4
ER-Bucklin(fractional)
   ?    5?    5              ?    5
Descending Acquiescing Coalitions (DAC)
        3?    4                     
Descending Solid Coalitions
        2?    2

nearly Condorcet-efficient

   JG   CB   KV   DK   MO   RL   JF
minmax(pairwise opposition)
    5    3?   4    ?    0   ?    4
CDTT,IRV
    7    5?   5    ?    ?   ?    4
CDTT,minmax(pairwise opposition)
    ?    3?   6    ?    ?   ?    5
Improved Condorcet Approval (ICA), a.k.a. Condorcet//Approval with FBC tweak)
   6?    6?   9    ?    ?   ?    5
Majority Defeat Disqualification Approval (MDDA)
   6?    5?   8        10   ?    6
MDD,ER-Bucklin(whole)
         8?

Condorcet-efficient

   JG   CB   KV   DK   MO   RL   JF
ranked pairs(WV)
    7    7    8    8    8    9    8
ranked pairs(margins)
    2    4    3    3    0    6    ?
river(wv)
    7    7     8    7    8    ?    9
Schulze(WV)
    7    7    8    7    8    9    8
Schulze(margins)  
    2    4    3    3    0    5    ?
sequential dropping(WV)
    7    ?    7    ?    5    ?    8
minmax(WV)                  
    4   ?     7    7    4    5    7
minmax(margins)     
    1    ?    3    3    0    5    ?
Smith//minmax(WV)    
    6    ?    7    ?  4.5    9    8
Smith//minmax(margins)
    2    ?    3    ?    0    5    ?
Nanson
  5.5?   ?    3    ?    0    ?    5
Raynaud
   6?    3?    3    3    0    ?    6
Smith,IRV or Schwartz,IRV
         8

ranking input with approval cutoff

   JG   CB   KV   DK    MO   RL   JF
definite majority choice a.k.a. ranked approval voting
  6.5  9.5    6    3     1     ?    5
approval weighted pairwise (e.g. with ranked pairs base)
    9    8?    7    3     1    ?    4
approval margins
  5.5   8.5    ?    3     1    ?    ?
democratic fair choice (DFC)
   ?    5?     3    3      1     ?    4
Schwartz//Approval or Smith//Approval (See Condorcet//Approval)
        5?      4           1        10
Condorcet//Approval     
        4?      4            1        10
Definite Majority,IRV
        8

rating input

   JG  CB   KV   DK   MO    RL
range voting (ratings summation)
  5.5       5    2   9.1
median ratings
    3       4    2    2
ranked pairs(cardinal pairwise)
  9.5  8?   5    2    5
Schulze(cardinal pairwise)
  9.5  8?   5    2    5
Automated DMC
      10

other

   JG  CB   DK   MO
CWO-ER-IRV(whole)
    7  2?    1    4
CWO-ER-IRV(fractional)
    8  3?    1    3
CWO-ranked pairs(WV)
    8        1    5
CWO-ranked ballot plurality
    6  1?    1     1
minmax(pairwise opposition) with AERLO and ATLO
    4  3?     ?     0
MMPO with AERLO, ATLO, & Power Truncation
    ?  0??          0
MMPO with (only) Power Truncation 
    ?  0??          10
Schulze(WV) with AERLO and ATLO
    8  3?      ?    8.5
Schulze(WV) with strong/weak preference option
  7.5  5?      ?       ?
random jury method
    ?  0      1   1

See also