UNISTAT - the ultimate Excel statistics add-in

6.4.5. Paired Proportions

A 2 x 2 table is formed to perform procedures in this section. The data can be in the form of two dichotomous factors or two continuous variables split into two groups by two cutpoints. It is also possible to enter directly the four cell frequencies as explained at the beginning of this chapter (see 6.0.7. 2 x 2 Tables). The user should take care to distinguish this table from a table formed on the same pair of columns by the Unpaired Proportions procedure. Here, the total table frequency is the number valid pairs (as in 2 x 2 cross-tabulation), whereas in Unpaired Proportions the total frequency is the sum of valid cases in sample 1 and sample 2.

The two columns usually contain measurements on the same sample before and after a certain treatment.

Nonparametric Tests-Paired Proportions

When the four frequency values for a 2 x 2 table are already available in the spreadsheet, you do not have to type them again into the Cell Frequencies are Given dialogue. All statistics available under Binomial Proportion, Unpaired Proportions and Paired Proportions procedures are also available in Contingency Table and Cross-Tabulation procedures (see 6.6.2.3. 2 x 2 Table Statistics).

6.4.5.1. Difference Between Paired Proportions

As in the previous section, the null hypothesis “the two proportions are equal” is tested (see 6.4.4.1. Difference Between Unpaired Proportions). That is:

     Nonparametric Tests-Paired Proportions

where:

     Nonparametric Tests-Paired Proportions, Nonparametric Tests-Paired Proportions

See Gardner M. J., Altman, D. G. (1989) p. 31. The test statistic based on normal approximation is defined as:

     Nonparametric Tests-Paired Proportions

with a standard error of:

     Nonparametric Tests-Paired Proportions

The asymptotic confidence limits are computed as:

     Nonparametric Tests-Paired Proportions

The exact probability is determined using the binomial distribution and the exact confidence limits are based on the definitions introduced for the Binomial Test:

      Nonparametric Tests-Paired Proportions

      Nonparametric Tests-Paired Proportions

Example 1

Example 4.10 on p. 127 from Armitage, P. & G. Berry (1994). Distribution of sputum according to results of culture on two media are given in the form of a 2 x 2 table.

Select Statistics 1Nonparametric Tests (1-2 Samples) → Paired Proportions and select the data option 3 Cell Frequencies are Given. Enter 20 in (1,1), 12 in (1,2), 2 in (2,1), 16 in (2,2) and check only the Difference Between Paired Proportions output option to obtain the following results:

Paired Proportions

Data option: Cell Frequencies are Given

 

 

 1

 2

Total

 1

 20

 2

 22

 2

 12

 16

 28

Total

 32

 18

 50

 

Difference Between Paired Proportions

 

Proportion 1 =

 0.0400

Proportion 2 =

 0.2400

 

 

Difference

2-Tail Probability

Lower 95%

Upper 95%

Normal Approximation

-0.2000

 0.0075

-0.3358

-0.0642

Exact Binomial

 

 0.0129

 0.0402

 0.2700

 

Example 2

Example on p. 32, Gardner M. J., Altman, D. G. (1989). Inadequacy of monitoring in hospital of deaths and survivors among asthma patients is given in the form of a 2 x 2 table.

Select Statistics 1Nonparametric Tests (1-2 Samples) → Paired Proportions and select the data option 3 Cell Frequencies are Given. Enter 10 in (1,1), 3 in (1,2), 13 in (2,1), 9 in (2,2) and check only the Difference Between Paired Proportions output option to obtain the following results:

Paired Proportions

Data option: Cell Frequencies are Given

 

 

 1

 2

Total

 1

 10

 13

 23

 2

 3

 9

 12

Total

 13

 22

 35

 

Difference Between Paired Proportions

 

Proportion 1 =

 0.3714

Proportion 2 =

 0.0857

 

 

Difference

Standard Error

Z-Statistic

1-Tail Probability

2-Tail Probability

Normal Approximation

 0.2857

 0.1036

 2.5000

 0.0062

 0.0124

Exact Binomial

 

 

 

 0.0106

 0.0213

 

 

Lower 95%

Upper 95%

Normal Approximation

 0.0827

 0.4887

Exact Binomial

 0.0398

 0.4201

 

6.4.5.2. Fisher’s Exact Test

Under the assumption of independence of column and row factors, the probability of the observed 2 x 2 table (the table probability) follows the hypergeometric distribution:

      Nonparametric Tests-Paired Proportions

where nij are the cell frequencies and:

      Nonparametric Tests-Paired Proportions

      Nonparametric Tests-Paired Proportions

      Nonparametric Tests-Paired Proportions

The following four probabilities are reported.

Right-Tail Probability: Sum of all possible table probabilities with the same observed row and column totals where n11 is greater than or equal to the observed n11. Use this to test positive association between the two factors.

Left-Tail Probability: Sum of all possible table probabilities with the same observed row and column totals where n11 is less than or equal to the observed n11. Use this to test negative association between the two factors.

2-Tail Probability: Sum of all table probabilities with the same observed row and column totals. Use this to test association between the two factors.

Table Probability: The probability of the observed table PT as defined above.

You can perform Fisher’s Exact Test for R x C Tables (i.e. tables larger than 2 x 2), using the Cross-Tabulation procedure (see 6.6.2.2.2. Fisher’s Exact Test).

Example

Example 24.22 on p. 568 from Zar, J. H. (2010). Data is given in the form of 2 x 2 contingency tables.

Paired Proportions

Data option: Cell Frequencies are Given

 

 

 1

 2

Total

 1

 12

 7

 19

 2

 2

 9

 11

Total

 14

 16

 30

 

Fisher's Exact Test

 

Left-Tail Probability

Right-Tail Probability

Two-Tail Probability

Table Probability

Fisher's Exact

 0.99787

 0.02119

 0.02589

 0.01906

 

Zar reports the right-tail and two-tailed probabilities.

6.4.5.3. McNemar Test

McNemar is a chi-square statistic used to test whether the first row and first column totals are equal.

Asymptotic without Continuity Correction: The chi-square statistic is:

      Nonparametric Tests-Paired Proportions

      Nonparametric Tests-Paired Proportions

Asymptotic with Continuity Correction:

      Nonparametric Tests-Paired Proportions

      Nonparametric Tests-Paired Proportions

Exact Binomial: The exact probability is calculated from the binomial function:

      Nonparametric Tests-Paired Proportions

      and the exact confidence limits are given by Liddell (1983) as:

      Nonparametric Tests-Paired Proportions

      Nonparametric Tests-Paired Proportions

Example

Example 24.17 on p. 571 from Zar, J. H. (2010). Data is recorded in the form of a 2 x 2 contingency table. The null hypothesis “the proportion of persons experiencing relief is the same with both locations” is tested.

 

 

 

Lotion 1

 

 

 

Relief

No relief

Lotion 2

Relief

12

5

 

No relief

11

22

Select Statistics 1Nonparametric Tests (1-2 Samples) → Paired Proportions and select the data option 3 Cell Frequencies are Given. Enter 12 in (1,1), 11 in (1,2), 5 in (2,1), 22 in (2,2). Next, select only the McNemar Test option.

Paired Proportions

Data option: Cell Frequencies are Given

 

 

 1

 2

Total

 1

 12

 5

 17

 2

 11

 22

 33

Total

 23

 27

 50

 

McNemar's Test

 

Chi-Square Statistic

Degrees of Freedom

Right-Tail Probability

Asymptotic

 2.2500

 1

 0.1336

Asymptotic with CC

 1.5625

 1

 0.2113

 

 

2-Tail Probability

Lower 95%

Upper 95%

Exact Binomial

 1.0000

 0.7047

 8.0769

 

Since p > 0.05 do not reject the null hypothesis.

6.4.5.4. Odds Ratio (Paired)

The odds ratio for paired cases is computed as:

      Nonparametric Tests-Paired Proportions

The exact confidence limits are based on the definitions introduced for the Binomial Test:

      Nonparametric Tests-Paired Proportions

      Nonparametric Tests-Paired Proportions

For the odds ratio for unpaired cases see 6.4.4.3. Odds Ratio and Relative Risks.

Example

Example on p. 58, Gardner M. J., Altman, D. G. (1989). Inadequacy of monitoring in hospital of deaths and survivors among asthma patients is given in the form of a 2 x 2 table.

Select Statistics 1Nonparametric Tests (1-2 Samples) → Paired Proportions and select the data option 3 Cell Frequencies are Given. Enter 10 in (1,1), 3 in (1,2), 13 in (2,1), 9 in (2,2) and check only the Odds Ratio (Paired) output option:

Paired Proportions

Data option: Cell Frequencies are Given

 

 

1

 2

Total

 1

 10

 13

 23

 2

 3

 9

 12

Total

 13

 22

 35

 

Odds Ratio (Paired)

 

Value

Lower 95%

Upper 95%

Odds Ratio (Paired)

 4.3333

 1.1908

 23.7074

 

6.4.5.5. Tetrachoric Correlation

The Tetrachoric Correlation coefficient is computed as follows:

      Nonparametric Tests-Paired Proportions

where:

      Nonparametric Tests-Paired Proportions

is the tetrachoric ratio.

Example

Table 58 on p. 167 from Cohen, L. & M. Holliday (1983). The raw data is not available on individual success ratings, but a 2 x 2 contingency table is given on satisfactory / unsatisfactory ratings on a basic computing course.

 

Frequency (1,1)

40

Frequency (1,2)

10

Frequency (2,1)

20

Frequency (2,2)

30

 

Select Statistics 1Nonparametric Tests (1-2 Samples) → Paired Proportions → Tetrachoric Correlation, select the data option Cell Frequencies are Given and enter the values as given in the above table to obtain the following results:

Paired Proportions

Data option: Cell Frequencies are Given

 

 

 1

 2

Total

 1

 40

 10

 50

 2

 20

 30

 50

Total

 60

 40

 100

 

Tetrachoric Correlation

 

Ratio

Tetrachoric Correlation

 

 6.0000

 0.6132