Evaluating Poll Methodology and Bias in Ed O’Boyle’s “The Customer Satisfaction Crisis” Report (Assessment)

Purpose of the Poll and Article Overview

Customer satisfaction rates are a key factor affecting a company’s success, high performance, and competitiveness. A 2021 article titled “The customer satisfaction crisis: Solve it with three strategies” by Ed O’Boyle highlights the need for organizations to focus better on buyers, as they are less satisfied than ever.

One strategy O’Boyle (2021) offers is to make clients feel surprised, appreciated, and special. To support this point of view, the author provides the results of a poll. Thus, customers are five times more likely to be interested and engaged when they are surprised and delighted. This step is essential for firms to stay competitive and keep clients’ loyalty, trust, and interest.

Population, Sample Characteristics, and Sample Size Adequacy

The population and sampling of this poll were the Gallup Panel’s members. Of approximately 100,000 members of this panel, who are adults aged 18 or older, 4,200 were selected (O’Boyle, 2021). This sample is representative of the population because it reflects the average perspective of the people. However, it would be more effective to use a larger sample, selecting approximately 10% of the population to achieve more accurate results.

Nature of the Results: Parameters vs. Statistics

Furthermore, although it is not specified precisely whether the results were parameters or statistics, the sentence mentioning the poll allows us to infer this. The author states that “when customers strongly agree that they are surprised and delighted by their customer experience, they are five times as likely to be fully engaged” (O’Boyle, 2021, para. 12). It is possible that the results here are parameters and refer to the whole population.

Sampling Technique, Participant Recruitment, and Methodological Appropriateness

Next, it is essential to discuss the type of sampling technique used in the poll. According to O’Boyle (2021), probability-based random sampling methods were used to recruit participants for self-administered web surveys. This is the strategy that this platform generally uses for its polls.

One can say it is an appropriate method for selecting participants in Gallup surveys because the members of its panel can take part in each poll, which allows them to be chosen randomly. While the author does not explicitly mention it, the subjects are most commonly contacted via email or phone. These are the most accessible and practical methods of reaching the sample.

Confidence Interval and Margin of Error Interpretation

As for the confidence interval and margin of error, O’Boyle (2021) indicates that “the margin of sampling error is ±1.5 percentage points at the 95% confidence level” (para. 29). Overall, this is a fairly small margin of error that demonstrates the accuracy of the results. The confidence level indicates that the probability of obtaining the same findings if the poll were conducted again is 95% high.

Potential Sources of Bias and Strategies for Bias Reduction

Ultimately, one should consider the potential bias in the survey’s results. The article does not provide the exact wording of the questions asked. However, the author suggests that the question wording may have affected the poll’s findings. For example, if a question is not formulated correctly, it may confuse a participant and cause them to respond incorrectly.

Another source of bias is sampling error. As mentioned earlier in the paper, the results would be more accurate if the sample size were larger, allowing for a better representation of the entire population. Moreover, since the sampling was random, it was impossible to ensure that information was obtained from a diverse audience. Consequently, if there was a strong predominance among the participants based on gender, race, age, or other characteristics, the results may be biased and represent precisely the preferences of the dominant group in the sample.

Reference

O’Boyle. (2023). The customer satisfaction crisis: Solve it with 3 strategies. Gallup.