Skip to main content

Decomposing cross-country differences in quality adjusted life expectancy: the impact of value sets

Abstract

Background

The validity, reliability and cross-country comparability of summary measures of population health (SMPH) have been persistently debated. In this debate, the measurement and valuation of nonfatal health outcomes have been defined as key issues. Our goal was to quantify and decompose international differences in health expectancy based on health-related quality of life (HRQoL). We focused on the impact of value set choice on cross-country variation.

Methods

We calculated Quality Adjusted Life Expectancy (QALE) at age 20 for 15 countries in which EQ-5D population surveys had been conducted. We applied the Sullivan approach to combine the EQ-5D based HRQoL data with life tables from the Human Mortality Database. Mean HRQoL by country-gender-age was estimated using a parametric model. We used nonparametric bootstrap techniques to compute confidence intervals. QALE was then compared across the six country-specific time trade-off value sets that were available. Finally, three counterfactual estimates were generated in order to assess the contribution of mortality, health states and health-state values to cross-country differences in QALE.

Results

QALE at age 20 ranged from 33 years in Armenia to almost 61 years in Japan, using the UK value set. The value sets of the other five countries generated different estimates, up to seven years higher. The relative impact of choosing a different value set differed across country-gender strata between 2% and 20%. In 50% of the country-gender strata the ranking changed by two or more positions across value sets. The decomposition demonstrated a varying impact of health states, health-state values, and mortality on QALE differences across countries.

Conclusions

The choice of the value set in SMPH may seriously affect cross-country comparisons of health expectancy, even across populations of similar levels of wealth and education. In our opinion, it is essential to get more insight into the drivers of differences in health-state values across populations. This will enhance the usefulness of health-expectancy measures.

Peer Review reports

Background

Summary measures of population health (SMPH) have been calculated to represent the health of a particular population in a single number, combining information on fatal and nonfatal health outcomes [1, 2]. SMPH have been applied to various purposes, e.g., to monitor changes in population health over time, to compare population health across countries, to investigate health inequalities (the distribution of health within a population), and to quantify the benefits of health interventions in cost effectiveness analyses [3–5]. In this study, we focus on using SMPH to compare the level of health across populations.

Although different types of SMPH have been developed [6–10], they usually comprise three elements: information on mortality, nonfatal health outcomes, and health-state values. Health-state values reflect the impact of nonfatal health outcomes on a cardinal scale, commonly comprising a value of 1 for full health and a value of 0 for a state equivalent to death. In SMPH, the number of years lived in a particular population (taken from life tables) is combined with information on the (proportional) prevalence of health states or diseases and the value of these nonfatal health outcomes. In this way, the number of life years lived in a population is transformed into the number of healthy life years lived.1 The value sets provide the link between the information on nonfatal health outcomes and the information on mortality.

There has been much debate on SMPH, in particular regarding the validity, reliability, and cross-country comparability of different methods. A complete discussion on the pros and cons of different methods is beyond the scope of this paper and can be found elsewhere [6, 11, 12]. In short, crucial and persistent issues have been the measurement and valuation of nonfatal health outcomes and the incorporation of other values such as discounting or equity. In cases where SMPH are used to compare population health across countries, it is essential to use the same concepts and measurement methods for mortality, nonfatal health outcomes, and value sets across countries. Furthermore, it is crucial to understand in what way the method chosen may affect cross-country variation in the summary measure.

In this study we performed a cross-country comparison of Quality Adjusted Life Expectancy (QALE). We included information on health-related quality of life (HRQoL) to represent nonfatal health outcomes. EQ-5D (HRQoL) population surveys were used, and we included the 15 countries in which an EQ-5D population survey had been conducted. The EQ-5D is a standardized and validated questionnaire for measuring HRQoL. It comprises five dimensions such as mobility and self-care. The information on HRQoL, in combination with one of the available value sets, can be used to calculate QALE. As far as we know, a HRQoL-based approach has rarely been used in SMPH [1], particularly in international comparisons. The approach may prove interesting, since the value sets are calculated on the basis of choice-based methods, which have a theoretical foundation in economic theory [13]. Furthermore, data requirements of an EQ-5D type of instrument may be limited compared to other approaches such as using disease prevalence, particularly in international comparisons [14, 15]. There are several other validated HRQoL instruments besides the EQ-5D, such as the SF-36 and the Health Utility Index mark 2 and mark 3 (HUI-2 and HUI-3) [16–18]. Muennig et al. used EQ-5D data to estimate Health Adjusted Life Years (HALY) in the American population [19]. They found differences across income groups, yet they did not provide insight into the uncertainty in their estimates. In Canada, the HUI was used to calculate a national SMPH [20, 21]. Feeny et al. used the HUI-3 and a single Canadian value set to compare health expectancy between Canada and the US [21]. Significant health differences between the two countries were found. Health-state profiles have also been included in SMPH in combination with information on diseases and disability [7].

Our first aim was to provide more empirical evidence on international differences in HRQoL-based health expectancy. Additionally, we aimed to explore the impact of the value set choice. In the context of international comparisons, a choice has to be made between country-specific values and cross-country (global) values. The issue of value set choice has not been extensively discussed in the literature, however. It can be argued that if SMPH serve (international) health system performance assessments, country-specific value sets are preferred. Health systems should deliver outcomes in accordance with the preferences of the population they serve and whose means are put in use. Country-specific value sets may not always be available, however. Some have used foreign value sets, e.g., from neighboring countries. For example, Feeny et al. compared health-utility-based health expectancy between the US and Canada using the Canadian value set for both countries [21]. The authors remarked this as a limitation because the true preferences of the US population may not exactly resemble the Canadian values. Some have used a single global value set in international comparisons. For example, Mathers et al. calculated Health Adjusted Life Expectancy (HALE) by combining data on disease incidence (from the WHO Global Burden of Disease [GBD] study) with, for a subset of countries, survey data on health states [7]. Global value sets were applied to both the diseases (values were called severity weights in this context) and the health states. International comparisons of disability-adjusted life years (DALYs) and of disability-adjusted life expectancy (DALE) also used a single value set across countries [22–24]. It has been argued that the valuation of health domains shows reasonable consistency across countries, justifying the use of a global value set from an empirical perspective [25]. Nevertheless the need for more empirical evidence was acknowledged. Others did find differences in disease/disability-related values across countries and raised doubts about the universality of health values [26]. Another consideration that could support the use of global values is that identical interventions on identical patients will result in different benefits if different value sets are used. For example, less-healthy (poorer) populations may experience a smaller impact of health problems and a smaller benefit from interventions because they are unaware of better health outcomes. In other words, differences in values and expectations would determine system performance and could also alter resource allocation decisions across populations in a way that may be considered undesirable.

In summary, the literature has demonstrated a need to improve the understanding of differences in the valuation of health, also in the context of international comparisons of SMPH [25–27]. We aimed to provide more empirical evidence on the impact of value sets on cross-country differences in health expectancy. Furthermore, we aimed to discuss these results in the context of the theoretical and methodological issues that have been raised in the literature.

Methods

Data

We calculated QALE in 15 countries using individual-level EQ-5D survey data (provided by Euroqol Group) and life tables from the Human Mortality Database (HMD) [28]. The HMD did not provide life tables for Armenia and Greece, for which we instead used WHO life tables [29]. The countries were selected on the basis of EQ-5D data availability. The EQ-5D surveys were conducted between 1993 and 2002 (see Additional file 1). All surveys used the standard EQ-5D setup. The translation process of the EQ-5D surveys followed the guidelines proposed in the international literature [30]. Survey respondents were noninstitutionalized persons older than 18 years. Sample size varied between 400 and 10,000 observations per country (see Additional file 1). We excluded 2,989 observations with missing values in at least one of the EQ-5D dimensions because HRQoL could not be calculated in these cases. Consequently 41,562 observations/individuals remained in the pooled dataset. We used life tables from the year 2000 for all countries.

The value sets used to weight health states were all based on the time trade-off (TTO) elicitation technique and were taken from the literature. TTO-based valuation studies had been conducted in Germany, Japan, the Netherlands, Spain, the UK, and the US (see Table 1) [16, 31–35]. The TTO method is considered the most appropriate (consistent) method to elicit preferences, compared to the Standard Gamble technique or the Visual Analogue Scale, for example [36].

Table 1 Characteristics of the TTO value sets

HRQoL

The EQ-5D comprises five domains: mobility, self-care, usual activities, pain/discomfort, and anxiety/depression. Each domain contains three levels: no problems (1), some problems (2), and extreme problems (3). For example, a respondent may report no problems in mobility, self-care, usual activities, and pain/discomfort, and some problems in anxiety/depression. Generally the five answers are transformed into a single HRQoL index as follows:

(1)

where α cjk = value of EQ-5D domain j and level k for country c; d jk = dummy for health state j and level k; β c = value of having some or severe problems in at least one health domain (dummy N2) for country c; and γ c = value of having severe problems in at least one health domain (dummy N3) for country c.

The US value set was based on a different formula [35]:

(2)

where D 1 = number of domains with some or extreme problems beyond the first, I2square equals the square of the number of domains at level 2 beyond the first, and I3square equals the square of the number of domains at level 3 beyond the first. This model was chosen in the US because it provided the best fit for the data [35]. Additionally, in contrast to the other value sets, the US model was meant to take account of the marginal changes in HRQoL associated with having some or extreme problems in additional domains.

Equation (1) and equation (2) show that the maximum HRQoL equals 1. The values α cjk reflect the HRQoL reduction associated with having some problems or severe problems in each EQ-5D domain. These preferences may differ across countries as shown in Table 1 by the difference in minimum HRQoL (see also [34, 37, 38]). Figure 1 demonstrates the relative value of each EQ-5D dimension for the five value sets that are based on equation (1). For example, it shows that, compared to Dutch residents, people in the UK attached greater value to having some or severe health problems in all domains except anxiety (see [33]). Consequently, minimum HRQoL was lower in the UK (-0.594 vs. -0.329).

Figure 1
figure 1

Value of the EQ-5D domains and levels. 1The US values are not shown because they are based on a different formula.

Analysis

We used the Sullivan approach to combine mortality and nonfatal health outcomes and to calculate QALE [39]. The life tables comprised current death rates and conditional probabilities of death by country, gender, and age group (mostly five-year age groups). These probabilities were used to calculate the number of life years lived per age group for a hypothetical cohort. We multiplied the number of life years, as given in the HMD life tables, with the mean HRQoL as predicted by the parametric model described underneath, in order to calculate the number of healthy life years. Finally, the total number of healthy life years from age × was divided by the number of survivors in the hypothetical cohort at age × to calculate QALE at age x. We excluded age groups under 20 years, because the EQ-5D surveys were conducted among individuals older than 18 years. In addition, we were unable to differentiate HRQoL in the age groups over 85 years, because the maximum age of respondents was 90 in almost all surveys. Equation (3) is a formal representation of the QALE.

(3)

LY c,g,a equals total number of life years lived in country c, gender g, and age group a;

HRQoL c,g,a equals average (predicted) HRQoL by country c, gender g, and age group a;

l c,g,a equals number of survivors in the life table cohort for country c, gender g, and age group a; and z equals the last open-ended age interval of the life table.

HRQoL c,g,a was calculated in three steps: 1) we calculated HRQoL at the individual level using equation (1); 2) we estimated the predicted HRQoL at the individual level using a multiple regression model; and 3) we computed the mean predicted HRQoL by country, gender, and age. In step 2, we estimated a multiple regression model with HRQoL as dependent variable (in the range [minimum, 1]) and age, gender, country dummies, and education level as independent variables. We estimated the model to fully exploit the information available in the pooled dataset and to explore the relationship between HRQoL and respondent characteristics (Additional file 2 shows that there is almost no difference between QALE using observed HRQoL and QALE using predicted HRQoL). Previous studies have shown that HRQoL is associated with demographic and socioeconomic characteristics such as age, gender, education, income, and race (e.g., [19, 40–42]). The EQ-5D surveys provided information on the respondents' age (the average age was 47 in the pooled dataset), gender (46% male), country, and level of education (primary education 31%, secondary education 57%, and university level 12%). The variables socioeconomic status and smoking status were not used because of high nonresponse rates (43% and 47% respectively). It was expected that the relationship between HRQoL and, for example, age differed by gender and country. Therefore interaction terms between country, gender, and age were included in the model. We used nonparametric bootstrap techniques to calculate 95% confidence intervals. As discussed in Pullenayegum et al., regression models that use this type of outcome measure need to take heteroscedasticity and a nonnormal distribution into account [43]. Pullenayegum et al. showed that OLS regression with nonparametric bootstrap can give 'acceptable adequacy' of the confidence intervals with these data. We also tested alternative models, a tobit model and a two-part model, which have been used to model skewed and truncated data. The outcomes of these models did not alter the main results and conclusions (these regression results can be obtained through the corresponding author).

Finally, we computed counterfactual estimates in order to explore the contribution of mortality, health states, and health-state valuation to cross-country variation in QALE. In this part of the study, we only included the six countries for which value sets had been established (Table 1). As a result, six sets of counterfactual estimates were generated. In each set, a different country was used as reference country. Suppose we use Germany as reference country. Then, we imputed mortality rates, health-state profiles, and values from Germany into QALE of, for example, Spain. Subsequently, we investigated the associated change in QALE for Spain in comparison to QALE based on Spanish mortality, health states, and values.

In the first counterfactual estimate we used country-specific value sets, country-specific EQ-5D health states, and death rates of the reference country. In other words, we imputed LY and l of the reference country in equation (3). The difference between this counterfactual QALE and the original QALE (based on country-specific mortality, health states, and values) revealed the contribution of mortality. With the second counterfactual QALE we estimated the impact of health states using country-specific value sets, country-specific death rates, and EQ-5D health states of the reference country. Now the HRQoL component in equation (3) was based on country-specific values α c,j,k and on the health state profiles d jk of the reference country. The difference between this counterfactual QALE and the original QALE showed the contribution of health states. The third counterfactual estimate comprised country-specific EQ-5D health states, country-specific death rates, and the value set of the reference country. We imputed the values α of the reference country in equation (1). Subsequently, QALE was estimated using equation (3) and the difference between this counterfactual QALE and the original QALE demonstrated the impact of value sets.

Results

Regression results

Table 2 presents the results of the regression model (using UK values). The table shows that HRQoL declined with age, although the relationship was not linear (age, age squared, and age cubic were jointly significant). The gender-age interaction term shows that the age effect differed between men and women: the reduction in HRQoL over age was somewhat smaller for males. In addition, the regression results showed significant country effects and cross-country differences in the impact of age and gender. The country dummies and interaction terms were jointly significant. HRQoL was also positively associated with education level.

Table 2 Regression results1

QALE

Figure 2 shows QALE at age 20 by country and gender (using UK values). It shows that QALE at age 20 ranged from 33 years in Armenia (males) to almost 61 years in Japan (females). The figure shows that QALE at age 20 years was higher for females than for males. Only Greece showed a higher male QALE, yet the confidence intervals of the two genders largely overlapped for this country. The absolute gender difference in QALE ranged between 1.6 years in the US and 4.6 years in Slovenia.

Figure 2
figure 2

Quality Adjusted Life Expectancy at 20 years by country and gender 1. 1Confidence interval based on nonparametric bootstrap technique. Blue: females, Red: males.

Value set choice

The former results were calculated using the UK value set in all countries. Table 3 demonstrates QALE using different value sets. The table shows that the UK value set generated the lowest QALE in most (67%) of the country-gender strata. The German value set generated the highest QALE in all country-gender strata, with a maximum difference of 7.2 healthy years (difference in QALE between the German value set and the UK value set for females in Armenia). The US value set consistently showed the second-highest QALE. In 60% to 70% of all country-gender strata, the Spanish value set ranked third, the Dutch value set ranked fourth, the Japanese value set ranked fifth, and the UK value set ranked sixth. The relative change in QALE, as a result of a change in value set choice, varied between countries. For example, the difference in QALE between the German value set and the UK value set was close to 3% for Japanese males, but more than 20% for Armenian females. We also added a country ranking (R) by value set and by gender. The countries at the top end and low end of the ranking showed a stable position across value sets. In between, the ranking of the countries was affected to some extent. Around 50% of the country-gender strata moved two or more rank-positions across value sets. Notable rank-changes were found for Belgium (females), Canada (females), Finland (females), Greece (males), and Sweden (males).

Table 3 QALE at age 20 years using different value sets plus a country ranking (R)1

QALE decomposition

Counterfactual estimates were generated in order to explore the role of mortality, health states, and health-state values in cross-country differences. Figure 3 demonstrates the results. Each of the six countries involved (Germany, Japan, Netherlands, Spain, UK, and US) appears once as reference country in the counterfactual scenarios. As a result, six figures are shown. The figure demonstrates that the impact of the different QALE components varied substantially across countries. For example, the top-left graph demonstrates the contribution of mortality, EQ-5D health states, and health-state values to the difference in QALE with the UK. It shows that mortality rates explained the major part of the QALE difference with the UK for Japanese females and Spanish females. Differences in terms of valuation explained most of the difference in QALE with the UK for Germany and the US. Differences in EQ-5D health states explained the greater part of the variation in QALE for males in Japan, the Netherlands, and Spain. The figure shows that the differences in QALE with Germany are largely explained by the valuation component for all countries.

Figure 3
figure 3

Contribution of mortality, EQ-5D health states and value sets to cross-country differences in QALE 1. 1The y-axis shows the difference in quality adjusted life years between the QALE that comprised country-specific components and each counterfactual estimate. Blue: mortality, Red: health states, Green: values.

Discussion and conclusions

In this study we performed an international comparison of HRQoL-based health expectancy. We found that QALE at age 20 ranged between 33 years in Armenia and almost 61 years in Japan. Generally, female QALE was higher than male QALE within this set of countries. In terms of QALE, Hungary and Slovenia performed better than Armenia, yet worse in comparison to the other countries. The relatively low health expectancy for a country such as Armenia may be expected given its lower levels of health spending and national income and its different socioeconomic circumstances. The United States performed worse in terms of QALE compared to the other western high-income countries in the dataset. Many studies have found such unfavorable health outcomes in the US and several explanations for this phenomenon have been given, such as an inefficient health care system, substantial disparities in the population in terms of access to health care, or behavioral factors (unhealthy diets) [44, 45].

In the final part of the analysis, we decomposed the difference in QALE using counterfactual scenarios. It was shown that the relative contribution of mortality, health states, and health-state values differed among countries. For example, the high QALE for Japanese males was to a large extent a result of a low prevalence of health problems in EQ-5D domains. In turn, the better average health of Spanish females was largely explained by lower mortality rates. Interestingly, in various cases the EQ-5D profiles showed a greater contribution to differences in QALE than differences in mortality. Lower mortality did go hand in hand with better HRQoL, although there were exceptions. For example, Dutch females had a lower life expectancy than Spanish females, yet they experienced fewer health problems in EQ-5D domains. As a result, the difference in HRQoL-based health expectancy was smaller than the difference in life expectancy between these two countries. The decomposition confirmed that international comparisons of health expectancy, based on country-specific values, are influenced substantially by differences in value sets.

Differences in health expectancy across countries may stem from various factors, among which methodological issues and cultural differences play a role. Amid the three main SMPH elements (mortality, nonfatal health outcomes, and valuation) we focus on the value sets first. A remarkable result was the difference in QALE across the six TTO value sets. The German value set generated QALE up to seven years higher than the UK value set. The ranking of countries varied to a lesser extent across value sets, particularly in the high-performing or low-performing countries. We did find rank switches in the group of average performers. This may be expected because the differences in QALE were relatively small in this middle group, showing various overlapping confidence intervals (see Figure 2). Therefore, the ranking of these country-gender strata is particularly sensitive to the value-set choice. Around 50% of the country-gender strata showed a rank-change of two or more positions across value sets. Interestingly, the relative change in QALE associated with the value set choice differed across countries. The impact was greatest in low-performing countries such as Armenia, Hungary, and Slovenia. We also found that the ranking of countries did not consistently improve when local values were used. For example, Germany did not reach a higher rank in the German value set compared to the ranking in which Japanese values were used.

In the literature, the variation in health valuation has largely been explained by methodological differences across valuation studies and differences in the level of wealth and the level of education among populations [27]. In our case the available value sets represented the preferences of Western countries of similar levels of education and similar levels of wealth. Although we cannot exclude that methodological differences played a role, we argue that these cannot fully explain the variation that was found (see also [46]). All studies were conducted using face-to-face interviews, applied the TTO technique to elicit values, and included nationally-representative samples. In order to determine the valuation function, they used similarly specified least squares regression models representing the relationship between the TTO outcome and EQ-5D domains-levels and took account of within-individual error correlation [46]. The main difference was the model used in the US, which included a different specification of the N2 and N3 interaction terms and the marginal HRQoL effects. The US value set took account of a decrease in the marginal reduction in HRQoL associated with further increases in the number of domains with any problems or extreme problems. Still, the extent to which the US valuation function generated different HRQoL scores not only depended on the interaction terms and marginal effects, but also on the values attached to the individual domains and levels. Additional file 3 shows for each value set the HRQoL score associated with certain health states to exemplify the differences.

Consequently, we argue that a more conceptual discussion is needed. Cross-country variation in values may reflect cultural differences or differences in the availability of certain social services (and therefore the perceived/expected impact of health impairments). Naturally, health-state values also differ among individuals [47]. It may be argued that national or global value sets should cover this within-population variation in terms of values. In other words, the samples in elicitation studies need to be representative along the relevant population characteristics (similar to the other elements of SMPH). The cross-national differences in values need to be taken into account in the context of health-system-performance assessments and international comparisons of population health. In such studies, country-specific value sets may be preferred, since each health system should deliver outcomes according to the preferences of the population it serves and whose means are put in use. Moreover, the varying impact of health problems across countries needs to be accounted for. Some previous international comparisons of SMPH have used global value sets, based on the argument that health values are reasonably consistent across countries. However, the result of this study, similar to, for example, Üstün et al. [26], points to the contrary and shows that variation in values may affect SMPH outcomes. A drawback of using country-specific value sets is that they may not always be available, as was experienced in this study and in previous studies (e.g. [21]). In our opinion, the best solution is to calculate health expectancy by different foreign value sets and to compare the differences (as in Table 3). Additionally, the use of country-specific value sets in international comparisons may deserve close scrutiny from an equity perspective, particularly if there is a relationship among values, true health status, and level of wealth. Populations with less exposure to what constitutes "full health" may assign lower values, i.e., a smaller loss in terms of HRQoL, to certain health problems. As a result, a particular health intervention will generate fewer benefits in these populations. From an equity perspective, this may be considered undesirable. This argument has not been tested empirically though, and may be less relevant when only high-income countries of similar levels of health are included, as in our study.

The issue of value-set choice not only pertains to HRQoL-based health expectancy. All SMPH using multiple health states, diseases, levels of disability, or other morbidity measures use a valuation function or a set of weights. Only measures such as disability-free life expectancy do not comprise value sets. Such approaches classify people in two groups: with or without disability or disease. In that case you simply multiply the proportion without any disability with the number of life years lived in a particular stratum. Obviously these are rather crude methods that neglect differences in severity levels.

Two other issues need to be raised regarding the valuation part of SMPH. First, a plus of the EQ-5D type instrument, particularly in case an economic perspective is required, may be that value sets have been elicited using a choice-based method (TTO technique). Choice-based methods are considered the preferred method among economists to elicit people's preferences. The extent to which the elicitation method affects cross-country differences is largely unknown. Some have argued that different elicitation methods generate a rather similar cross-country variation in terms of values, but more research is needed on this issue [47]. Secondly, we need to address the question of whose values should be used. The value sets we used all represented general population values. Various authors have compared population values with patient values [48–51]. From an economic perspective, population values may be preferred, since health systems consume public means and should therefore allocate their resources and outcomes according to the preferences of the general population [48]. However, it was found that the general public attaches a much greater loss in terms of HRQoL to particular health problems than patients do. Although patients are better informed about the impact of morbidity, the adaptation effect is present among them [52, 53]. Expert opinion has also been applied in previous international studies on SMPH [24]. The question is to what extent experts are able to assess the impact of different health states or diseases on people in general as well as for different populations. As a result this discussion appears unresolved.

As demonstrated by the decomposition, differences in QALE are also affected by differences in health states. Two major measurement issues should be discussed in this respect. First, although all studies used the same standardized EQ-5D instrument, the mode of administration differed across studies. It has been shown that telephone surveys in particular may generate more positive HRQoL scores compared to self- or interviewer-administered surveys [54]. The surveys included in our study were conducted as face-to-face interviews (Armenia, Greece, Japan, Spain, and UK) or self-administered postal interviews (other countries). Only part of the German data was based on a telephone survey. A second major measurement issue regarding the measurement of nonfatal health outcomes is response heterogeneity. People who are in an objectively equal health state may respond differently to the same health question. Response heterogeneity can be explained by differences in norms and expectations, in awareness, and in access to health care across populations. It may affect the validity and the cross-population comparability of all SMPH using self-reported health data (in terms of health states, disability, or disease) [55]. At the same time, the effect of response heterogeneity may somewhat be dampened if similar mechanisms also play a role in the valuation of nonfatal health outcomes. Some have argued that response heterogeneity may be less of a problem if different severity levels are included in the morbidity measure, since most threshold issues arise at the lower-valued mild-severity levels [1]. Moreover, the problem may be greater in self-rated general health questions, and some authors even used EQ-5D type of questions as more objective health measures [56, 57]. Still, it remains unclear to what extent the reporting of EQ-5D health states, and our international comparison, have been subject to response bias. Whether response bias in the measurement of morbidity is related to the variation in the valuation of morbidity needs further investigation.

From a practical point of view, HRQoL-type of data may be preferred, since this approach may turn out to be less resource-intensive in terms of data gathering and data analysis than, for example, disease-based methods [22]. The latter approach requires information on many types of diseases and on the impact of all diseases in terms of disability. At an international level, data availability may be limited, which could cause less accuracy of the results. Furthermore, the presence of comorbidity complicates disease-based calculations [58]. In turn, an advantage of disease-based measures may be that clinical records or administrative records on the prevalence of diseases can be used. Such data do not suffer from self-report problems.

The following should be kept in mind while interpreting our results. First, the EQ-5D surveys were conducted in different years. This also holds for the value sets that were used, whereas preferences may change over time. It is unclear whether this is the case and to what extent this may have affected the results. We did see that value sets from similar years still showed substantial differences such as those from the Netherlands and the US or those from Germany and Japan. Future research could clarify to what extent health-related preferences change over time. Secondly, certain population groups were not included in the EQ-5D samples, such as inhabitants younger than 20 years and, in most surveys, people older than 85. Therefore we did not calculate QALE at birth and were unable to differentiate HRQoL within the 85-plus group. In addition, the surveys did not include the institutionalized population. However, due to a lack of comparable data, it is unclear to what extent this influenced the cross-country variation. Further, it was unclear whether all potential determinants of HRQoL were represented sufficiently. Thirdly, we did not take uncertainty in mortality into account because this information was not included in WHO life tables. However, there will be little uncertainty in life tables given the large population size. Consequently, the uncertainty in health expectancy particularly arises in the morbidity part of these measures [21]. Finally, as discussed before, different researchers may have used slightly different protocols and analyses which may have affected the differences in value sets [46].

In conclusion, we recommend that future international comparisons on SMPH profoundly discuss their value-set choice, including the theoretical and practical issues, and perform sensitivity analyses where possible and necessary. In addition, more qualitative research on the determinants of differences in valuation within and across populations is needed. This will improve the interpretation and the usefulness of HRQoL-based, and other, summary measures of population health.

Endnote

1A simplified example: suppose that the life expectancy at birth of a population is equal to 80 years. Furthermore assume that half of the population lives in perfect health for 80 years, and the other half lives in an imperfect health state for 80 years. If the value of this imperfect health state is 0.5 then half of the population will live 80 healthy years and half of the population will live 80*0.5 = 40 healthy years. Consequently health expectancy of the entire population will be 60 years.

References

  1. Mathers CD: Health expectancies: an overview and critical appraisal. In Summary Measures of Population Health: Concepts, Ethics, Measurement and Applications. Edited by: Murray CJL Salomon JA Mathers CD Lopez AD. Geneva: WHO; 2002:177-204.

    Google Scholar 

  2. Field MJ, Gold MR: Summarizing population health: directions for the development and application of population metrics. Washington DC: Institute Of Medicine; 1998.

    Google Scholar 

  3. Murray CJ, Frenk J: A framework for assessing the performance of health systems. Volume 78. Bull World Health Organ; 2000:717-31.

    Google Scholar 

  4. Mathers CD, Murray CJ, Ezzati M, Gakidou E, Salomon JA, Stein C: Population health metrics: crucial inputs to the development of evidence for health policy. Popul Health Metr 2003, 1: 6. 10.1186/1478-7954-1-6

    Article  PubMed  PubMed Central  Google Scholar 

  5. Murray CJ, Frenk J: Ranking 37th--measuring the performance of the U.S. health care system. N Engl J Med 2010, 362: 98-9. 10.1056/NEJMp0910064

    Article  CAS  PubMed  Google Scholar 

  6. Murray CJL, Salomon JA, Mathers CD: A critical examination of summary measures of population health. In Summary Measures of Population Health: Concepts, Ethics, Measurement and Applications. Edited by: Murray CJL Salomon JA Mathers CD Lopez AD. Geneva: WHO; 2002:13-40.

    Google Scholar 

  7. Mathers CD, Murray CJ, Salomon JA, Sadana R, Tandon A, Lopez AD, et al.: Healthy life expectancy: comparison of OECD countries in 2001. Aust N Z J Public Health 2003, 27: 5-11. 10.1111/j.1467-842X.2003.tb00372.x

    Article  PubMed  Google Scholar 

  8. Robine JM, Ritchie K: Healthy life expectancy: evaluation of global indicator of change in population health. BMJ 1991, 302: 457-60. 10.1136/bmj.302.6774.457

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Perenboom RJ, Van Herten LM, Boshuizen HC, Van Den Bos GA: Trends in disability-free life expectancy. Disabil Rehabil 2004, 26: 377-86. 10.1080/0963828032000174098

    Article  CAS  PubMed  Google Scholar 

  10. Murray CJ: Quantifying the burden of disease: the technical basis for disability-adjusted life years. Bull World Health Organ 1994, 72: 429-45.

    CAS  PubMed  PubMed Central  Google Scholar 

  11. Murray CJ, Salomon JA, Mathers C: A critical examination of summary measures of population health. Bull World Health Organ 2000, 78: 981-94.

    CAS  PubMed  PubMed Central  Google Scholar 

  12. Mathers CD: Towards valid and comparable measurement of population health. Bull World Health Organ 2003, 81: 787-8.

    PubMed  Google Scholar 

  13. Dolan P: The measurement of Health-Related Quality of Life. In Handbook of Health Economics. Edited by: Culyer AJ, Newhouse JP. Amsterdam: Elsevier Science; 2000:1723-1760.

    Google Scholar 

  14. Williams A: Calculating the global burden of disease: time for a strategic reappraisal? Health Econ 1999, 8: 1-8.

    Article  CAS  PubMed  Google Scholar 

  15. Williams A: Comments on the response by Murray and Lopez. Health Econ 2000, 9: 83-6. 10.1002/(SICI)1099-1050(200001)9:1<83::AID-HEC494>3.0.CO;2-V

    Article  CAS  PubMed  Google Scholar 

  16. Dolan P: Modeling valuations for EuroQol health states. Med Care 1997, 35: 1095-108. 10.1097/00005650-199711000-00002

    Article  CAS  PubMed  Google Scholar 

  17. Brazier J, Roberts J, Deverill M: The estimation of a preference based single index measure for health from the SF-36. Journal of Health Economics 2002, 21: 271-292. 10.1016/S0167-6296(01)00130-8

    Article  PubMed  Google Scholar 

  18. Feeny DH, Furling WJ, Torrance GW et al: Multiattribute and single attribute utility function - the health utility mark 3 system. Med Care 2002, 40: 113-128. 10.1097/00005650-200202000-00006

    Article  PubMed  Google Scholar 

  19. Muennig P, Franks P, Jia H, Lubetkin E, Gold MR: The income-associated burden of disease in the United States. Soc Sci Med 2005, 61: 2018-26. 10.1016/j.socscimed.2005.04.005

    Article  PubMed  Google Scholar 

  20. Wolfson MC: Health-Adjusted Life Expectancy. Statistics Canada: Health Reports 1996, 8: 41-46.

    CAS  PubMed  Google Scholar 

  21. Feeny D, Kaplan MS, Huguet N, McFarland BH: Comparing population health in the United States and Canada. Popul Health Metr 2010, 8: 8. 10.1186/1478-7954-8-8

    Article  PubMed  PubMed Central  Google Scholar 

  22. Murray CJL: Regional patterns of disability-free life expectancy and disability-adjusted life expectancy: Global Burden of Disease Study. Lancet 1997, 349: 1347-1352. 10.1016/S0140-6736(96)07494-6

    Article  CAS  PubMed  Google Scholar 

  23. Mathers CD, Sadana R, Salomon JA, Murray CJL, Lopez AD: Healthy life expectancy in 191 countries, 1999. Lancet 2001, 357: 1685-1691. 10.1016/S0140-6736(00)04824-8

    Article  CAS  PubMed  Google Scholar 

  24. Mathers CD, Lopez AD, Murray CJL: The Burden of Disease and Mortality by Condition: Data, Methods, and Results for 2001. In Global Burden of Disease and Risk Factors. Edited by: Lopez AD, Mathers CD, Ezzati M, Jamison DT, Murray CJL. Washington DC: The International Bank for Reconstruction and Development/The World Bank; 2006.

    Google Scholar 

  25. Salomon JA, Mathers CD, Chatterji S, Sadana R, Üstün B, Murray CJL: Quantifying Individual Levels of Health: Definitions, Concepts, and Measurement Issues. In Health Systems Performance Assessment: Debates, Methods and Empiricism. Edited by: Murray CJL, Evans DB. Geneva: World Health Organization; 2003.

    Google Scholar 

  26. Üstün B, Rehm J, Chatterji S, Saxena S, Trotter R, Room R, Bickenbach J, the WHO/NIH Joint Project CAR Study Group: Multiple-informant ranking of disabling effect of different health conditions in 14 countries. Lancet 1999, 354: 111-115. 10.1016/S0140-6736(98)07507-2

    Article  PubMed  Google Scholar 

  27. Sommerfeld J, Baltussen RMPM, Metz L, Sanon M, Sauerborn R: Determinants of variance in health state valuations. In Summary Measures of Population Health: Concepts, Ethics, Measurement and Applications. Edited by: Murray CJL Salomon JA Mathers CD Lopez AD. Geneva: WHO; 2002:549-580.

    Google Scholar 

  28. Human Mortality DatabaseUniversity of California and Max Planck Institute for Demographic Research; [http://www.mortality.org]

  29. WHO Mortality DatabaseGeneva: WHO; 2009. [http://www.who.int]

  30. Rabin R, de Charro F: EQ-5D: a measure of health status from the EuroQol Group. Ann Med 2001, 33: 337-43. 10.3109/07853890109002087

    Article  CAS  PubMed  Google Scholar 

  31. Greiner W, Claes C, Busschbach JJ, von der Schulenburg JM: Validating the EQ-5D with time trade off for the German population. Eur J Health Econ 2005, 6: 124-30. 10.1007/s10198-004-0264-z

    Article  CAS  PubMed  Google Scholar 

  32. Tsuchiya A, Ikeda S, Ikegami N, Nishimura S, Sakai I, Fukuda T, et al.: Estimating an EQ-5D population value set: the case of Japan. Health Econ 2002, 11: 341-53. 10.1002/hec.673

    Article  PubMed  Google Scholar 

  33. Lamers LM, Stalmeier PF, McDonnell J, Krabbe PF, van Busschbach JJ: [Measuring the quality of life in economic evaluations: the Dutch EQ-5D tariff]. Ned Tijdschr Geneeskd 2005, 149: 1574-8.

    CAS  PubMed  Google Scholar 

  34. Badia X, Roset M, Herdman M, Kind P: A comparison of United Kingdom and Spanish general population time trade-off values for EQ-5D health states. Med Decis Making 2001, 21: 7-16. 10.1177/0272989X0102100102

    Article  CAS  PubMed  Google Scholar 

  35. Shaw JW, Johnson JA, Coons SJ: US valuation of the EQ-5D health states: development and testing of the D1 valuation model. Med Care 2005, 43: 203-20. 10.1097/00005650-200503000-00003

    Article  PubMed  Google Scholar 

  36. Torrance GW: Measurement of health state utilities for economic appraisal. J Health Econ 1986, 5: 1-30. 10.1016/0167-6296(86)90020-2

    Article  CAS  PubMed  Google Scholar 

  37. Johnson JA, Luo N, Shaw JW, Kind P, Coons SJ: Valuations of EQ-5D health states: are the United States and United Kingdom different? Med Care 2005, 43: 221-8. 10.1097/00005650-200503000-00004

    Article  PubMed  Google Scholar 

  38. Parkin D, Rice N, Devlin N: Statistical Analysis of EQ-5D Profiles: Does the Use of Value Sets Bias Inference? Med Decis Making 2010, 30: 556-65. 10.1177/0272989X09357473

    Article  PubMed  Google Scholar 

  39. Sullivan DF: A single index of mortality and morbidity. HSMHA Health Rep 1971, 86: 347-54. 10.2307/4594169

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. Luo N, Johnson JA, Shaw JW, Feeny D, Coons SJ: Self-reported health status of the general adult U.S. population as assessed by the EQ-5D and Health Utilities Index. Med Care 2005, 43: 1078-86. 10.1097/01.mlr.0000182493.57090.c1

    Article  PubMed  Google Scholar 

  41. Robert SA, Cherepanov D, Palta M, Dunham NC, Feeny D, Fryback DG: Socioeconomic status and age variations in health-related quality of life: results from the national health measurement study. J Gerontol B Psychol Sci Soc Sci 2009, 64: 378-89.

    Article  PubMed  Google Scholar 

  42. Cherepanov D, Palta M, Fryback DG, Robert SA: Gender differences in health-related quality-of-life are partly explained by sociodemographic and socioeconomic variation between adult men and women in the US: evidence from four US nationally representative data sets. Qual Life Res 2010, 19: 1115-24. 10.1007/s11136-010-9673-x

    Article  PubMed  PubMed Central  Google Scholar 

  43. Pullenayegum EM, Tarride JE, Xie F, Goeree R, Gerstein HC, O'Reilly D: Analysis of Health Utility Data When Some Subjects Attain the Upper Bound of 1: Are Tobit and CLAD Models Appropriate? Value Health 2010, 13: 487-94. 10.1111/j.1524-4733.2010.00695.x

    Article  PubMed  Google Scholar 

  44. Preston SH, Ho J: Low Life Expectancy in the United States: Is the Health Care System at Fault?. Cambridge: National Bureau of Economic Research; 2009.

    Book  Google Scholar 

  45. Wilper AP, Woolhandler S, Lasser KE, McCormick D, Bor DH, Himmelstein DU: Health insurance and mortality in US adults. Am J Public Health 2009, 99: 2289-95. 10.2105/AJPH.2008.157685

    Article  PubMed  PubMed Central  Google Scholar 

  46. Szende A, Oppe M, Devlin : EQ-5D value sets: inventory, comparative review and user guide. Dordrecht: Springer; 2007.

    Chapter  Google Scholar 

  47. Salomon JA, Murray CJL, Üstün B, Chatterji S: Health State Valuations in Summary Measures of Population Health. In Health Systems Performance Assessment: Debates, Methods and Empiricism. Edited by: Murray CJL, Evans DB. Geneva: World Health Organization; 2003:409-436.

    Google Scholar 

  48. Brazier J, Akehurst R, Brennan A, Dolan P, Claxton K, McCabe C, et al.: Should patients have a greater role in valuing health states? Appl Health Econ Health Policy 2005, 4: 201-8. 10.2165/00148365-200504040-00002

    Article  PubMed  Google Scholar 

  49. Brazier JE, Dixon S, Ratcliffe J: The role of patient preferences in cost-effectiveness analysis: a conflict of values? Pharmacoeconomics 2009, 27: 705-12. 10.2165/11314840-000000000-00000

    Article  PubMed  Google Scholar 

  50. McNamee P: What difference does it make? The calculation of QALY gains from health profiles using patient and general population values. Health Policy 2007, 84: 321-31. 10.1016/j.healthpol.2007.05.004

    Article  PubMed  Google Scholar 

  51. Drummond M, Brixner D, Gold M, Kind P, McGuire A, Nord E: Toward a consensus on the QALY. Value Health 2009,12(Suppl 1):s31-5.

    Article  PubMed  Google Scholar 

  52. De Wit GA, Busschbach JJ, De Charro FT: Sensitivity and perspective in the valuation of health status: whose values count? Health Econ 2000, 9: 109-26. 10.1002/(SICI)1099-1050(200003)9:2<109::AID-HEC503>3.0.CO;2-L

    Article  CAS  PubMed  Google Scholar 

  53. Dolan P, Kahneman D: Interpretations of utility and their implications for the valuation of health. The Economic Journal 2008, 118: 215-34.

    Article  Google Scholar 

  54. Hanmer J, Hays RD, Fryback DG: Mode of Administration Is Important in US National Estimates of Health-Related Quality of Life. Medical Care 2007, 45: 1171-1179. 10.1097/MLR.0b013e3181354828

    Article  PubMed  Google Scholar 

  55. Sadana R, Mathers CD, Lopez AD, Murray CJL, Moesgaard Iburg K: Comparative analyses of more than 50 household surveys on health status. In Summary Measures of Population Health: Concepts, Ethics, Measurement and Applications. Edited by: Murray CJ, Salomon JA, Mathers CD, Lopez AD. Geneva: WHO; 2002:369-386.

    Google Scholar 

  56. Lindeboom M, Van Doorslaer E: Cut-Point Shift and Index Shift in Self-Reported Health. Bonn: Institute for the Study of Labor (IZA); 2004.

    Google Scholar 

  57. Meijer E, Kapteyn A, Andreyeva T: Health Indexes and Retirement Modeling in International Comparisons. Santa Monica: RAND Labor and Population 2008.

    Google Scholar 

  58. van Baal PH, Hoeymans N, Hoogenveen RT, de Wit GA, Westert GP: Disability weights for comorbidity and their influence on health-adjusted life expectancy. Popul Health Metr 2006, 4: 1. 10.1186/1478-7954-4-1

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements and funding

No acknowledgments.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Richard Heijink.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

RH performed the analyses and wrote the draft manuscript. MO collected the data. All authors have made substantial intellectual contribution to the manuscript. All contributed to the conception and design of the study and the interpretation of the data. All authors have been actively involved in drafting or revising the manuscript and have given final approval of the version to be published.

Electronic supplementary material

12963_2011_139_MOESM1_ESM.DOC

Additional file 1:Characteristics of the surveys included in the dataset. The table shows in which year the EQ-5D surveys were conducted and it shows the sample size of the survey for each country. (DOC 34 KB)

12963_2011_139_MOESM2_ESM.DOC

Additional file 2:Observed and predicted HRQoL and QALE by country, gender and age (UK value set). The figures show the observed HRQoL by country, gender and age group. Additionally, the HRQoL by country, gender and age group as predicted by the regression model is shown (the line in each figure). The last figure demonstrates QALE at age 20 using the observed HRQoL vs. QALE at age 20 using the predicted HRQoL. (DOC 116 KB)

12963_2011_139_MOESM3_ESM.DOC

Additional file 3:HRQoL score associated with different EQ-5D profiles according to six value sets. HRQoL score associated with different EQ-5D profiles according to the six value sets. Each point on the x-axis represents a hypothetical set of answers in the five EQ-5D domains: mobility, self-care, usual activities, pain/discomfort and anxiety/depression. Each domain contains 3 levels: no problems (1), some problems (2), and extreme problems (3). (DOC 89 KB)

Authors’ original submitted files for images

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Heijink, R., van Baal, P., Oppe, M. et al. Decomposing cross-country differences in quality adjusted life expectancy: the impact of value sets. Popul Health Metrics 9, 17 (2011). https://doi.org/10.1186/1478-7954-9-17

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1478-7954-9-17

Keywords