Health Promotion International Advance Access originally published online on November 1, 2004
Health Promotion International 2004 19(4):471-481; doi:10.1093/heapro/dah409
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
HEALTH PROMOTION INTERNATIONAL Vol. 19. No. 4 © Oxford University Press 2004; All rights reserved.
Towards the development of scales to measure will to promote heart health within health organizations in Canada
1Alberta Heart Health Project, University of Alberta, Edmonton T6G 2T4, Canada, 2Centre for Health Promotion Studies, University of Alberta, Edmonton T6G 2T4, Canada and 3Alberta Centre for Active Living and Faculty of Physical Education and Recreation, University of Alberta, Edmonton T6G 2T4, Canada
Address for correspondence: Ronald C. Plotnikoff Centre for Health Promotion Studies, University of Alberta, 5-10A University Extension Centre, 8303-112 Street, Edmonton, Alberta, T6G 2T4, Canada E-mail: ron.plotnikoff{at}ualberta.ca
| SUMMARY |
|---|
|
|
|---|
This paper describes the development and psychometric evaluation of scales measuring the dimensions of will (belief, confidence, prior action and desire) for heart health promotion specifically and health promotion in general at both an individual and organizational level. Content validity was established through a series of focus groups and expert opinion assessments, based on a compilation of capacity-assessment instruments developed by other provinces involved in the Canadian Heart Health Initiative and the literature. Psychometric analyses of questionnaire data provided empirical evidence of the construct validity and reliability of the 16 individual and 21 organizational level will scales. A series of principal component analyses assisted in verifying the unidimensionality of the measures and all scales yielded high internal consistencies with Cronbach's alpha coefficients ranging between 0.73 and 0.96. These measures can be used by both researchers and practitioners for assessing the will to promote heart health specifically and health promotion in general.
Key words: capacity assessment; heart health promotion; scale development
| BACKGROUND |
|---|
|
|
|---|
The Alberta Heart Health Project (AHHP) was established in 1990 as a provincial level program of the Canadian Heart Health Initiative (CHHI). The CHHI was initiated to address the consistently high rates of cardiovascular disease among all Canadian provinces. Phase 1 involved collecting detailed heart health information with provincial heart health surveys. The 1990 Alberta Heart Health Survey indicated that 57% of the population exhibited one or more of the three major modifiable heart health risk factors: high blood cholesterol, high blood pressure and use of tobacco (Alberta Health, 1990
| INTRODUCTION |
|---|
|
|
|---|
Hawe and colleagues (Hawe et al., 1997
|
The model depicts: leadership as the foundation upon which the development of capacity rests. Consistent with The Singapore Declaration, will to act and infrastructure are the pillars of capacity. The spiral in the model depicts Rogers' stages of diffusion of innovations within organizations (Rogers, 1995
While there is a dearth of literature describing capacity and its components (Smith et al., 2001
), what is available confirms the importance of will in driving organizational and individual change in creating capacity for health promotion (Hawe et al., 1997
; Goodman et al., 1998
; The Singapore Declaration 1998; Riley et al., 2001a
; Riley et al., 2001b
). Will is similar to predisposition, which is described by Riley and colleagues (Riley et al., 2001a
) as the motivation to undertake heart health promotion activities and includes belief in the importance of implementing heart health promotion activities. May (May, 1982
) states the term will relates to intention and has qualities of independence, personal freedom and decision-making. Kim and Kim (Kim and Kim, 1996
) note that will, with regards to the adoption of an innovation, involves intention, which is determined by attitude towards the innovation in question. Similarly, Hollander (Hollander, 1999
) uses motivation as a simile for will and argues that a loss of political will is associated with a loss of legitimacy and conviction. The current project bases its definition of will on that of The Singapore Declaration (Advisory Board Third International Heart Health Conference, 1998
) where will is taken to imply the process of conceiving and implementing a program, leading to action.
The first step in the process of developing will is acquiring knowledge and beliefs that are derived from modeling or example (Advisory Board Third International Heart Health Conference, 1998
). This conceptualization is similar to constructs of the Health Belief Model (Strecher and Rosenstock, 1997) that include susceptibility, severity, benefits and barriers of an action, cues to action (e.g. reinforcement) and self-efficacy. As such, confidence is defined as a belief strong enough to lead to a willingness to act (Advisory Board Third International Heart Health Conference, 1998
). Gaining conviction, the next stage involves combining beliefs and desire, and is a precursor to building confidence and establishing values. One's perceived confidence (i.e. self-efficacy) based on Bandura's (Bandura, 1986
) Social Cognitive Theory is a key social-cognitive construct predicting behaviour change. The Singapore Declaration asserts that confidence must precede action (Advisory Board Third International Heart Health Conference, 1998
).
While some of the dimensions of will are drawn from theories, such as self-efficacy (Bandura, 1986
), the components of will have not been empirically tested in relation to capacity building. There appears, at least on the surface, to be a high degree of overlap between many of the components of will listed in The Singapore Declaration. It is essential to validate these dimensions of will in order to examine it's role in capacity building. The objective of this study therefore, was to validate the measurement properties of individual and organizational level scales to measure will to do health promotion in general and heart health promotion more specifically among key respondents from the health sector, including board members, senior/middle-management and service providers. We have conceptualized organizational will as an element of capacity, similar to readiness, and consisting of the guidance of decision-makers and managers (Advisory Board Third International Heart Health Conference, 1998
). This study is part of a larger research project to develop scales to measure the three components of capacity identified earlier in the paper. While, this paper focuses on the will scales, additional manuscripts are being written on the leadership and infrastructure components of capacity.
Throughout the paper, reference is made to both will to do heart health promotion and health promotion in general. While some of the scales are specific to heart health promotion, others are more general to health promotion but however do encompass heart health promotion.
| METHODS |
|---|
|
|
|---|
Instruments
The will scales were developed to measure beliefs, confidence, prior action and desire to promote health. The variables selected for inclusion in the will scales were based on those used in other provincial heart health research efforts (i.e., Nova Scotia, Ontario, Saskatchewan and British Columbia) and the literature (Advisory Board Third International Heart Health Conference, 1998
Instrument development
A two-day think tank was held with CHHI researchers from the provinces of Saskatchewan, British Columbia, Ontario and Manitoba with the purpose to discuss their experiences with tools assessing individual and organizational capacity to do heart healthgeneral health promotion. From this, a table was constructed listing the different components of will and the specific items found within each component. This assisted the identification of constructs to be measured along with establishing content validity. Some items and response choices were modified to meet the AHHP research needs. All will items were compiled into two questionnaires addressing organizational capacity and individual capacity, respectively. The individual capacity questionnaire required the respondents to reflect on their own level of capacity to do heart health promotion specifically and health promotion in general, whereas the organizational capacity questionnaire required the individual to reflect on the organization as a whole in its capacity to do heart health promotion and general health promotion.
The instruments were then subjected to two expert opinion focus groups; each focus group was comprised of five health promotion professionals (including consultants, graduate students, faculty and staff from national and provincial health agencies) to further establish and verify content validity of the questionnaires. One focus group reviewed the individual instrument; the other reviewed the organizational tool. Focus group participants initially completed the questionnaire and were asked to identify any expressions or items that appeared unclear. Subsequent modifications were made to the instruments.
Pilot versions of the two questionnaires were drafted and tested. Three health promotion-based organizations from Alberta served as the pilot sample. The organizations represented local, provincial and national level organizations, but did not include the target group. The pilot test aimed to identify questionnaire item ambiguities and to verify the clarity of the questions. Pilot test respondents included comments on the instruments, which were later recorded and taken into account when developing the final version of the questionnaires. The instruments were sent out to 37 key individuals, who were part of the CHHI, to verify the content validity of the will dimensions.
Final questionnaires
Final versions of the individual- and organizational-level questionnaires were sent to 158 individuals across all of Alberta's 17 RHAs. Data from 144 respondents were used to verify the construct validity of the a prior established scales. No significant changes were made to the instruments following psychometric analysis, and hence became the study's final questionnaires.
The will component of individual capacity questionnaire contained 90 items designed to measure confidence (three scales, 15 items), beliefs (four scales, 15 items), prior action (five scales, 40 items) and desire to promote health (four scales, 20 items). The will components of the organizational capacity questionnaire consisted of 149 items also designed to assess beliefs (three scales, 15 items), prior action (eleven scales, 77 items) and desire to promote health (seven scales, 57 items). Pilot work revealed that it was too difficult to measure confidence at an organizational level.
Subjects and procedures
Between six and 18 sets of questionnaires were sent to 158 participating RHA individuals. A site coordinator at each RHA was asked to recruit two RHA board members, and based on staff numbers, between two and eight senior/middle managers and service providers. Site coordinators were sent packages including the questionnaires, return envelopes, an information sheet describing the project and consent forms for participants. The package included instructions about timelines and the questionnaire distribution, completion and collection process. Participants were given one month to return the completed instruments. A member of the research team contacted site coordinators by telephone one month following the distribution to follow-up on questionnaire completion. If requested, participants were granted a two-week extension to return the instruments. The return of 144 completed paired individual and organizational-level questionnaires from three organizational levels [i.e. board members (n = 30), senior/middle management (n = 58) and service providers (n = 56)] yielded a response rate of 91%. Each respondent completed both the individual and organizational will instruments.
Analysis: assessment of construct validity
Scales were developed using the following procedures. Items to be included in the scales were established a priori according to measures established previously in former research efforts of other CHHI provincial projects described above. The five-point Likert-type scale categories for individual and organizational will are provided in Tables 1 and 2, respectively. The various response options ranged from 1 (e.g. not at all/poor) to 5 (e.g. completely/excellent).
|
|
The structure of the scales was then tested using factorial analytical techniques [principal component analysis (PCA)] (Tabachnick and Fidell, 2001
| RESULTS |
|---|
|
|
|---|
After the PCA and reliability analyses, scales were created and named. Descriptive statistics for the individual and organizational will scales, including the number of items per scale, mean scale scores and standard deviations, item loading range, percent variance accounted for by each scale and the scale alpha are presented in Tables 1 and 2, respectively. As noted above, the dashed-lines in Tables 1 and 2 illustrate the groupings by which the PCAs were conducted. Factor loadings for all scales in the study ranged from 0.42 to 0.92. Factor loadings of +0.30 are considered to be significant: loadings of +0.40 are deemed more important: and loadings of +0.50 or greater are considered to be very significant (Hair et al., 1992
Table 1 lists the individual will scales under the headings of confidence, beliefs, prior action and desire. PCA resulted in three scales pertaining to confidence in ability to address determinants of health (psychosocial/environmental risk conditions, physiological risk factors, behavioural risk factors). Analysis with respect to beliefs in addressing the determinants of health resulted in the determinants of health items factoring into four components (physiological, environmental, psychosocial, behavioural). Twenty items pertaining to actions that are characteristic of health promotion factored into two components. The first component was interpreted as a general health promotion action scale and the second as a risk factor scale. PCA was performed on the prior action determinants of health items (composed of 15 original items), which extracted two components. The components were examined for content and named prior action in addressing: traditional risk factors and psychosocial/environmental risk factors. There are five action strategies that characterize health promotion and are commonly referred to as the Ottawa Charter Action strategies (World Health Organization, 1986
). PCA retained one factor confirming this scale's unidimensionality. Desire to promote health has been conceptualized as a key component of the equation resulting in will to take action on health promotion. An initial grouping of 20 items characteristic of health promotion actions factored into four subscales, which were interpreted as desire to do: research and planning, community work, address risk factors and team work.
Table 2 provides an overview of the descriptive statistics and psychometric properties for measures of organizational will. Scales are grouped under the following headings; beliefs, prior action and desire. Respondents were asked to: Indicate how strongly you believe your organization should address each of the following factors. An initial set of 15 items describing the different determinants of health were factored into three components and named psychosocial/environmental, physiological and behavioural. Eleven scales were developed for health promotion prior action. An initial grouping of 15 items factored into three different subscales were named; traditional, psychosocial/environmental and income risk conditions. The next three scales were derived from an initial general health promotion statement scale, with 15 different items describing typical health promotion statements or statements suggestive of support for health promotion initiatives. The three scales were interpreted as prior action around: public and community actions, general health promotion actions and planning and evaluation. The unidimensionality of the Ottawa Charter action strategy scale was confirmed by PCA. PCA confirmed the unidimensionality of the following four health promotion scales: assessment, planning, implementation and evaluation. PCA analysis confirmed the undimensionality of desire to do health promotion general scale, public and community action and planning and evaluation.
Pearson correlation coefficient testing of the individual and organizational will scales revealed a bivariate component score correlation range of 0.000.67, for individual capacity scales and 0.000.79 for the organizational capacity scales significant at the 0.01 level (two-tailed) (see Tables 3 and 4).
|
|
| DISCUSSION |
|---|
|
|
|---|
The analyses indicate that both the individual and organizational will scales have good content and construct validity for measuring beliefs, prior action, confidence (at an individual level) and desire to promote health. The satisfactory results of these reliability and validity tests can be attributed to the strength of the face and content validity process undertaken by the other provincial heart health initiatives such as Saskatchewan, Ontario and Nova Scotia. This study contributes to the literature in that few instruments (Hawe et al., 2000
The organizational capacity instrument proved to be a challenge on many levels. First, it was difficult to write a statement that would guide the respondent to respond on behalf of the organization as a whole. On the desired scales we were limited to asking the respondent to indicate the level of involvement they would be satisfied with for the organization. Secondly, respondents appeared to find it difficult to reflect on the organization as a whole. This is in part due to the very large size of the RHAs and the potential for individuals' lack of knowledge about organizational will for health promotion. On the other-hand it may be hypothesized that if the will to do health promotion were an integral part of the organization, then employees would be aware of any actions, plans, etc., for health promotion. One might argue that if the organization had the will to do health promotion then it would be easier to respond to the organizational will statements.
The questionnaires are limited to perception, especially in terms of prior action and desire to promote health in that they only ask respondents what they perceive is happening without asking for specific evidence. Researchers may want to validate their findings with qualitative and auditing techniques such as review of documents (e.g. business plans and annual reports). If the will to do health promotion were an integral part of an organization, then one would expect that this would be reflected in such documents.
In assessing these results, several caveats need to be noted. Caution is advised when interpreting the analysis given the relatively small sample size (n = 144). While content and partial construct validity were established for each scale, continued research examining both individual and organizational will to do health promotion is needed to provide criterion-related validity. As these scales are relatively new, repeated administration for further refinement is warranted. For instance a testretest research design could assess instrument stability. Research on larger and more representative samples of workers from the health sector is recommended. A much larger sample size could also provide the ability to perform additional confirmatory factor analytical work required to further establish the construct validity of the measures. Given there are no gold standards for measurement of will to do health promotion (Ebbesen et al., 2004
) researchers may want to establish scale norms for the next generation of the instruments. Again, such work would require large and representative samples. Finally, research should also aim at developing a shortened version of the instruments in an attempt to minimize respondent burden.
Implications for practice
The instruments may be employed by health promotion practitioners who aim at increasing capacity to do health promotion, of which will is an essential component, at either an individual or organizational level. The scales may help identify gaps (i.e. specific areas where there is a lack of will) of individual and organizational will whether it be belief, confidence, desire or action. In return, focused interventions can be designed to increase will. The scores obtained from the tools can be used as a guide to planning by identifying individual and organizational strengths and weaknesses to do health promotion. Further, the scales have utility in assessing and tracking individual and organizational will longitudinally.
The will response scales are anchored at 1 and 5, with 1 reflecting a total absence, and 5 a strength or total presence of the component in question. Although the benchmarks for will to do health promotion have yet to be established, the authors suggest that a score lower than 2.5 may be considered as weak will, 2.53.5 an indication of a mediocre level of will, and scores greater than 3.5 a reflection of strong will. Identified domains with weak scores may be highlighted as key areas to focus on for in-service education sessions with front-line service providers. Senior and middle managers may use such results to guide planning for health promotion and target any identified weak areas.
The will scales can also be used in conjunction with infrastructure and leadership scales to test theoretical models of health promotion actions, such as the one presented in this paper. The development of such instruments is an important step towards the design of a more effective assessment of capacity.
| REFERENCES |
|---|
|
|
|---|
Advisory Board Third International Heart Health Conference (1998) The Singapore Declaration: Forging the Will for Heart Health in the Next Millenium. Singapore National Heart Association, Singapore.
Alberta Health (1990) Report of the Alberta Heart Health Survey, Edmonton, AB.
Bandura, A. (1986) Social Foundations of Thought and Action: A Social Cognitive Theory. Prentice Hall, Englewood Cliffs, NJ.
Bourke, S. F. (1984) The teaching and learning of mathematics. Monographs of ACER, 25, Australian Council of Education Research, Hawthron, VIC.
Dressendorfer, R. H., Raine, K., Dyck, R. J., Plotnikoff, R. C., Collins-Nakai, R. L., McLaughlin, W. K et al. (in press) A conceptual model of community capacity development for health promotion. Health Promotion Practice
Ebbesen, L., Heath, S., Naylor, P. J. and Anderson, D. (2004) Issues in measuring health promotion capacity in Canada: a multi-province perspective. Health Promotion International, 19, 8594.
Goodman, R. M., Speers, M. A., McLeroy, K., Fawcett, S., Kegler, M., Parker, E. et al. (1998) Identifying and defining the dimensions of community capacity to provide a basis for measurement. Health Education and Behaviour, 25, 258278.
Hair, J. F., Anderson, R. E., Tatham, R. L. and Black, W. C. (1992) In Easter, R. (ed.) Multivariate Data Analysis: With Readings, 3rd edition. Macmillan Publishing Company, New York, NY.
Hawe, P., Noort, M., King, L. and Jordens, C. (1997) Mutiplying health gains: the critical role of capacity building within health promotion programs. Health Policy, 39, 219.
Hawe, P., Noort, M., King, L., Jordens, C. and Lloyd, B. (2000) Indicators to help with capacity building in health promotion. http://www.health.nsw.gov.au/pubs/i/pdf/capbuild.pdf (last accessed August 2004)
Hollander, P. (1999) Political Will and Personal Belief. Yale University Press, London.
Kim, I. and Kim, M. I. (1996) The effects of individual and nursing-unit characteristics on willingness to adopt an innovation a multilevel analysis. Computers in Nursing, 14, 183187.[Web of Science][Medline]
May, G. G. (1982) Will and spirit. In: Willingness and Willfulness. Harper & Row San, Francisco, pp. 121.
Norusis, M. J. (1993) SPSS for Windows: Professional Statistics, Release 6.0. SPSS Inc., Chicago, IL, pp. 4782.
Plotnikoff, R. (1994) An application of protection motivation theory to coronary heart disease risk factor behaviour in three Australian samples: community adults, cardiac patients, and school children. PhD thesis, University of Newcastle, Australia.
Riley, B. L., Taylor, M. and Elliott, S. (2001a) Determinants of implementing heart health promotion activities in Ontario public health units: a social ecological perspective. Health Education Research, 16, 425441.
Riley, B., Eliott, S., Taylor, M., Cameron, R. and Walker, R. (2001b) Dissemination of heart health promotion: lessons from the Canadian Heart Health Initiative Ontario Project. Promotion and Education, Supplement 1, 2630.
Rogers, E. M. (1995) Diffusion of Innovations, 4th edition. Free Press, New York.
Smith, C., Raine, K., Anderson, D., Dyck, R., Plotnikoff, R., Ness, K. and McLaughlin, K. K. (2001) A preliminary examination of organizational capacity for heart health promotion in Alberta's Regional Health Authorities. International Journal of Health Promotion and Education, Supplement 1, 4043.
Tabachnick, B. and Fidell, L. (2001). Using Multivariate Statistics, 4th edition. HarperCollins College Publishers, New York.
World Health Organization (1986) Ottawa Charter for Health Promotion. World Health Organization, Health and Welfare Canada, & Canadian Public Health Association, Ottawa.
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
D. Anderson, K. D. Raine, R. C. Plotnikoff, K. Cook, L. Barrett, and C. Smith Baseline assessment of organizational capacity for health promotion within regional health authorities in Alberta, Canada Global Health Promotion, June 1, 2008; 15(2): 6 - 14. [Abstract] [PDF] |
||||
![]() |
M. F. Maclellan-Wright, D. Anderson, S. Barber, N. Smith, B. Cantin, R. Felix, and K. Raine The development of measures of community capacity for community-based funding programs in Canada Health Promot. Int., December 1, 2007; 22(4): 299 - 306. [Abstract] [Full Text] [PDF] |
||||
![]() |
N. Hanusaik, J. L O'Loughlin, N. Kishchuk, J. Eyles, K. Robinson, and R. Cameron Building the backbone for organisational research in public health systems: development of measures of organisational capacity for chronic disease prevention J Epidemiol Community Health, August 1, 2007; 61(8): 742 - 749. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||



