Health Promotion International Advance Access originally published online on November 29, 2006
Health Promotion International 2007 22(1):19-27; doi:10.1093/heapro/dal040
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
From innovation to practice: initiation, implementation and evaluation of a physician-based physical activity promotion programme in Finland
1 The UKK Institute for Health Promotion Research, Tampere, Finland 2 Kiipula Rehabilitation Centre, Turenki, Finland 3 Tampere School of Public Health, University of Tampere, Tampere, Finland 4 National Research and Development Centre for Welfare and Health (STAKES), Helsinki, Finland
Address for correspondence: Minna Aittasalo The UKK Institute for Health Promotion Research, PO Box 30 FI-33501 Tampere Finland E-mail: minna.aittasalo{at}uta.fi
| SUMMARY |
|---|
|
|
|---|
In 2001, a collaborative Physical Activity Prescription Programme (PAPP) was started in Finland to increase physical activity (PA) counselling among physicians, especially in primary care. This article describes the initiation, implementation and evaluation of PAPP.
Five actions were implemented to reach the programme goal: (i) developing a counselling approach for physicians; (ii) providing easy and open access to counselling material; (iii) facilitating physicians' uptake and adoption of the counselling approach; (iv) disseminating information about the counselling approach to physicians, health and exercise professionals and decision-makers and (v) raising financial resources to cover programme expenses. Evaluation was based on the dimensions of the RE-AIM framework: reach, effectiveness, adoption, implementation and maintenance. Effectiveness and adoption were evaluated with two questions added to the annual survey of the Finnish Medical Association to all practising physicians in the year 2002 (n = 16 692) and 2004 (n = 17 170).
The 4-year PAPP was successful in reaching health care units (Reach), accomplishing most of the implementation actions (Implementation) and initiating local projects for institutionalizing the prescription-based counselling approach, Prex (Maintenance). However, at the national level, the programme was not effective in increasing the frequency of asking about patients' PA habits (Effectiveness) or the frequency of using Prex or other written material in PA counselling among physicians (Adoption).
To improve the latter two, the duration of the programme would have had to be extended with more effort at strengthening physicians' confidence in PA counselling and knowledge about its effectiveness. Also, a more systematic approach would have been necessary to facilitate inter-sectoral network for adopting Prex as a counselling tool at the local level.
Key words: physical activity; promotion; primary health care; dissemination
| INTRODUCTION |
|---|
|
|
|---|
In 2001, a collaborative Physical Activity Prescription Programme (PAPP) was started in Finland to increase physical activity (PA) counselling among physicians, especially in primary care. The ultimate aim of the programme was to promote the health-enhancing PA (U.S. Department of Health and Human Services, 1996
The basic idea for PAPP was adapted from physician-based counselling interventions such as PACE in the United States (Patrick et al., 1994
), Active Practice in Australia (Smith et al., 2000
) and Green Prescription in New Zealand (Swinburn et al., 1998
). Similar programmes have also been conducted in Europe, for instance in the UK (Department of Health, 2001
) and in Sweden (www.blifysisktaktiv.nu). In most of the cases, the purpose was that the prescription, especially after having been proven scientifically effective, would become routine practice in primary health care. However, dissemination of prescriptions or other health promotion practices have seldom been reported (Oldenburg et al., 1999
; Eakin et al., 2005
). The purpose of this report is to remedy part of this deficit.
At first, the initiation of PAPP is described (Figure 1). Secondly, actions to reach the programme goal (Implementation) are illustrated. Thirdly, an evaluation based on the RE-AIM framework (Glasgow et al., 1999
) including five dimensionsreach, efficacy/effectiveness, adoption, implementation and maintenanceis reported (Table 1). The content of each dimension is explained with clarifying questions, which in this report are modified for PAPP and described in Figure 1 along with an overview of PAPP.
|
|
| INITIATION |
|---|
|
|
|---|
Since 1995, several actions have been accomplished to include PA in national health policies and recommendations in Finland (Ståhl et al., 2002
The programme goal was set to increase PA counselling among primary-care physicians working in municipal health centres (MHC), occupational health care (OHC), private clinics and rehabilitation centres. Physicians working in hospitals were a secondary target group due to the more acute nature or higher specialization of their tasks.
| IMPLEMENTATION |
|---|
|
|
|---|
Developing a counselling approach for physicians
A prescription form was chosen as the counselling approach due to time limits in physicians' appointments, differences in physicians' skills in providing counselling (Abramson et al., 2000
The prescription was to guide physicians to good counselling principles, derived from studies on health behaviour change (Prochaska and Velicer, 1997
), implementation of PA counselling (Laitakari and Miilunpalo, 1998
) and effectiveness of PA counselling in primary care (Eakin et al., 2000
). In the autumn of 2001 two prescription forms, a user's guide and a training protocol were produced and tested in a pilot study involving three MHC and two OHC units with 58 physicians. The final version of a form, Prex (www.liikkumisresepti.fi/physical activity prescription), was launched in February 2002 at a national medical congress. The counselling principles of Prex can be applied to the framework of 5 A's construct recommended for counselling in a health care setting (Estabrooks et al., 2003
; Goldstein et al., 2004
). In Prex, the assessment of current PA habits and statement on the sufficiency of PA represent assess and advice, goal setting and instructions agree, and additional advice and monitoring assist and arrange. Cooperation with municipal exercise services was emphasized as proposed recently (Hillsdon et al., 2005b
). A 10-page booklet, User's Guide, was prepared to enhance the adoption of the principles in clinical practice.
Providing easy and open access to the counselling material
The web pages for PAPP (www.liikkumisresepti.net) were opened in February 2002. Requests for printed material provided free of charge were dealt by one person in FMA. One User's Guide was attached to the block of 20 prescriptions. At the request of physicians, a PA-log for follow-up purposes was developed and printed.
The need for an electronic Prex soon became evident, especially in OHC, where majority of patient data is in electronic form. Negotiations with two companies producing and maintaining the two leading electronic patient record systems in Finland were started in 2002. In the meantime, a pdf form was attached to the PAPP website. Also, demo-software was produced for personal computers to speed up the negotiations and to make the installation of Prex possible for health care units maintaining their own electronic records.
Facilitating the uptake and adoption of the counselling approach
Training, recruiting of an opinion leader and producing evidence on the effectiveness of Prex were seen as primary approaches to lower the threshold for physicians' uptake of Prex. The training protocol included two modes: (i) peer-training (4 h) for physicians who were interested in introducing Prex to their colleagues and (ii) user's training (45 or 90 min), which the peer-trainers then arranged for their colleagues and local health care and exercise professionals. In both trainings the physicians practiced in completing Prex. Two members from the steering group provided the peer-training. The target was to recruit 1530 peers from all parts of the country mainly by advertisements in medical journals. The peer-trainers were provided with transparencies and PowerPoint presentation as well as with an overview of PA in various diseases, which was replaced in 2004 with an evidence-based web review (Kukkonen-Harjula and Vuori, 2004
). Peer-trainers' contact information was attached to PAPP websites.
Disseminating information about the counselling approach to physicians, health and exercise professionals and decision-makers
The role of the PAPP members and their networks was to introduce Prex in national and local health promotion meetings and events and in professional journals for health care and exercise specialists. Events arranged for physicians were given top priority but inter-professional meetings at the community and municipal level were also valued for the facilitation of local Prex projects. The members of PAPP involved in national health policy decision-making were to advocate Prex in health promotion meetings. Also, collaborators were searched for disseminating information to medical students.
Raising financial resources to cover PAPP expenses
The Finnish Rheumatism Association, as coordinator, was responsible of applying of funds for the programme, allocating it according to the needs (e.g. materials, peer-training, salary of the programme coordinator) and making the annual action plans and reports to the financial supporters.
| EVALUATION |
|---|
|
|
|---|
Reach
A total of 3048 blocks of prescriptions had been delivered by the end of 2004, 50% of them to MHC, 15% to OHC, 24% to local projects and 11% to hospitals, private clinics and rehabilitation centres. The number of MHC requesting material was 96, representing
34% of all the centres, the southern and western parts of Finland being the most actively interested. Regarding OHC the coverage was
7%.
Effectiveness
A question How many of your patients do you ask about their PA habits? adopted from Laitakari et al. (Laitakari et al., 1989
) was added to the annual surveys of FMA to all the registered physicians (address known, not retired) in 2002 (n = 16 692) at the time of launching Prex and in 2004 (n = 17 170), when it had been available for
2 years. The response alternatives were: (i) nearly all; (ii) two out of three; (iii) every second; (iv) one out of three; (v) fewer or none. Only physicians receiving patients at clinical appointments were asked to respond. The response rate was 85% (n = 14 155) in 2002 and 82% (n = 14 011) in 2004. A description of the respondents in 2002 (n = 12 945) is presented in Table 1.
In examining the change between the years, answer categories (i)(iv) were combined and only those (n = 9435) responding at both surveys were included. The proportion of physicians asking at least one out of three of their patients about PA habits was 64.9% in 2002 and 66.8% in 2004. Because of the large sample size this change of 1.9% units (95% CI 1.12.8) is statistically significant. Similar changes were found in all subgroups except for the youngest age group and those working in private clinics and OHC (Table 2). However, the clinical relevance of the quite modest changes can be questioned.
|
Adoption
Another question To how many patients do you give Prex or other written material to support verbal advice on PA?' was added to the FMA surveys in 2002 and 2004. The response alternatives, re-categorizing of the responses and the inclusion of the respondents (n = 8629) were the same as for the previous question. The proportion of physicians using Prex or other written material in PA counselling with at least one out of three patients was 12.2% in 2002 and 11.0% in 2004, indicating a statistically significant decline of 1.3% units (95%CI 2.0 to 0.5). The decrease can be seen in both genders and in the youngest and oldest age groups as well as in physicians working in MHC (Table 3). Again, the declines seem quite modest from the clinical point of view.
|
Implementation
Developing a counselling approach for physicians
The counselling approach developed seemed credible and acceptable: It was justified due to its resemblance to drug prescriptions, was developed in conjunction with physicians in a pilot study, was based on the prevailing evidence on health-enhancing PA and PA counselling, and the compliance with the counselling principles was enhanced with a User's Guide. In the further development of Prex, however, PAPP was not as successful: Negotiations with the electronic patient record system producers were prolonged and finally abandoned due, according to the producers, to insufficient customer demand.
Providing easy and open access to the counselling material
For Prex requests, PAPP was able to use the FMA, which was considered a well-established, well-known and reliable channel among physicians. The unexpectedly large number of requests illustrates that the material was easy to find and accessible.
Facilitating the uptake and adoption of the counselling approach
By the end of 2004, 76 peer-trainers from the most densely populated areas of Finland had participated in one of the four peer-trainings. The user's training was therefore within easy reach of the majority of health care units. Based on peer-trainers' self-reports, 898 physicians had participated in the user's training. Of these, 629 worked in MHC, representing
19% of all MHC physicians, and 129 worked in OHC, representing
16% of all OHC physicians. One of the peer-trainers took the role of an opinion leader. A randomized, controlled study on the effectiveness of Prex was started in 2002 with other funding.
Disseminating information about the counselling approach to physicians, health and exercise professionals and decision-makers
By the end of 2003, Prex had been introduced at 49 events involving altogether 3555 participants and in eight articles published in professional journals. Referrals were made in 69 newspaper articles, 33 articles in health and exercise magazines, eight articles in other magazines and seven TV and five radio programmes. Collaboration was started with the six Finnish Centres of Exercise Medicine, who provide training to medical students together with the universities. Furthermore, altogether 1480 information leaflets were mailed to physicians in hospitals, private clinics and rehabilitation centres.
Raising financial resources to cover PAPP expenses
Funding for 20012003 was annually applied for by the Finnish Rheumatism Association from the Ministry of Social Affairs and Health. Various other resources were needed for additional support and in 2003 funding for another year was deemed essential for institutionalization. During the period 20012004, a total of eight financial decisions were needed to cover the programme costs of 266 000 Euros, which included 117 600 Euros of the collaborative organizations' own funding (working hours of the steering group).
Maintenance
By the end of 2004, at least 14 local projects had been initiated based on the use of Prex. Seven of the projects represented southern Finland, four central and three eastern Finland. In most of them the purpose was to harmonize PA counselling practices in health care and to improve inter-sectoral cooperation. Prex was introduced as a recommended tool for PA counselling in two nationally important public health documents: Recommendations for promoting health-enhancing PA (Ministry of Social Affairs and Health, 2001) and Programme for the Prevention of Type 2 Diabetes (Finnish Diabetes Association, 2003
). The latter programme is being implemented in five of the 20 Finnish hospital districts during the period 20032007.
| DISCUSSION |
|---|
|
|
|---|
PAPP was successful in reaching the health care units (Reach), in accomplishing most of the implementation actions (Implementation) and in facilitating the initiation of local projects (Maintenance). However, at the national level among physicians, no increase from 2002 to 2004 could be observed in the frequency of asking about patients' PA habits (Effectiveness) or in the frequency of using Prex or other written material in PA counselling (Adoption). As stated by Glasgow et al. (Glasgow et al., 2002
In PAPP, taking into account the short duration of the active phase (2 years) as well as the modest human and financial resources, reaching 34% of MHC can be considered successful. The strengths involved in implementation were the pilot study, the opportunity to use well-known and respected channels for disseminating the counselling material and the large network of peer-trainers. The primary drawback was the failure to negotiate electronic Prex for patient record systems. From the maintenance point of view, the number of local inter-sectoral projects based on Prex was encouraging because coordination is needed to achieve more permanent changes in clinical practices (Haines and Donald, 1998
).
The modest outcomes in effectiveness and adoption may refer to at least three problems in their evaluation. First, the time perspective may have been too short. Studies concerning clinical guidelines indicate that the adoption process is slow (Haynes and Haines, 1998
) because numerous aspects influence health care providers' practices (Davis and Taylor-Vaisey, 1997
). Similar modest changes in physicians' PA counselling have been discovered earlier (Eakin et al., 2004
). Thus, possibility to add PAPP questions to FMA survey in 2007 should be explored.
Second, the survey data were based on physicians' self-reports, which may reflect what they should do rather than what they actually do (Brotons et al., 2005
) impairing the ability of self-reports to detect clinically relevant changes. However, in the study of Laitakari et al. (Laitakari et al., 1989
) the question proved quite conclusive in assessing health care professionals' counselling practices.
Third, the ultimate question is whether the implementation actions were selected appropriately for effectiveness and adoption. For effectiveness, more action may have been needed, especially at the beginning, to strengthen physicians' confidence in PA counselling and their knowledge of its effectiveness. The gaps in these are, after all, among the main barriers to physicians' counselling (Lawlor et al., 1999
; Abramson et al., 2000
). Information about the above-mentioned issues could have been disseminated through channels capable of reaching the majority of physicians (e.g. professional journals), although it is conceded that information alone is not powerful in changing practices (Baro et al., 1998
; Melin et al., 2005
). To be convincing, evidence about Prex should have been available (Wang et al., 2005
). In this respect, the results of our effectiveness study (Aittasalo et al., 2006
) came late.
In adoption, focusing on training seemed an appropriate approach, especially since physicians' peer-training seems effective (Davis and Taylor-Vaisey, 1997
). However, single training sessions were not enough to put Prex into practice and to facilitate inter-sectoral cooperation at local level, as confirmed also in recent studies (Sims et al., 2004
). Introducing ways of collaboration in the user's training and supporting the participants to tailor their own strategy may have led to better results (Cifuentes et al., 2005
; Woolf et al., 2005
). Furthermore, the administrators at the unit and district level should have been committed to Prex and cooperation, which is supported by literature on clinical guidelines (Haines and Donald, 1998
). Local cooperation may also have created more pressure for electronic Prex.
| CONCLUSIONS |
|---|
|
|
|---|
According to the evaluation framework of RE-AIM, PAPP was successful in reaching the health care units (Reach), accomplishing most of the implementation actions (Implementation) and initiating local projects for institutionalizing Prex (Maintenance). However, the programme was not effective in increasing the frequency of asking about patients' PA habits or the frequency of using Prex or other written material in PA counselling among physicians at the national level. To improve the latter two, the duration of the programme should have been extended and more effort should have been invested: (i) in strengthening physicians' confidence in PA counselling and knowledge about the effectiveness of PA counselling at the national level and (ii) facilitating inter-sectoral cooperation in adopting Prex as a counselling tool at the local and regional level.
| References |
|---|
|
|
|---|
Abramson S., Stein J., Schaufele M., Frates E., Rogan S. (2000) Personal exercise habits and counseling practices of primary care physicians: a national survey. Clinical Journal of Sports Medicine 10:4048.
Ainsworth B. E. and Youmans C. P. (2002) Tools for physical activity counselling in medical practice. Obesity Research 10:S69S75 suppl.[ISI][Medline]
Aittasalo M., Miilunpalo S., Kukkonen-Harjula K., Pasanen M. (2006) A randomized intervention of physical activity promotion and patient self-monitoring in primary health care. Preventive Medicine 42:4046.[CrossRef][ISI][Medline]
Anis N. A., Lee R. E., Ellerbeck E. F., Nazir N., Greiner K. A., Ahluwalia J. S. (2004) Direct observation of physician counseling on dietary habits and exercise: patient, physician, and office correlates. Preventive Medicine 38:198202.[CrossRef][ISI][Medline]
Baro L. A., Grilli R., Grimshaw J. M., Harvey E., Oxman A. D., Thomson M. A. (1998) Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. British Medical Journal 317:465468.
Brotons C., Björkelund C., Bulc M., Ciurana R., Godycki-Cwirko M., Jurgova E., et al. (2005) Prevention and health promotion in clinical practice: the views of general practitioners in Europe. Preventive Medicine 40:595601.[CrossRef][ISI][Medline]
Calfas K. J., Long B. J., Sallis J. F., Wooten W. J., Pratt M., Patrick K. (1996) A controlled trial of physician counseling to promote the adoption of physical activity. Preventive Medicine 25:225233.[CrossRef][ISI][Medline]
Cifuentes M., Fernald D. H., Green L. A., Niebauer L. J., Crabtree B. F., Stange K. C., et al. (2005) Prescription for health: changing primary care practice to foster healthy behaviours. Annals of Family Medicine 3:S4S11 suppl.
Davis D. A. and Taylor-Vaisey A. (1997) Translating guidelines into practice. A systematic review of theoretic concepts, practical experience and research evidence in the adoption of clinical practice guidelines. Canadian Medical Association Journal 157:408416.[Abstract]
Department of Health. (2001) Exercise Referral Systems: A National Quality Assurance Framework(Department of Health, London, UK).
Eakin E. G., Glasgow R. E., Riley K. M. (2000) Review of primary care-based physical activity intervention studies. Journal of Family Practice 49:158168.[ISI][Medline]
Eakin E. G., Brown W. J., Marshall A. L., Mummery K., Larsen E. (2004) Physical activity promotion in primary care: bridging the gap between research and practice. American Journal of Preventive Medicine 27:297303.[ISI][Medline]
Eakin E. G., Smith B. J., Bauman A. E. (2005) Evaluating the population health impact of physical activity interventions in primary careare we asking the right questions? Journal of Physical Activity and Health 2:197215.
Estabrooks P. A., Glasgow R. E., Dzewaltowski D. A. (2003) Physical activity promotion through primary health care. JAMA 289:29132916.
Estabrooks P. A. and Gyurcsik N. C. (2003) Evaluating the impact of behavioural interventions that target physical activity: issues of generalizability and public health. Psychology of Sports and Exercise 4:4155.[CrossRef]
Finnish Diabetes Association. (2003) DEHKO Development Programme for the Prevention and Care of Diabetes in Finland 20002010. Programme for the Prevention of Type 2 Diabetes in Finland 20032010. Gummerus Printing, Jyväskylä, Finland www.diabetes.fi).
Glasgow R. E., Vogt T. M., Boles S. M. (1999) Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health 89:13221327.
Glasgow R. E., Bull S. S., Gillette C., Klesges L. M., Dzewaltowski D. A. (2002) Behavior change intervention research in health care settings. A review of recent reports with emphasis on external validity. American Journal of Preventive Medicine 23:6269.[CrossRef][ISI][Medline]
Goldstein M. G., Whitlock E. P., DePue J. (2004) Multiple behavioural risk factor interventions in primary health care. Summary of research evidence. American Journal of Preventive Medicine 27:6179 suppl.[Medline]
Haines A. and Donald A. (1998) Making better use of research findings. British Medical Journal 317:7275.
Haynes B. and Haines A. (1998) Barriers and bridges to evidence based clinical practice. British Medical Journal 317:273276.
Helakorpi S., Patja K., Prättälä R., Aro A. R., Uutela A. (2005) Health Behaviour and Health Among the Finnish Adult Population(Publications of the National Public Health Institute B 13/2004, Helsinki, Finland) www.ktl.fi).
Hillsdon M., Foster C., Naidoo B., Crombie H. (2005a) The Effectiveness of Public Health Interventions for Increasing Physical Activity Among Adults: A Review of Reviews 2nd edition (Health Development Agency, London) (www.hda.nhs.uk/evidence).
Hillsdon M., Foster C., Thorogood M. (2005b) Interventions for promoting physical activity. Cochrane Database Systematic Reviews 1CD003180.
Kukkonen-Harjula K. and Vuori I. (2004) Physical activity in the prevention, treatment and rehabilitation of diseases. In Database (requires a password). Evidence-Based Medicine GuidelinesJohn Wiley & Sons Ltd (www.ebm-guidelines.com).
Laitakari J., Miilunpalo S., Pasanen M., Vuori I. (1989) Health Education in Finnish Health Centers Series Original Reports 6 (Publications of the National Board of Health, Helsinki, Finland) In Finnish with English summary.
Laitakari J. and Miilunpalo S. (1998) How can physical activity be changedBasic concepts and general principles in the promotion of health-related physical activity. Patient Education and Counseling 33:S47S59 suppl.[CrossRef][ISI][Medline]
Lawlor D. A., Keen S., Neal R. D. (1999) Increasing population levels of physical activity through primary care: GP's knowledge, attitudes and self-reported practice. Family Practice 16:250254.
Melin I., Karlström B., Berglund L., Zamfir M., Rössner S. (2005) Education and supervision of health care professionals to initiate, implement and improve management of obesity. Patient Education and Counseling 58:127136.[CrossRef][ISI][Medline]
Miilunpalo S., Laitakari J., Vuori I. (1995) Strengths and weaknesses in health counselling in Finnish primary health care. Patient Education and Counseling 25:317328.[CrossRef][ISI][Medline]
Ministry of Social Affairs Health. (2001) Report by the Committee on Development of Health-Enhancing Physical Activity (Edita Publishing Ltd, Helsinki, Finland) (In Finnish with English summary). Committee Reports 2001:12, STM0760:00/15/06/2000, (www.stm.fi).
Morgan O. (2005) Approaches to increase physical activity: reviewing the evidence for exercise-referral schemes. Public Health 119:361370.[CrossRef][ISI][Medline]
Oldenburg B. F., Sallis J. F., French M. L., Owen N. (1999) Health promotion research and the diffusion and institutionalization of interventions. Health Education Research 14:121130.
Patrick K., Sallis J. F., Long B., Calfas K. J., Wooten W., Heath G., et al. (1994) A new tool for encouraging activity. Project PACE. The Physician and Sports Medicine 22:4555.
Podl T. R., Goodwin M. A., Kikano G. E., Stange K. C. (1999) Direct observation of exercise counseling in community family practice. American Journal of Preventive Medicine 17:207210.[CrossRef][ISI][Medline]
Prochaska J. O. and Velicer W. F. (1997) The transtheoretical model of health behavior change. American Journal of Health Promotion 12:3848.[ISI][Medline]
Sims J., Huang N., Pietsch J., Naccarella L. (2004) The Victorian Active Script Programme: promising signs for general practitioners, population health, and the promotion of physical activity. British Journal of Sports Medicine 38:1925.
Smith B. J., Bauman A. E., Bull F. C., Booth M. L., Harris M. F. (2000) Promoting physical activity in general practice: a controlled trial of written advice and information materials. British Journal of Sports Medicine 34:262267.
Ståhl T., Rütten A., Nutbeam D., Kannas L. (2002) The importance of policy orientation and environment on physical activity participation a comparative analysis between Eastern Germany, Western Germany and Finland. Health Promotion International 17:235246.
Swinburn B. A., Walter L. G., Arroll B., Tilyard M. W., Russell D. G. (1998) The green prescription study: a randomised controlled trial of written exercise advice provided by general practitioners. American Journal of Public Health 88:288291.
U.S. Department of Health and Human Services. (1996) Physical Activity and Health: A Report of the Surgeon General , Atlanta, GA, USA.
Wang S., Moss J. R., Hiller J. E. (2005) Applicability and transferability of interventions in evidence-based public health. Health Promotion International 21:7683.
Woolf S. H., Glasgow R. E., Krist A., Bartz C., Flocke S. A., Holtrop J. S., et al. (2005) Putting it together: finding success in behaviour change trough integration of services. Annals of Family Medicine. 3:S20S27 suppl.
![]()
CiteULike
Connotea
Del.icio.us What's this?
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
