- Open Access
Needs assessment: towards a more responsive Canadian Society of Nephrology Annual General Meeting (CSN AGM) program
© Cohen et al. 2016
- Received: 6 January 2016
- Accepted: 19 April 2016
- Published: 24 June 2016
A critical feature of any continuing medical education (CME) program is the inclusion of a needs assessment for its target audience. This assessment must identify both perceived and unperceived needs, so as to best capture the entire spectrum of learning opportunities for the group.
We describe the process developed by the Canadian Society of Nephrology (CSN) to enhance the educational effectiveness of its Annual General Meeting program.
The design of this study is the analysis of a survey questionnaire and of the Canadian Organ Replacement Registry (CORR) database.
We surveyed members of the CSN and analyzed patient data from CORR aggregated by center.
We tabulated votes in the survey by topic. We assessed the extent to which centers achieved CSN guideline targets on the clinical management of patients on dialysis.
Perceived needs: a CSN panel constructed a list of topics, which was amplified by the inclusion of topics based on members’ text responses to open-ended questions during previous iterations of this process. CSN members specified their top five choices, using an online survey instrument. Unperceived needs: an expert panel determined achievable thresholds for a number of quality metrics associated with dialysis. The quality metrics were identified from CSN guidelines. Using patient data in the CORR database, we generated center-specific performance estimates for each quality metric and constructed ratios comparing the performance of each center with the achievable threshold. We triangulated the results of the two assessments.
The response rate for the perceived needs assessment survey was 16 %. This assessment identified “Primary and Secondary Glomerulonephritis” as the non-dialysis topics and “Infectious Complications of Dialysis Access” and “Volume Status and Hypertension on Dialysis” as the dialysis topics with the highest perceived learning needs. In the unperceived needs assessment, “Vascular Access Type” and “Vascular Access Monitoring” were identified as having the highest learning needs. Triangulation identified “Vascular Access Type” and “Vascular Access Monitoring” as high needs topics.
Perceived needs assessment: Some topics were much more general than others, which could have led to over-selection. The response rate of 16 % limits the robustness of generalization to the membership as a whole or to all meeting attendees.
Unperceived needs assessment: The assessment was limited by the data that CORR actually collects; many aspects of general nephrology practice, including glomerulonephritis, are not covered. The level of evidence underlying the various guidelines was variable, and in some cases, poor. A validated approach to data analysis in this area is lacking.
To our knowledge, this is the first published example of a needs assessment for a nephrology CME event that considers both the perceived and unperceived needs of the membership. The results of this exercise are currently being used to assist in the development of a more responsive CME program.
Un aspect crucial de tout programme d’enseignement médical continu (EMC) est l’inclusion d’une évaluation des besoins de la clientèle cible. Cet examen se doit de permettre l’identification tant des besoins perçus que des besoins non perçus afin de mieux cerner les occasions d’apprentissage pour le groupe.
Objectifs de l’étude
Cet article fait la description de la démarche mise au point par la Société de Néphrologie du Canada (SNC) dans le cadre du programme de son assemblée générale annuelle. Cette démarche vise accroître l’efficacité de la formation.
Plan de l’étude
On a procédé à l’analyse des réponses obtenues lors d’une enquête auprès des membres ainsi qu’à la consultation des métadonnées du Registre Canadien des Insuffisances et des Transplantations d’Organes (RCITO).
Le sondage a été mené auprès des membres de la SCN et on a procédé à l’examen des données du RCITO cumulées dans chaque centre de soins.
La compilation des réponses au sondage a été effectuée par catégories. Nous avons également évalué dans quelle mesure avaient été atteints les objectifs d’orientation fixés par les lignes directrices de la SCN quant à la conduite du traitement clinique des patients sous dialyse.
Un premier volet s’attardait à définir les besoins perçus. Pour ce faire, le comité de la SCN a dressé une liste de thèmes. Cette liste s’est par la suite allongée avec l’ajout de sujets tirés des réponses des membres aux questions ouvertes colligées lors des versions antérieures du sondage. Les membres de la SCN ont spécifié les cinq thèmes qu’ils jugeaient les plus importants par le biais d’un instrument de sondage en ligne. Un second volet se penchait sur les besoins non perçus. Dans ce deuxième cas, un groupe d’experts a déterminé les seuils réalisables pour un certain nombre de paramètres de la qualité associés à la dialyse. L’identification de ces paramètres était tirée des lignes directrices de la SCN. À l’aide des données des patients contenues dans le RCITO, une appréciation de la performance de chaque centre de soins a été produite pour chacun des paramètres identifiés. Des ratios ont ensuite été construits en comparant la performance de chaque centre de soins avec le seuil réalisable établi précédemment. De plus, les résultats des deux analyses ont été triangulés.
Le taux de réponse pour le sondage sur l’analyse des besoins perçus a été de 16 %. Cet examen a permis d’identifier les besoins perçus à considérer en matière de formation pour les futurs néphrologues. Du côté des sujets non reliés directement à la dialyse elle-même, on retrouve la glomérulonéphrite primaire et secondaire ainsi que les complications infectieuses liées au cathéter. Quant aux sujets directement reliés à la dialyse, on a pu identifier la volémie et l’hypertension en dialyse. En ce qui concerne les besoins non perçus, le type d’accès vasculaire et la surveillance de celui-ci ont été identifiés comme étant des sujets important à couvrir lors de la formation. Ces deux derniers sujets sont également ressortis comme très importants à considérer dans les besoins de formation lors de la triangulation des résultats.
Limites de l’étude
Dans le cas des besoins perçus, certains sujets étaient de nature très générale et ceci pourrait avoir conduit à une sélection excessive. Qui plus est, le très faible taux de réponse limite la robustesse d’une généralisation des résultats à tous les membres ayant participé à l’assemblée. Du côté des besoins non perçus, l’analyse est limitée par les données du RCITO où plusieurs aspects de la pratique générale en néphrologie, notamment la prise en charge de la glomérulonéphrite, ne sont pas couverts. Le degré d’éléments probants sous-jacent les différents principes directeurs s’est avéré variable et dans certains cas, médiocre. Une approche validée face à l’analyse des données dans ce domaine est manquante.
À notre connaissance, cette enquête constitue la première analyse publiée des besoins, réalisée lors d’un événement d’EMC en néphrologie, qui prend en considération les besoins perçus et non perçus de ses membres. Les résultats de cet exercice sont actuellement utilisés dans le développement d’un programme d’EMC mieux adapté.
- Needs assessment
- Perceived needs
- Unperceived needs
- Environmental scan
- Continuing medical education
A needs assessment of the target audience improves the effectiveness of any continuing medical education program. This should include an assessment of both perceived and unperceived needs. For this reason, the Royal College of Physicians and Surgeons of Canada (RCPSC) has made the inclusion of such an assessment a requirement for accreditation.
A needs assessment that considers both perceived and unperceived needs can be conducted for the Canadian Society of Nephrology in order to enhance the effectiveness of its Annual General Meeting program. This assessment has identified several specific topics that should be discussed at this meeting.
The primary purpose of continuing medical education (CME) is to enhance physicians’ knowledge and behavior in their respective fields, in order to improve patient health outcomes. As such, improvements in health outcomes, not increases in physician knowledge, are the ultimate goals of any CME program. A number of factors have been shown to improve the effectiveness of a CME program, including interactive programming (as opposed to didactic), inclusion of enabling, knowledge translation factors (e.g., patient educational materials), and longitudinal programming; additionally, that programming is based on a needs assessment [1–3].
Indeed, the importance of a needs assessment to CME has been known for more than a generation. In 1977, Bertram and Brooks-Bertram stated that “the gross failure to demonstrate effectiveness of CME is chiefly due to failure to identify the learning needs of practitioners and the health needs of their patients as well as inadequate evaluation methods” . This claim has been echoed by multiple authors [1–3].
A needs assessment can be defined as a systematic process designed to collect and analyze information as to the specific learning needs of a particular group; the activity must therefore focus on this target group. A learning need may be defined as the measured gap between an individual’s (or group’s) current knowledge as compared to either (i) an agreed-upon level of knowledge (optimal knowledge) or importance of such knowledge or (ii) a gap between an accepted standard of practice and an individual’s current level of practice. Perceived needs are the self-identified learning needs of the target group (i.e., the “wants” of the group). They are subjectively determined and are best exemplified by the phrase, “I know what I don’t know.” Unperceived needs represent discrepancies not perceived by the learners; they are objectively determined and are best exemplified by the phrase, “What I don’t know that I don’t know” [1, 5].
In 2009, the Royal College of Physicians and Surgeons of Canada (RCPSC) instructed the Canadian Society of Nephrology (CSN) to conduct a learning needs assessment of the CSN membership, as part of the development of the CSN Annual General Meeting (AGM), in order to meet the accreditation requirement, as per Standard 5 of the RCPSC Accreditation Guide for Continuing Professional Development (CPD) Events for Specialists. This standard further states that there must be a balance between perceived and unperceived needs, which should include strategies to identify practice standards .
The Education Committee of the CSN (EC-CSN) subsequently developed the required needs assessment tool during 2010 and 2011 and first utilized it in the planning of the 2012 AGM. What follows is a description of the development of the needs assessment tool, as well as the results of its most recent application.
Assessment of the target group’s unperceived needs was facilitated using an environmental scan—the Canadian Organ Replacement Registry (CORR)—which tracks demographic and clinical variables of all Canadian chronic dialysis patients, including variables to assess, such as anemia management, diabetes management, and prevalent fistula rates . Clinical outcomes of these variables were reviewed by the EC-CSN, and areas where targets were not achieved were identified as unperceived learning needs.
Various national nephrology societies (e.g., the CSN, the National Kidney Foundation (NKF)) publish guidelines for management of patients with kidney disease, on dialysis or otherwise. Medical experts from these societies systematically review the literature, rank the level of evidence, and if there is no evidence, they form an opinion statement by consensus. The guidelines are then rated on the strength to which they are recommended; for an example, see the KDOQI Clinical Practice Guideline for Hemodialysis Adequacy: 2015 Update . The societies then disseminate their guidelines via their websites, the published literature, and continuing medical education events. While individual nephrologists often disagree with many of the recommendations put forth by these guidelines, knowledge of these guidelines is integral to the practice of nephrology in Canada. As such, failure to achieve targets described in these guidelines may indicate either disagreement with them, or lack of knowledge of these guidelines, and in turn with the subject matter and literature that subsumes them.
Prevalent hemodialysis patients using each of fistulae, grafts, and catheters as their form of vascular access
Prevalent hemodialysis patients with fistulae/grafts who are monitored via access flow or recirculation techniques
Prevalent hemodialysis patients with a sessional Kt/V above 1.2
Prevalent peritoneal dialysis (PD) patients with a weekly Kt/V (PD + renal) above 1.7
Prevalent dialysis patients with a predialysis hemoglobin concentration of 100–120 g/L
Prevalent dialysis patients with a transferrin saturation of 20–50 %
Prevalent dialysis patients with a ferritin concentration of 100–800 ng/mL
Prevalent dialysis patients with a predialysis corrected calcium concentration of 2.1–2.54 mmol/L
Prevalent dialysis patients with a predialysis phosphate concentration of 1.13–1.78 mmol/L
Prevalent dialysis patients with a parathyroid hormone concentration of 16.5–33.0 pmol/L
Prevalent dialysis patients achieving none of the three targets in mineral metabolism
Prevalent diabetic dialysis patients with a HgbA1c less than 7.0 %
Acceptable guideline target achievement rates by parameter, within dialysis units
Acceptable guideline target achievement rate (%)
Prevalent HD pts using fistulae
Prevalent HD pts using catheters
Prevalent HD pts monitored via Qa
Prevalent HD pts monitored via Recirc
Prevalent HD pts not monitored
Prevalent HD pts with sessional Kt/V >1.2
Prevalent PD pts with weekly Kt/V (PD + renal) >1.7
Prevalent dialysis pts; [Hgb] 100–120 g/L
Prevalent dialysis pts; tsat 20–50 %
Prevalent dialysis pts; [ferritin] 100–800 ng/mL
Prevalent dialysis pts; [Ca] 2.1–2.54 mmol/L
Prevalent dialysis pts; [PO4] 1.13–1.78 mmol/L
Prevalent dialysis pts; [PTH] 16.5–33.0 pmol/L
Prevalent dialysis pts; 0 in target
Prevalent dialysis pts; HgbA1c <7.0 %
Comparison of perceived and unperceived needs assessments
The validity of a needs assessment is improved by using multiple methods to assess for these needs and then by comparing the results obtained by each method. This process is referred to as “triangulation.” A number of chronic dialysis-related topics were assessable by multiple methods—questionnaire and achievement of guideline targets; these topics included vascular access type, vascular access monitoring, adequacy, anemia, mineral metabolism, and metabolic issues (e.g., diabetes control). Based on the methods described in sections A and B above, each of the chronic dialysis-related topics was rated as either “high needs,” “intermediate needs,” or “low needs” for each of the perceived and unperceived needs assessments. The results of the two assessments were then compared, qualitatively, in order to define the overall need.
Perceived needs assessment
Perceived needs assessment for the 2016 CSN AGM
% of all votes
Volume Status and Hypertension in Dialysis
Dialysis Access – Infectious Complications (HD and PD)
Dialysis Program Administration
Cardiovascular Disease in CKD and Dialysis
Hemodialysis Access – timing, selection, surveillance, intervention
Outcomes in Dialysis including Adequacy and Timing
Dialysis Modality Selection
Exercise/Rehab in CKD and Dialysis
Anemia Management in CKD and Dialysis
Mineral Metabolism in CKD and Dialysis
Nutrition in CKD and Dialysis
Metabolic Issues in CKD and Dialysis – lipids, diabetes
Psychosocial Issues and Palliative Care in Nephrology
OTHER: Acute Dialysis Modality Selection
Perceived needs assessment for the 2016 CSN AGM
% of all votes
General CKD prevention – proteinuria, lipids, BP
Transplant Issues for the General Nephrologist
Ethics in Nephrology
Pregnancy and Renal Disease
Ischemic Nephropathy and Renovascular Hypertension
ARF/AKI – Staging and Therapy
Genetic Diseases including PCKD
Radiographic Interventions and the Kidney
Management of Overdoses
General CKD Staging – Scr, Ccr, Cockcroft-Gault, eGFR
OTHER: CKD Screening
OTHER: Renal Pathology
Unperceived needs assessment
Unperceived needs assessment for the 2016 CSN AGM—achievement rates for various guidelines targets
Centers submitting data
Centers with an acceptable guideline target achievement rate
Percentage of centers with an acceptable guideline target achievement rate
1. HD access
Total access rate
2. Access monitoring
0 in target—HD
0 in target—PD
As can be seen from the first column, there are six broad areas where data and guidelines are available—hemodialysis access, access monitoring, adequacy, anemia, mineral metabolism, and diabetes mellitus. Within each broad area, there are between two and eight individual parameters for which data are available. Within each of these six broad areas, the totals for each parameter are summed, and an overall achievement rate for each broad area has been calculated—shown in boldface.
Triangulation—comparison of perceived and unperceived needs assessments
Triangulation of needs assessment for dialysis topics
Achievement of guideline targets
Vascular access type
Metabolic issues (DM)
The EC-CSN is in the process of using the results of the above described needs assessment in the planning of the 2016 CSN AGM. As mentioned, the issues with the highest identified perceived and/or unperceived learning needs include topics related to glomerulonephritis and to vascular access on dialysis.
To our knowledge, this is the first published example of a needs assessment for a nephrology CME event that considers both perceived and unperceived needs. That being said, there are numerous published examples of needs assessments for CME. Most of these are perceived needs assessments that utilize survey questionnaires, including Curran et al. in 2007 (family medicine CME in Canada) , Turner et al. in 2006 (multiple sclerosis in the USA) , Turner et al. in 2004 (occupational medicine) , and Purdy in 2002 (migraine) . Dupuis et al. conducted a perceived needs assessment related to Crohn’s disease that utilized a triangulated, mixed-method approach—questionnaire plus semi-structured interview .
There are also examples of unperceived needs assessments for CME: Aeschilmann et al. utilized a multiple choice quiz to assess learning needs for rheumatology CME . Klein et al. utilized an environmental scan, in the form of an electronic clinical practice audit, to conduct their needs assessment for family medicine CME in Canada . Finally, Laidlaw et al. conducted a needs assessment of general practitioners for malignant melanoma that utilized multiple methods and considered both perceived and unperceived needs—surveys of general practitioners and specialists (perceived needs), plus literature review and advisory group recommendation review (unperceived needs) .
There are a number of accepted techniques for conducting perceived needs assessments for CME. The tool most commonly used is the survey questionnaire, which elicits written responses to multiple questions. Strengths of this technique include efficiency in terms of material and human resources, their ability to address a wide range of topics, and the fact that the information can be returned in a standardized fashion (if, for example, multiple choice questions are used). Conversely, problems can arise when response rates are low (sometimes necessitating expensive follow-up efforts) and if the surveys themselves are poorly constructed . The EC-CSN selected this method for its perceived needs assessment because of these indicated strengths.
Additional published strategies for perceived needs assessments include interviews and focus groups (“group interviews”). These methods acquire personalized, in-depth information; in focus groups, members draw from one another to enhance the information provided. These, however, are very time-consuming and resource-intensive to conduct . For these latter reasons, the EC-CSN did not utilize these techniques.
There are also a number of accepted strategies for conducting unperceived needs assessments for CME. A popular one is the environmental scan. For this technique, existing information/documents are scanned unobtrusively for learning needs. These documents could include minutes of meetings, chart audits, attendance data, national databases, published guidelines of care, and literature searches, among others. A major strength of this technique lies in its economical sources of data, i.e., documents have already been produced for another purpose, and so no new expenditures are required. Further, a wide spectrum of data is available, the data are often generated iteratively, and it can be scanned unobtrusively. On the other hand, weaknesses include data that may be too broadly defined, too time-consuming and costly to analyze, and the fact that there can be political interference with accessing/analyzing the data [5, 20]. The CORR database was deemed an ideal selection for data as it was freely offered for review by its governing board (in a de-politicized manner), and no costs were attached to its review.
Other published strategies for unperceived needs assessments include chart audits and pre-course testing. These provide objective information but can be very time-consuming to conduct [5, 16]. For these reasons, the EC-CSN did not utilize these techniques.
Finally, the published literature suggests that the validity of the needs assessment is increased if multiple techniques are used, and the results of these techniques are compared—a process known as triangulation . Our study utilizes such a technique which we feel strengthens our results in terms of validity.
There are a number of strengths to the present study. It represents the first published study of a needs assessment for a nephrology CME event that considers both perceived and unperceived needs. It therefore demonstrates that such work can be done in order to enhance the delivery of nephrology CME. Second, for the perceived needs assessment, a reasonably representative sample of Canadian nephrologists—171 individuals—responded to the survey, enhancing its validity. Third, for the unperceived needs assessment, a robust database that represents dialysis practice throughout Canada was available for analysis. Fourth, triangulation of the different methods utilized was performed, further enhancing the validity of the work.
We acknowledge that there are some limitations to the study. For the perceived needs assessment, the topics for the survey were determined by the EC-CSN after much discussion; that said, some of the topics were much more general (e.g., “Dialysis Outcomes”), and others were very specific (e.g., “Radiographic Interventions and the Kidney”). This could have led to some topics being selected more than others by the respondents.
Perhaps the greatest limitation of the unperceived needs assessment is the lack of a standard, validated, published approach for conducting it. The environmental scan, in a general sense, is a validated method, particularly for qualitative data ; however, we could identify no standard approach for handling this kind of data. That said, we feel that the method we devised was reasonable—we believe that the panel of experts was able to assess the factors that detract from perfect guideline target achievement and to determine if those factors were nephrologist-related or not. Second, the results were dependent on the availability of CORR data. CORR does not generate data for the non-dialysis-related topics, so the survey results for these topics could not be triangulated with any known reference. Third, the authors concede that the level of evidence cited within published guidelines can be poor; for example, KDOQI’s minimum acceptable target for urea clearance (a single pool Kt/V of 1.2 for thrice weekly dialysis) reflects grade 1B level evidence .
A third possible weakness in the unperceived needs assessment is that the targets set by the panel of experts were chosen because they were what the panel felt to be reasonable but were not correlated with patient outcomes. Indeed, the literature does include a number of studies that look at the extent to which achievement of guideline targets predicts outcome. Djukanovic et al. demonstrated that the failure to achieve KDOQI targets for Kt/V, hemoglobin, and PTH was associated with an increased relative risk of time to death in a Serbian hemodialysis population . Anton-Perez et al. demonstrated an inability to meet KDOQI vascular access targets in a Spanish population and showed that this was independently associated with high mortality . On the other hand, Tangri et al. not only demonstrated variable guideline target achievement for various mineral metabolism factors (calcium, phosphate, PTH) in a British renal registry (hemodialysis plus peritoneal dialysis) but also showed that those patients who achieved guideline targets did not have a survival advantage . As such, in our view, there is insufficient evidence in the literature to support the use of outcome-based targets for our needs assessment—not all guidelines are addressed, and those that are addressed arrive at inconsistent conclusions.
For part C, triangulation, as for the unperceived needs assessment, there is no validated, published approach for triangulating this kind of data. Most of the published literature that describes triangulation methods for needs assessments involves qualitative data and utilizes analysis of themes derived from such data sources as interviews and focus groups [15, 18]. We do feel, however, that our method of comparing the rank order of the various topics identified by the two assessment methods is reasonable. Second, the triangulation was performed on data that was not quite contemporaneous: The unperceived needs assessment was conducted on data obtained as of December 2013; the survey questionnaire (perceived needs) was administered in April 2015. This was done in order to use the most current data possible when planning the meeting. The likelihood that this introduced significant error is low because (a) the datasets differ only by 16 months and (b) the results of the unperceived needs assessment have not changed very much over the 5 years that this assessment has been conducted.
In conclusion, this paper demonstrates that a multi-method needs assessment strategy, that addresses both perceived and unperceived needs, can be generated and applied, so as to enhance the quality of nephrology CME in Canada.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Laxdal OE. Needs assessment in continuing medical education: a practical guide. J Med Educ. 1982;57:827–34.PubMedGoogle Scholar
- Davis D, Thomson M-A, Freemantle N, Wolf FM, Mazmanian P, Taylor-Vaisey A. Impact of formal continuing medical education—do conferences, workshops, rounds, and other traditional continuing education activities change physician behavior or health care outcomes? JAMA. 1999;282(9):867–74.View ArticlePubMedGoogle Scholar
- Davis DA, Thomson MA, Oxman A, Haynes B. Changing physician performance—a systematic review of the effect of continuing medical education strategies. JAMA. 1995;274(9):700–5.View ArticlePubMedGoogle Scholar
- Bertram DA, Brooks-Bertram P. The evaluation of continuing medical education: a literature review. Health Educ Monogr. 1977;5:330–62.View ArticlePubMedGoogle Scholar
- Ratnapalan S, Hilliard RI. Needs assessment in postgraduate medical education: a review. Med Educ Online. 2002;7:1–8.View ArticleGoogle Scholar
- The Royal College of Physicians and Surgeons of Canada Accreditation Guide for Continuing Professional Development (CPD) Events for Specialists. Part B—planning and provision of educational services. Standard %—assessment of needs. 2009. p. 14–8.Google Scholar
- The Royal College of Physicians and Surgeons of Canada. Syllabus of training objectives for nephrology trainees—medical expert role. https://collab.royalcollege.ca/share/page/site/SCinNephrology/document-details?nodeRef=workspace://SpacesStore/ic56037a-12el-4c5c-9342-860ceaf564. Accessed March/April, 2010.
- Moist LM, Fenton S, Kim JS, Gill JS, Ivis F, de Sa E, et al. Canadian Organ Replacement Register (CORR): reflecting the past and embracing the future. Can J Kidney Health Dis. 2014;1:26.View ArticlePubMedPubMed CentralGoogle Scholar
- Foundation NK. KDOQI clinical practice guideline for hemodialysis adequacy: 2015 update. Am J Kidney Dis. 2015;66(5):884–930.View ArticleGoogle Scholar
- Canadian Institute for Health Information. Canadian Organ Replacement Registry annual report: treatment of end-stage organ failure in Canada, 2004 to 2013. Ottawa, ON: CIHI; 2015.Google Scholar
- Curran VR, Keegan D, Parsons W, Rideout G, Tannenbaum D, Dumoulin N, et al. A comparative analysis of the perceived continuing medical education needs of a cohort of rural and urban Canadian family physicians. Can J Rural Med. 2007;12(3):161–6.PubMedGoogle Scholar
- Turner AP, Martin C, Williams RM, Gougreau K, Bowen JD, Hatzakis Jr M, et al. Exploring educational needs of multiple sclerosis care providers: results of a care-provider survey. J Rehabil Res Dev. 2006;43(1):25–34.View ArticlePubMedGoogle Scholar
- Turner S, Hobson J, D’Auria D, Beach J. Continuing professional development of occupational medicine practitioners: a needs assessment. Occup Med (Lond). 2004;54(1):14–20.View ArticleGoogle Scholar
- Purdy RA. Migraine: the doctor-patient link. Results of a needs assessment. Can J Neurol Sci. 2002;29 Suppl 2:S3–7.View ArticlePubMedGoogle Scholar
- Dupuis M, Marshall JK, Hayes SM, Cytryn K, Murray S. Assessing the needs of Canadian gastroenterologists and gastroenterology nurses: challenges to optimal care in Crohn’s disease. Can J Gastroenterol. 2009;23:805–10.View ArticlePubMedPubMed CentralGoogle Scholar
- Aeschlimann A, Westkaemper R, Doherty M, Woolf AD. Multiple choice question quiz: a valid test for needs assessment in CME in rheumatology and for self-assessment. Ann Rheum Dis. 2001;60(8):740–3.View ArticlePubMedPubMed CentralGoogle Scholar
- Klein D, Staples J, Pittman C, Stepanko C. Using electronic clinical practice audits as needs assessment to produce effective continuing medical education programming. Med Teach. 2012;34(2):151–4.View ArticlePubMedGoogle Scholar
- Laidlaw JM, Harden RM, Morris AM. Needs assessment and the development of an educational programme on malignant melanoma for general practitioners. Med Teach. 1995;17(1):79–87.View ArticleGoogle Scholar
- Mann KV. Not another survey! Using questionnaires effectively in needs assessment. J Contin Educ Heal Prof. 1998;18:142–9.View ArticleGoogle Scholar
- Hatch TF, Pearson TG. Using environmental scans in educational needs assessment. J Contin Educ Heal Prof. 1998;18:179–84.View ArticleGoogle Scholar
- Djukanovic L, Dimkovic N, Marinkovic J, Andric B, Bogdanovic J, Budosan I, et al. Compliance with guidelines and predictors of mortality in hemodialysis. Learning from Serbia patients. Nefrologia. 2015;35(3):287–95.View ArticlePubMedGoogle Scholar
- Anton-Perez G, Perez-Borges P, Alonso-Alman F, Vega-Diaz N. Vascular accesses in hemodialysis: a challenge to be met. Nefrologia. 2012;32(1):103–7.PubMedGoogle Scholar
- Tangri N, Wagner M, Griffith JL, Miskulin DC, Hodsman A, Ansell D, Et al. Effect of bone mineral guideline target achievement on mortality in incident dialysis patients: an analysis of the United Kingdom Renal Registry. Am J Kidney Dis. 2011;57(3):415–21.View ArticlePubMedGoogle Scholar