Skip to main content
Download PDF

Development of clinical competence – a longitudinal survey of nurse practitioner students

BMC Nursing volume 20, Article number: 130 (2021) Cite this article

Abstract

Background

In order to achieve a sustainable standard of advanced clinical competence for nurse practitioners leading to a credible role, it is important to investigate the development of clinical competence among nurse practitioner students.

Aim

The aim of the present study is to analyse the development of nurse practitioner students’ self-assessed clinical competence from the beginning of their education to after completion of their clinical studies.

Design

The study involved the application of a longitudinal survey design adhering to STROBE guidelines.

Methods

The participants consisted of 36 registered nurses from a nurse practitioner programme at a Norwegian university. The Professional Nurse Self-Assessment Scale II was used for data collection during the period August 2015 to May 2020.

Results

The students developed their clinical competence the most for direct clinical practice. Our findings are inconclusive in terms of whether the students developed clinical competence regarding consultation, coaching and guidance, and collaboration. However, they do indicate a lack of development in some aspects of clinical leadership. The students with the lowest level of clinical competence developed their clinical competence regarding direct clinical practice significantly more than the students with the highest level of clinical competence. The differences between students with high and low levels of clinical competence were levelled out during their education. Thus, the students as a whole became a more homogenous group after completion of their clinical studies. Previous work experience in primary healthcare was a statistically significant, yet minor, predictor of the development of clinical competence.

Conclusion

Our findings indicate that the students developed their clinical competence for direct clinical practice in accordance with the intended learning outcomes of the university’s Master’s programme and international standards for nurse practitioners. It is imperative that the clinical field supports nurse practitioners by facilitating extended work-task fits that are appropriate to their newly developed clinical competence. We refrain from concluding with a recommendation that prior clinical work experience should be an entry requirement for nurse practitioner programmes. However, we recommend an evaluation of the nurse practitioner education programme with the aim of investigating whether the curriculum meets the academic standards of clinical leadership expected in advanced level of nursing.

Peer Review reports

Background

Advanced practice nursing (APN) has been introduced as a means of delivering high quality, safe and affordable healthcare [1]. At least one-third of all OECD (Organisation for Economic Cooperation and Development) countries reported in 2012–2013 that during the previous 5 years, they had expanded their scopes of practice of non-physicians, including advanced roles for nurses [2]. Research indicates that APN is beneficial in terms of achieving health outcomes for patients and patient satisfaction [3,4,5]. On 1 February 2020, Norway introduced regulations for registered nurses (RNs) with a Master’s degree in APN [6] as part of an effort to meet the challenges facing the primary health care sector [7].

According to International Council of Nurses (ICN) guidelines [1], an APN is an RN: ‘with the expert knowledge base, complex decision-making skills and clinical competencies for Advanced Nursing Practice’ ([1] p. 4) who holds a minimum of a Master’s degree. Clinical nurse specialist (CNS) and nurse practitioner (NP) are usually the two most recognised APN roles [1]. The ICN [1] provides the following definition of an NP: ‘A Nurse Practitioner is an Advanced Practice Nurse who integrates clinical skills associated with nursing and medicine in order to assess, diagnose and manage patients in primary healthcare (PHC) settings and acute care populations as well as ongoing care for populations with chronic illness’ ([1] p. 4).

An NP is an autonomous clinician with a clinical expertise that combines the diagnosis and treatment of health conditions and the prescription of medication based on evidence-informed guidelines and nursing principles. Moreover, NPs emphasise disease prevention and health management in their practice [1]. Research demonstrates that patients receiving care from NPs experience fewer unnecessary emergency room visits, reduced waiting times, and fewer hospital admissions and readmissions [8,9,10]. National contexts and the regulatory policies within which NPs practice determine their levels of autonomy and accountability [1]. Norway is presently in its first phase of implementing the NP role, and NPs do not currently have prescribing rights in Norway.

In order to meet the growing need for clinical competence in the care of an increasingly ageing population, as well as patients with complex health conditions, one university in Norway is currently offering a part-time (three- to- four-year) Master’s degree programme for NPs with a 120 European Credit Transfer System (ECTS). The programme was launched in 2015 and includes courses in advanced health and physical assessment, advanced pathophysiology and advanced pharmacology. It also offers three courses focusing on elective specialization in geriatric assessment, acute medical assessment and specialization in wound care and acute pain treatment. All NP students in the programme are expected to submit a Master’s thesis. The programme is consistent with both the ICN [1] definition of an NP and Fagerström’s [11] Nordic APN model, which incorporates the nurse-patient relationship, eight core competencies and critical contextual factors.

The definition of clinical competence within nursing has been the subject of much debate, but there seems to be an international consensus that the concept must be viewed from a holistic perspective [12] that includes the application of complex combinations of knowledge, performance, skills, values and attitudes [13]. This holistic view appears to be in line with the complementary view of knowledge that underpins the Nordic APN model, representing a synthesis of the three Aristotelian dimensions of knowledge: scientific knowledge (episteme), expertise (technê), and practical wisdom (phronêsis) [14]. An APN nurse’s clinical competence can be described as the result of a process in which these three dimensions of knowledge are synthesized to become ‘knowledge in action’ [11].

In order to investigate the clinical competence and the need for further training of NP/APN students, two studies have been carried out using a questionnaire called the Professional Nurse Self-Assessment Scale of clinical core competencies II (PROFFNurseSAS II), which is grounded in the Nordic APN model [15]. The sample included in the first study involved specialist and APN students from Iceland, the Netherlands, Sweden, Norway and the United Kingdom, surveyed on completion of their education [15]. The sample included in the second study involved students from three different NP/APN education programmes in Norway, surveyed at the beginning of their education [16]. Both studies found that the students self-assessed their clinical competence to be highest in aspects related to taking responsibility and their need for further training with regard to knowledge of medication [15, 16].

The ICN [1] emphasises that the educational preparation that enables students to meet the qualifications for NP practice is crucial to the credibility and sustainability of the NP concept. Since continuous evaluation is a critical contextual factor in the Nordic APN model [11], it is important to investigate the development NP students’ clinical competence in a Norwegian context. Moreover, it is especially important for countries like Norway, in which the NP/APN role is at an early stage of its development, to evaluate whether it is evolving according to international standards. Previous empirical research on clinical competence within nursing has been dominated by cross-sectional design studies, so we recognise a need for research employing a longitudinal design that track changes in clinical competence throughout a nurse’s education [17]. Thus, with the aim of exploring the development of nursing students’ clinical competence during an NP Master’s programme, the present work describes and analyses their self-assessed clinical competence using a longitudinal design study facilitated by the aforementioned PROFFNurse SAS II questionnaire.

Methods

Aim

The aim of the present study is to analyse the development of NP students’ self-assessed clinical competence from the beginning of their education (baseline) to after completion of their clinical studies (follow-up).

The following research questions regarding the students’ education were addressed:

  • What were the most and least developed items from baseline to follow-up?

  • How did the lowest self-assessed items at baseline develop for students with high and low clinical competence?

  • Are clinical work experience and previous higher education predictors for the development of clinical competence?

Design

A longitudinal survey design is applied in this study, and the ProffNurseSAS II questionnaire employed for the NP students’ to self-assess their clinical competence at baseline and follow up.

Questionnaire

The PROFFNurseSAS II questionnaire used in this study aims to measure the clinical competence of nurses at different educational levels from a holistic and lifelong learning perspective [15]. The questionnaire builds on the validated questionnaire PROFFNurseSAS I [18], which consisted of six components: direct clinical practice, professional development, ethical decision-making, clinical leadership, cooperation and consultation, and critical thinking. Wangensteen [15] sought to improve the questionnaire and developed a modified version containing 50 items subdivided along two scales: the A-scale for self-assessed clinical competence, and the B-scale for self-assessed need for further training [15].

The PROFFNurseSAS II questionnaire has been evaluated for content validity [15] and reliability (the Cronbach’s alpha value for the A-scale was 0.936) [16]. Since the aim of the present study addresses the development of clinical competence, it reports findings on the A-scale.

Participants

The survey involved the recruitment of a sample of RNs attending an NP programme at a Norwegian university. The first inclusion criterion was enrolment as a first-year student in the programme during their first semester. The second criterion centred on the students’ completion of their clinical studies (450 h) and the passing of their Objective Structured Clinical Assessment (OSCA). A total of 46 NP students from four cohorts that met the inclusion criteria were invited to participate. Among these, 36 were included in the present study, a response rate of 78%.

A power analysis was performed to evaluate sample size. The standard deviations of the total A-score from the first and second investigations were 0.90 and 0.74, respectively. It is possible, given that there were 36 APN students in the follow-up investigation, that the test power will be at least 90% if the mean difference in the total A-score between the first and second estimations is at least 0.50. Thus, we are satisfied that 36 students appears to be an appropriate sample size for the present study.

Data collection

The students completed the questionnaire twice: initially at the beginning of their NP education (baseline), and then later after they had completed their clinical studies (follow-up). The interval between surveys was approximately 2 years. The NP education is a part-time programme, in which all the students are assigned an individual study plan stating when and where their clinical studies are conducted, according to their needs and wishes. This provides the students with some flexibility, enabling some to spend more time completing their clinical studies than others. For this reason, there are slight differences between the two measuring points, although an approximate 2-year period applied to all students.

Data were collected using the questionnaire PROFFNurseSAS II, which includes 50 items with responses ranged on a scale from 1 to 10, where 1 indicates a poor, and 10 an excellent, level of clinical competence. The questionnaire also includes an option for scoring ‘entirely missing competence’, which is quantified as zero. The questionnaire also includes the option ‘competency not covered in the programme’, which was treated as an invalid value and not included in the analysis. The number of students who selected this option is set out in the Tables. A number of sociodemographic variables were also collected, including gender, age, years of clinical work experience as an RN, area of work experience (i.e., as a specialist or in primary health care), and previous higher education qualifications above a Bachelor’s degree in nursing, as recognised by the ECTS.

The students were first invited to participate in the baseline investigation by means of a printed handout of the questionnaire distributed during an NP programme lecture. As part of the second invitation, to the follow-up investigation, the students were given the opportunity to respond to the questionnaire online. Data collection was carried out between August 2015 and May 2020 by two of the present authors (IT and LF).

Ethical considerations

The project was approved by the Norwegian Centre for Research Data (NSD: approval no. 52648). Information was provided to the informants both at baseline (orally and on a written handout) and follow-up (via e-mail). The students were also informed about participant anonymity and their right to withdraw from the study at any time, without giving any reason. An ethical issue arises in situations where the nurse educators are also researchers conducting the study, and their students are participants. Such students may feel under some duress for fear that non-participation will impact on their progress or learning experience within the programme [19]. In order to address this concern, a PhD student with no teaching affiliation to the faculty (IT) assumed responsibility for collecting all the data, except in the case of one of the cohorts for which a former education programme leader (LF) collected data at baseline. It was emphasised to all the students that their responses would not affect their teachers’ evaluations or their examination grades. A scrambling key was created that enabled directly identifiable information to be stored separately from the data. Only the first author (IT) had access to the scrambling key.

Data analysis

The software IBM SPSS® Statistics 26.0 for Windows was used for data analysis. Of the total number of participants, 79% (n = 31) responded to all 50 items in the questionnaire. The baseline and follow-up investigations had total response rates of 85% (n = 33) and 87% (n = 34), respectively. Only participants with fewer than 10 missing items (18% of the total number of items) were included in the study. This criterion resulted in the exclusion of three participants. Thus, among the 39 NP students who responded to the questionnaire (a response rate of 80%), 36 were included in the data analysis. The case mean substitution technique is recommended in self-assessment studies [20] and it was thus used to replace missing data for participants who met the inclusion criteria (n = 5).

The data were expressed as frequencies, percentages and means to summarize the students’ demographical variables, items and total mean. Paired sample t-tests (two tailed) were conducted on participants’ total mean scores and individual items during comparisons of baseline and follow-up scores. An independent sample t-test was used when comparing NP students with high and low self-assessed clinical competencies.

Multiple linear regression analyses were conducted in situations where the total mean score for self-assessed clinical competence at follow-up was used as a dependent variable. The independent variables were as follows; (a) total mean score for the students’ self-assessed clinical competence at baseline, (b) age, (c) years of clinical work experience as an RN (overall, in primary health care and specialist health care, respectively) and (d) previous level of higher education above a Bachelor’s degree in nursing (measured in ECTS credits). Forced entry was used for all the predicting variables [21], which means that all independent variables were entered simultaneously. A backward variable selection method was subsequently applied by which predictors were removed one by one when they were not statistically significant, until all the remaining predictors were recognised as significant. The aim of this process was to build a model containing only statistically significant predictors [21]. Follow-up scores were adjusted for the baseline when linear regressions were performed, as recommended by Vickers and Altman [22],

The assumptions underlying the t-tests and linear analyses were checked and found to be adequately met, and p values below 0.05 were considered statistically significant.

It is important in this study to recognize a potential ceiling effect resulting from selection of the highest value at baseline, which may lead to an erroneous conclusion of no improvement [23]. In the present study, a ceiling effect was considered to be present at baseline if more than 15% of the participants self-assessed themselves with the highest possible score.

Results

The participating students (n = 36) consisted of 33 females and three males, with a mean age of 41 (range: 26–59). The mean number of years with clinical work experience as an RN was 13.0 (range: 4–33). All the participants were part-time students. Their mean number of years of clinical work experience in primary health care was 7.3 (range: 0–27), and 4.7 (range: 0–17) in specialist health care. Before entering their NP programmes, 23 students (64%) had previous educational qualifications above the level of a Bachelor’s degree in nursing. Among these, 18 students (50%) had obtained more than 30 ECTS credits.

The total mean score of clinical competence at baseline was 6.83 (SD = 0.90, range: 4.94–8.64), and 8.22 (SD = 0.74, range: 6.68–9.77) at follow-up. The mean difference between baseline and follow-up was 1.39 (SD = 0.80; range: − 0.68–2.84; 95% CI: − 1.58–1.04; p < 0.001). Among the 50 items in the questionnaire, 44 increased significantly (not shown in table).

The ten items that increased most between baseline and follow-up are presented in Table 1. Eight of these related to direct clinical practice, such as history-taking, physical examination, differential diagnosing and medication, while two were related to health promotion and illness prevention, and support and guidance provided to the patient. These items increased from 1.66–2.80 between baseline and follow-up, and all items increased significantly.

Table 1 Top 10 developed self-assessed items between baseline and follow-up (paired sample t-test)
Full size table

The ten items that increased least between baseline and follow-up are presented in Table 2. These related to fragmented aspects of clinical competence such as responsibility, cooperation with the physician, decision-making, improvements in the workplace, and the use of electronic devices such as telephones and e-mail when assessing the patient. These items increased from 0.12–0.75 between baseline and follow-up, and five items increased significantly. A ceiling effect was observed for seven items.

Table 2 Lowest 10 developed self-assessed items between baseline and follow-up (paired sample t-test)
Full size table

The 10 items ranked lowest at baseline are presented in Table 3. These related to direct clinical practice, improvement in the workplace, health promotion and illness prevention, and the use of electronic devices such as telephones and e-mail when assessing the patient. The items increased from 0.36–2.8 between baseline and follow-up, and eight items increased significantly.

Table 3 10 lowest self-assessed items at baseline with follow-up scores and difference (paired sample t-test)
Full size table

We extracted two groups from the total sample. One group represents the third of the students with the highest total mean for clinical competence (n = 12; total mean: 7.93; SD: 0.49; range: 7.31–8.75), and the other group represents the third of the students with the lowest total mean for clinical competence (n = 12; total mean: 5.91; SD: 0.46; range: 4.98–6.42). In the group with high clinical competence, the 10 lowest self-assessed items at baseline are presented in Table 4. In this group, eight items increased significantly. In the group with low clinical competence, the 10 lowest self-assessed items at baseline are presented in Table 5. In this group, eight items increased significantly. When the 10 lowest self-assessed items at baseline for students with high and low clinical competence (Tables 4 and 5) were compared, 8 items were found in both groups (items in grey in Tables 4 and 5). Among these eight items, five concerned direct clinical practice, two concerned assessing the patient with electronic devices and one concerned competence development at the workplace. Among the 50 items, 22 items increased significantly more for students with low clinical competence than for students with high clinical competence (Table 6). The ceiling effect was observed for 14 items, but this did not include the items concerning direct clinical practice.

Table 4 Students with higher clinical competence and the 10 lowest self-assessed items at baseline (paired sample t-test)
Full size table
Table 5 Students with lower clinical competence and the 10 lowest self-assessed items at baseline (paired sample t-test)
Full size table
Table 6 Students with high clinical competence vs low clinical competence (independent sample t-test)
Full size table

Previous clinical work experience as an RN within primary health care was found to be a statistically significant, yet minor, predictor for total mean clinical competence scores at follow-up, when adjusted for clinical competence at baseline (Table 7). This predictor variable explained 36.9% of the variance. Students with 10 years of previous clinical work experience in primary health care had a 0.35-point higher score for total clinical competence than students without. Neither work experience as an RN overall, work experience within specialist health care or previous education, were significant predictors.

Table 7 Regression: Self-assessment total mean at follow-up versus years of clinical work experience as an RN in primary health care, adjusted for total mean at baseline
Full size table

Discussion

Clinical competence that developed the most

The aim of the present study is to analyse the development of NP students’ self-assessed clinical competence from the beginning of their education (baseline) to after completion of their clinical studies (follow-up). Among the 50 items in the PROFFNurseSAS II questionnaire, 45 increased significantly. The total clinical competence score increased by 1.39 points, resulting in a total score of 8.22 (of a maximum of 10) after the students had completed their clinical studies. This finding is consistent with that of Wangensteen [15], who found that APN students self-assessed their clinical competence at 8.08 on completing their education.

We found that, among the 10 items that increased the most between the beginning of the students’ NP education and following the completion of their clinical studies, 8 items concerned the direct clinical practice of history-taking, physical examination, differential diagnosis and medication. These items refer to medically-related clinical skills that highly proficient RNs must acquire in order to become NPs [1, 24]. This finding is in line with previous research, which has shown that direct clinical practice was what NP/APN students most desired to learn [15, 16], and what NP students perceived as the most important aspect of their clinical competence [25].

Clinical decision-making is an important aspect of an NP’s clinical competence. Tiffen et al. ([26] p.400) developed the following definition: ‘Clinical decision-making is a contextual, continuous, and evolving process, where data are gathered, interpreted, and evaluated in order to select an evidence-based choice of action’. Taylor, Bing-Jonsson, Johansen, Levy-Malmberg, and Fagerström [27] found that while NP students demonstrated some structured history-taking and physical assessment techniques, they struggled to demonstrate decision-making in their OSCE (first clinical exam) for a pre-clinical course that they were required to pass prior to starting their clinical studies. In the present study, all the participating students had completed their clinical studies. They had also passed their OSCA (a second clinical exam), during which they were asked to assess clinical preceptor-selected patients who had given their consent. Item no. 8 in the questionnaire – ‘I interpret, analyse and reach alternative conclusions about patients’ health conditions after a detailed mapping of health history and health assessment (physical examination)’ – is consistent with the aforementioned definition of clinical decision-making, and was ranked second among the items that increased its scores the most in the follow-up part of the present study. This skill is specific and essential to NPs, as is clearly stated in the APN Nordic model [11].

Previous research has shown that medication (interactions and side-effects) represented the item about which NP/APN students most wanted to learn [15, 16]. The present study found that this item was ranked third among the items in the questionnaire that increased its scores the most. A study has shown that RNs working in nursing homes are in need of a deeper understanding of the inter-complexity of age-specific diseases and medication in order to ensure that their clinical judgments and actions are appropriate and safe [28]. Another study revealed that among 243 graduating nursing students and 203 RNs who took a multiple choice test, 25% of the answers to questions related to medicines management indicated a high risk of error [29]. We thus regard it as a promising finding of the present study that the item related to medication was ranked third among those that increased its scores the most. Despite the fact that NPs in Norway have yet to be granted prescription rights, our NP programme course in pharmacology is extensive and compares well with those offered in countries where NPs are granted such rights. The findings in this study indicate that the students had developed their clinical competence for direct clinical practice in line with the ICN’s [1] NP definition and the intended learning outcomes of the NP Master’s programme, specifically in relation to advanced health and physical assessment, advanced pathophysiology and advanced pharmacology.

Clinical competence that developed the least development

We found that the 10 items that increased the least between the start of students’ NP education and after the completion of their clinical studies concerned fragmented aspects of clinical competence such as responsibility, cooperation with the physician, decision-making, improvements in the workplace, and the use of electronic devices such as telephones and e-mail when assessing the patient. All of these items coincided with similarly fragmented aspects of clinical competencies set out in the Nordic APN-model, i.e., consultation, coaching and guidance, collaboration and leadership [11].

In the case of item 19 in the questionnaire (‘I improve routines/systems that fail to meet the needs of patients at my workplace’), the students reported average scores at the beginning of their education, and scores for this item did not increase significantly on completion of their clinical studies. This item is considered to be important as a measure of a student’s clinical competence in relation clinical leadership in the workplace. According to the ICN [1], NPs are clinical leaders who can influence health service delivery and the profession at large. Thus, an assessment of the development of students’ clinical competence at advanced nursing level must include an evaluation of their ability as clinical leaders. Indeed, leadership has been reported to be a key factor in an advanced practitioner’s ability to influence innovation, improve clinical practice and health care delivery, and advance the nursing/midwifery professions [30]. Moreover, the leadership aspect of the APN role is embedded in the statutory regulations governing APN Master’s programmes offered in Norway [31], which conform in most respects to national policy and competency standards relating to NP education in countries such as Australia, England, the United States and South Africa [32,33,34,35]. However, the finding in the present study may indicate that the NP students did not develop sufficiently with regard to clinical competence in some aspects of clinical leadership.

The students’ self-assessment of item no. 46—‘I give health promotion advice and recommendations to patients by telephone, e-mail or other electronic devices’—was the second-lowest at the beginning of their education. This item did not increase significantly on completion of their clinical studies. This outcome is in line with previous findings showing that NP/APN students consistently reported the lowest scores for this item [15], and were neutral in their attitudes as to whether this was an important factor in the further training [16]. We note in passing that experience from the Covid-19 pandemic has demonstrated that digital health care is more relevant today than it has ever been.

A ceiling effect was observed for seven of the ten items that increased their scores the least. Since a ceiling effect can be indicative of an incomplete scale [23], it may be argued that some of the items in the PROFFNurseSAS II questionnaire have limitations regarding their value as measures of clinical competence at an advanced level. However, a ceiling effect may reflect other than purely statistical issues [23] and NP students may have been reporting a maximum score for items relevant to their experiences as an RN. There are distinct differences between the levels of clinical competence among RNs and NPs. NPs have a broader degree of autonomy due to their advanced in-depth critical decision-making skills [1]. Due to the recent introduction of the NP role in Norway, many of the students in the present study did not associate with other NPs who could act as role models and indicators of what might be expected in terms of clinical competence at advanced NP level. Thus, in this respect, the present study has some limitations with regard to its measurement of some aspects of clinical competence at NP level.

Students with high and low clinical competence

When selecting the ten items with the lowest mean scores at the beginning of the students’ education, the high- and low-clinical competence groups revealed surprising similarity. With the exception of two items, those selected were identical in both groups. Even more surprisingly, in the case of 22 items, students with a low clinical competence at baseline increased their scores significantly more than those starting with a high clinical competence. A ceiling effect was observed for 14 of the 22 items, but not for those relating to direct clinical practice, which represent the central competencies set out in the Nordic APN model [11]. This means that the students with low clinical competence increased their clinical competence of direct clinical practice more that the students with higher clinical competence. In short, the differences between students with high and low levels of clinical competence at baseline were levelled out during their education. As a consequence, the students evolved into a more homogenous group with similar levels of clinical competence in relation to direct clinical practice after the completion of their clinical studies.

It is important to implement set standards in NP education as a means of achieving consistency in the educational preparation and authorization of NPs [36]. However, there are both positive and negative aspects in having all students develop their clinical competence to the same level. Stensaker and Prøitz [37] have expressed the concern that our perception of quality in education is conflicted. On the one hand, educational programmes are broad-based and generalised in an attempt to promote inclusivity. Others, on the other hand, education policy evolve as narrow and elitist in pursuit of promoting excellence. A challenge currently facing NP education is the fact that programmes seek simultaneously to educate students to be safe practitioners at an advanced level [38] while also encouraging them to be highly autonomous pioneers with the ability to make a difference to the quality of patient care [39]. We argue that NP education should aim to level up differences in clinical competence in order to ensure that the NP role represents a sustainable standard that contributes to improvements in patient safety.

Work experience and the development of clinical competence

Previous research has not found an association between the clinical competence and work experience of RNs in primary health care [40], or among RNs and critical care nurses working in intensive care units [41]. This is in line with the present authors’ previous research [16], during which we also did not establish work experience in primary health care as a significant predictor of clinical competence among APN/NP students at the beginning of their education. This finding is also supported by that of Wangensteen [15]. However, in the present study, we found that work experience in primary health care was a statistically significant, yet minor, predictor of the total mean score reported by students after they had completed their clinical studies, following adjustment for the total mean score reported at baseline. This could mean that, even though previous work experience was not associated with clinical competence at the beginning of their education, the students who had worked within primary health care utilized their work experience in a way that enabled them to develop clinical competence. Knowles, Holton, Swanson, and Robinson [42] emphasise that the richest resources for learning reside in the adult learners themselves, and recommend teaching techniques that tap in to the learners’ own experiences. Offering students the opportunity to draw on their prior work experience during their Master’s education has been shown to promote learning, especially when educators facilitate the students’ critical reflections on their experiences and provided feedback on their performance [43]. Students who participated in the present study were specifically encouraged to apply their previous work experience during the programme’s coursework and lectures. Our findings may therefore indicate that the NP Master’s programme is well suited to students who have prior work experience in primary health care.

The finding that prior work experience in primary health care is associated with clinical competence development is interesting with regard to NP programmes that include clinical work experience as an entry requirement. According to the ICN [1], entry requirements for NP programmes in terms of work experience differ markedly between countries. For example, Gardner, Dunn, Carryer and Gardner [44] found that entry requirements across the 14 programmes they studied varied from zero to 5 years of experience. In the present authors’ previous study [16], we did not find evidence to recommend having work experience as an entry requirement. Due to the findings in the present study, that are significant yet minor, we remain inconclusive to a recommendation for having working experience as an entry requirement.

Limitations

The PROFFNurseSAS II questionnaire has been evaluated for content validity [15] and reliability [16]. However, findings indicate that it may have issues related to its ability as a tool to assess the development of some aspects related to consultation, coaching and guidance, as well as collaboration at an advanced nursing level. This may be due to the fact that there are relatively few items in the questionnaire that pertain to these aspects, combined with a ceiling effect.

The value of self-assessment in nursing education is currently disputed, since it has been argued that nursing students at Bachelor’s level do not possess either sufficient faculty of self-reflection in relation to their actions, or the critical thinking skills necessary to carry out self-assessment [45]. The Dunning–Kruger effect has shown that poor performers overestimate their performance [46], thus raising doubts as to the construct validity of self-assessment approaches. However, Flynn, Valeberg, Tønnessen and Bing-Jonsson [47] found that Master’s students in nurse anaesthesia education significantly underestimated their clinical performance in relation to non-technical skills when compared with the assessments of their clinical supervisors. This finding supports the argument made in our previous study [16] that self-assessment is a valid and reliable approach to evaluations of APN education.

The present study does not attempt to evaluate the development of NPs’ clinical competence from the start to the end of their education, but from the start to the completion of their clinical courses in physical assessment, pathophysiology and advanced pharmacology, and their clinical studies. Before completing the NP Master’s programme, the students still have to complete their Master’s theses, which each offer 30 ECTS credits. Students are encouraged to choose topics with a clinical focus, or a project centred on professional development or quality improvement. Thus, since the students in this study had not yet fully completed their Master’s programme at the follow-up point, we suggest that more research is needed in order to investigate the students’ level of clinical competence as certified NPs.

We acknowledge that in general terms our sample size of 36 participants is limited in the context of a quantitative research project. However, the population of 46 students is also small. The study has achieved a high response rate and from the power analysis we have concluded that the sample size is appropriate. However, we recognise the problems associated with generalising our results on the basis of such a small sample size, and recommend further research using a larger sample.

Conclusion

The greatest development in the NPs’ clinical competence observed in this study was in relation to direct clinical practice. This is in line with international standards and the intended learning outcomes of the NP Master’s programme. However, the results of the present study are inconclusive regarding the students’ development in the fields of consultation, coaching and guidance, and collaboration. Furthermore, we observed a lack of development in aspects concerning clinical leadership in the workplace. The students entered the NP programme with different levels of clinical competence in terms of direct clinical practice, but these differences were largely equalised during their education. Students with low clinical competence of direct clinical practice at baseline achieved significantly greater advances in their clinical competence during their education than those with high clinical competence at baseline. Clinical work experience in primary health care was a statistically significant, yet minor, predictor of the development of clinical competence among the students during the programme. The authors thus refrain from recommending that prior clinical experience should be an entry requirement for the NP programme. We believe that the results of the present study may be used to improve nurse practitioner education, and recommend that an evaluation of the current NP programme be carried out in order to determine whether the curriculum meets the academic standards of clinical leadership that are expected for advanced level nursing practitioners.

The Norwegian government has contributed by introducing an APN certification and regulations governing APN Master’s education in Norway. It is now imperative that the clinical sector works together with the NP students to integrate the NP role in the workplace. NP students must be given the opportunity to display and further advance their newly acquired clinical competence at advanced level so that potential health outcomes for patients can be measured. Further research into the development of NP students’ clinical competence should include studies of future NPs with clinical work experience in relevant and advanced fields of nursing practice in clinical settings. The objective here will be to evaluate the transfer of learning outcomes from education to clinical practice. With regard to the methodological dilemmas associated with self-assessment, we believe that it would be interesting to include NP students or NPs clinical preceptors in such studies in order to strengthen the validity of any findings.

Availability of data and materials

Due to the express wishes of the informants, the datasets used and analysed in the present study are not available. The corresponding author can be contacted.

Abbreviations

APN:

Advanced Practice Nursing

ICN:

International Council of Nurses

OECD:

Organisation for Economic Cooperation and Development

RNs:

Registered Nurses

CNS:

Clinical Nurse Specialist

NP:

Nurse Practitioner

PHC:

Primary Health Care

ECTS:

European Credit Transfer System

PROFFNurseSAS II :

The Professional Nurse Self-Assessment Scale of clinical core competencies II (survey questionnaire)

OSCA:

Objective Structured Clinical Assessment

OSCE:

Objective Structured Clinical Examination

References

  1. International Council of Nurses. Guidelines on advanced practice nursing. 2020. https://www.icn.ch/system/files/documents/2020-04/ICN_APN%20Report_EN_WEB.pdf. Accessed 8 January 2021.

  2. Moreira L, Lafortune G. Equipping health workers with the right skills, in the right mix and in the right numbers, in OECD countries: World Health Organization; 2017. https://www.who.int/hrh/com-heeg/Rights_skills_mix_numbers_online.pdf?ua=1. Accessed 8 January 2021

    Google Scholar 

  3. Glarcher M, Lex KM. Advanced nursing practice in Austria under consideration of outcome measurement. Z Evid Fortbild Qual Gesundhwes. 2020. https://0-doi-org.brum.beds.ac.uk/10.1016/j.zefq.2020.06.012.

  4. Laurant M, van der Biezen M, Wijers N, Watananirun K, Kontopantelis E, van Vught A. Nurses as substitutes for doctors in primary care. Cochrane Database Syst Rev. 2018;2018. https://0-doi-org.brum.beds.ac.uk/10.1002/14651858.CD001271.pub3.

  5. Woo BFY, Lee JXY, Tam WWS. The impact of the advanced practice nursing role on quality of care, clinical outcomes, patient satisfaction, and cost in the emergency and critical care settings: a systematic review. Hum Resour Health. 2017;15(1):63. https://0-doi-org.brum.beds.ac.uk/10.1186/s12960-017-0237-9.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Ministry of Health and Care Services. (2020). Forskrift om spesialistgodkjenning for sykepleiere [Norwegian statutory regulations governing specialist approval for nurses]. https://lovdata.no/dokument/LTI/forskrift/2019-11-19-2206. Accessed 8 January 2021.

  7. Ministry of Health and Care Services. The primary health and care services of tomorrow – localised and integrated. (Meld. St. 26 (2014–2015)). https://www.regjeringen.no/en/dokumenter/meld.-st.-26-20142015/id2409890/. Accessed 8 January 2021.

  8. Chavez KS, Dwyer AA, Ramelet AS. International practice settings, interventions and outcomes of nurse practitioners in geriatric care: A scoping review. Int J Nurs Stud. 2018. https://0-doi-org.brum.beds.ac.uk/10.1016/j.ijnurstu.2017.09.010.

  9. Maier CB, Aiken LH, Busse R. Nurses in advanced roles in primary care (vol. 98). Paris: OECD Publishing; 2017. Accessed 8 January 2021

    Google Scholar 

  10. Martin-Misener R, Harbman P, Donald F, Reid K, Kilpatrick K, Carter N, et al. Cost-effectiveness of nurse practitioners in primary and specialised ambulatory care: Systematic review. BMJ Open. 2015. https://0-doi-org.brum.beds.ac.uk/10.1136/bmjopen-2014-007167.

  11. Fagerström L. En nordisk modell for avansert klinisk sykepleie [A Nordic advanced practice nurse model]. In: Fagerström L, editor. Avansert klinisk sykepleie [Advanced practice nurse]. Oslo: Gyldendal; 2019. p. 62–70.

    Google Scholar 

  12. Takase M, Teraoka S. Development of the Holistic Nursing Competence Scale. Nurs Health Sci. 2011. https://0-doi-org.brum.beds.ac.uk/10.1111/j.1442-2018.2011.00631.x.

  13. Cowan DT, Norman I, Coopamah VP. Competence in nursing practice: A controversial concept – a focused review of literature. Nurse Educ Today. 2005. https://0-doi-org.brum.beds.ac.uk/10.1016/j.nedt.2005.03.002.

  14. Aristotle. The Nicomachean ethics. In: Brown L, Ross WD, editors. Revised ed . Oxford: Oxford University Press; 2009.

    Google Scholar 

  15. Wangensteen S, Finnbakk E, Adolfsson A, Kristjansdottir G, Roodbol P, Ward H, et al. Postgraduate nurses’ self-assessment of clinical competence and need for further training: A European cross-sectional survey. Nurse Educ Today. 2016. https://0-doi-org.brum.beds.ac.uk/10.1016/j.nedt.2017.12.020.

  16. Taylor I, Bing-Jonsson P, Wangensteen S, Finnbakk E, Sandvik L, McCormack B, et al. The self-assessment of clinical competence and the need for further training: A cross-sectional survey of advanced practice nursing students. J Clin Nurs. 2020. https://0-doi-org.brum.beds.ac.uk/10.1111/jocn.15095.

  17. Yanhua C, Watson R. A review of clinical competence assessment in nursing. Nurse Educ Today. 2011. https://0-doi-org.brum.beds.ac.uk/10.1016/j.nedt.2011.05.003.

  18. Finnbakk E, Wangensteen S, Skovdahl K, Fagerström L. The Professional Nurse Self-Assessment Scale: Psychometric testing in Norwegian long term and home care contexts. BMC Nurs. 2015. https://0-doi-org.brum.beds.ac.uk/10.1186/s12912-015-0109-3.

  19. Ferguson LM, Myrick F, Yonge O. Ethically involving students in faculty research. Nurse Educ Today. 2006. https://0-doi-org.brum.beds.ac.uk/10.1016/j.nedt.2006.07.021.

  20. Fox-Wasylyshyn S, El-Masri MM. Handling missing data in self-report measures. Res Nurs Health. 2005. https://0-doi-org.brum.beds.ac.uk/10.1002/nur.20100.

  21. Field A. Discovering statistics using IBM SPSS statistics. 5th ed. London: SAGE Publications Ltd.; 2018.

    Google Scholar 

  22. Vickers AJ, Altman DG. Statistics notes: Analysing controlled trials with baseline and follow up measurements. Br Med J. 2001. https://0-doi-org.brum.beds.ac.uk/10.1136/bmj.323.7321.1123.

  23. Cramer D, Howitt DL. The SAGE dictionary of statistics: a practical resource for students in the social sciences. London: SAGE Publications Ltd.; 2004. https://0-doi-org.brum.beds.ac.uk/10.4135/9780857020123.

    Book  Google Scholar 

  24. Brook S, Rushforth H. Why is the regulation of advanced practice essential? B J Nurs. 2011. https://0-doi-org.brum.beds.ac.uk/10.12968/bjon.2011.20.16.996.

  25. Henni SH, Kirkevold M, Antypas K, Foss C. The role of advanced geriatric nurses in Norway: a descriptive exploratory study. Int J Older People Nursing. 2018, 2018. https://0-doi-org.brum.beds.ac.uk/10.1111/opn.12188.

  26. Tiffen J, Corbridge SJ, Slimmer L. Enhancing clinical decision making: development of a contiguous definition and conceptual framework. J Prof Nurs. 2014;30(5):399–405. https://0-doi-org.brum.beds.ac.uk/10.1016/j.profnurs.2014.01.006.

    Article  PubMed  Google Scholar 

  27. Taylor I, Bing-Jonsson P, Johansen E, Levy-Malmberg R, Fagerström L. The Objective Structured Clinical Examination in evolving nurse practitioner education: A study of students’ and examiners’ experiences. Nurse Educ Pract. 2019. https://0-doi-org.brum.beds.ac.uk/10.1016/j.nepr.2019.04.001.

  28. Finnbakk E, Skovdahl K, Wangensteen S, Fagerström L. “It’s not for amateurs!” – Registered nurses’ experiences of their clinical competence when caring for elderly patients. Int J Hum Caring. 2020. https://0-doi-org.brum.beds.ac.uk/10.20467/HumanCaring-D-19-00044.

  29. Simonsen BO, Daehlin GK, Johansson I, Farup PG. Differences in medication knowledge and risk of errors between graduating nursing students and working registered nurses: Comparative study. BMC Health Serv Res. 2014. https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-014-0580-7.

  30. Delamaire ML, Lafortune G. Nurses in advanced roles (OECD Health Working Papers): OECD Publishing; 2010. https://0-doi-org.brum.beds.ac.uk/10.1787/5kmbrcfms5g7-en.

    Book  Google Scholar 

  31. Ministry of Education and Research. Norwegian statutory regulations governing national guidelines for master’s education in advanced practice nursing. [Forskrift om nasjonal retningslinje for masterutdanning i avansert klinisk allmennsykepleie]. 2020. https://lovdata.no/dokument/SF/forskrift/2020-01-03-45. Accessed 8 Jan 2021.

  32. Nursing and Midwifery Board of Australia. Nurse practitioner standards for practice—Effective from 1 January 2014. 2018. https://www.nursingmidwiferyboard.gov.au/codes-guidelines-statements/professional-standards/nurse-practitioner-standards-of-practice.aspx. Accessed 8 Jan 2021.

  33. Health Education England. Multi-professional framework for advanced clinical practice in England. 2017. https://www.hee.nhs.uk/sites/default/files/documents/Multi-professional%20framework%20for%20advanced%20clinical%20practice%20in%20England.pdf. Accessed 2 March 2021.

  34. National Organization of Nurse Practitioner Faculties. Nurse practitioner core competencies content. 2017. https://nursing.lsuhsc.edu/Docs/Quality/Nurse%20Practitioner%20Core%20Competencies%20(2017).pdf. Accessed 8 January 2021.

  35. South African Nursing Council. Generic competency framework for advanced nurse practitioners. 2005. https://sanc.co.za/pdf/Competencies/SANC%20Competencies-Generic%20Framework%20for%20Advanced%20Nurse%20Practitioners.pdf. Accessed 8 Jan 2021.

    Google Scholar 

  36. Gardner G, Carryer J, Gardner A, Dunn S. Nurse practitioner competency standards: Findings from collaborative Australian and New Zealand research. Int J Nurs Stud. 2006. https://0-doi-org.brum.beds.ac.uk/10.1016/j.ijnurstu.2005.09.002.

  37. Stensaker B, Prøitz TS. Fra en elitistisk til en demokratisk forståelse av kvalitet. (Quality – from an elitist to a democratic understanding). In: Frølich N, editor. Hva skjer i universiteter og høgskoler?: Perspektiver fra vitenskapelig ansatte og studenter. (What is happening in universities and colleges?: Some perspectives from scientific employees and students). Oslo: Universitetsforlaget; 2015. p. 25–36.

    Google Scholar 

  38. Starkweather A, Sargent L, Nye C, Albrecht T, Cloutier R, Foster A. Progressive assessment and competency evaluation framework for integrating simulation in nurse practitioner education. J Nurse Pract. 2017. https://0-doi-org.brum.beds.ac.uk/10.1016/j.nurpra.2017.04.012.

  39. Brown MA, Draye MA. Experiences of pioneer nurse practitioners in establishing advanced practice roles. J Nurs Scholarsh. 2003. https://0-doi-org.brum.beds.ac.uk/10.1111/j.1547-5069.2003.00391.x.

  40. Bing-Jonsson PC, Hofoss D, Kirkevold M, Bjork IT, Foss C. Sufficient competence in community elderly care? Results from a competence measurement of nursing staff. BMC Nurs. 2016;15(1):5. https://0-doi-org.brum.beds.ac.uk/10.1186/s12912-016-0124-z.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Leonardsen AC, Nystrøm V, Sælid Grimsrud IJ, Hauge LM, Olsen BF. Competence in caring for patients with respiratory insufficiency: a cross-sectional study. Intensive Crit Care Nursing. 2020;63:102952. https://0-doi-org.brum.beds.ac.uk/10.1016/j.iccn.2020.102952.

    Article  Google Scholar 

  42. Knowles MS. The adult learner: the definitive classic in adult education and human resource development. 8th ed. Oxon: Routledge; 2015.

    Google Scholar 

  43. Madi M, Hamzeh H, Griffiths M, Rushton A, Heneghan NR. Exploring taught masters education for healthcare practitioners: a systematic review of literature. BMC Med Educ. 2019. https://0-doi-org.brum.beds.ac.uk/10.1186/s12909-019-1768-7.

  44. Gardner G, Dunn S, Carryer J, Gardner A. Competency and capability: imperative for nurse practitioner education. Aust J Adv Nurs. 2006;24:8–14 Retrieved from https://0-search-ebscohost-com.brum.beds.ac.uk/login.aspx?direct=true&db=ccm&AN=106359418&site=ehost-live. Accessed 8 January 2021.

    PubMed  Google Scholar 

  45. Siles-González J, Solano-Ruiz C. Self-assessment, reflection on practice and critical thinking in nursing students. Nurse Educ Today. 2016. https://0-doi-org.brum.beds.ac.uk/10.1016/j.nedt.2016.07.005.

  46. Kruger J, Dunning D. Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. J Pers Soc Psychol. 1999;77:1121–34. https://0-doi-org.brum.beds.ac.uk/10.1037/0022-3514.77.6.1121.

  47. Flynn FM, Valeberg BT, Tønnessen S, Bing-Jonsson PC. Psychometric testing of a structured assessment instrument for non-technical skills (NANTS-no) for use in clinical supervision of student nurse anesthetists. J Nurs Meas. 2020. https://0-doi-org.brum.beds.ac.uk/10.1891/jnm-d-19-00086.

Download references

Acknowledgments

The authors would like to acknowledge and thank all the students who participated in the study.

Funding

This study forms part of the research project “Providing person-centred healthcare - by new models of advanced nursing practice in cooperation with patients, clinical field and education” (Researcher project: PRAKSISVEL; Application no.: ES530499; Project no.: 239991), which is funded by the Norwegian Research Council.

Author information

Authors and Affiliations

  1. Faculty of Health and Social Sciences, University of South-Eastern Norway (USN), P. O. Box 235, 3603, Kongsberg, Norway

    I. Taylor, P. C. Bing-Jonsson, L. Sandvik & L. Fagerström

  2. Lovisenberg Diaconal University College, Oslo, Norway

    E. Finnbakk

  3. Faculty of Education and Welfare Studies, Åbo Akademi University, Vaasa, Finland

    E. Finnbakk & L. Fagerström

  4. Faculty of Medicine and Health Science in Gjøvik, Norwegian University of Science and Technology (NTNU), Gjøvik, Norway

    S. Wangensteen

Authors
  1. I. Taylor
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. P. C. Bing-Jonsson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. E. Finnbakk
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. S. Wangensteen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. L. Sandvik
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. L. Fagerström
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All those entitled to authorship are listed as authors. All authors have agreed on the final version and have made substantial contributions to all of the following: (1) The conception and design of the study, as well as the acquisition or analysis and interpretation of data. (2) The drafting or critical revision of the article for important intellectual content. (3) The final approval of the version to be submitted.

Corresponding author

Correspondence to I. Taylor.

Ethics declarations

Ethics approval and consent to participate

The present project was approved by the Norwegian Centre for Research Data (NSD: approval no. 52648). The Norwegian Centre for Research Data ensures that data about people can be collected, stored and shared, both safely and legally, today and in the future. The Ethical Committee of South East Norway provides advance approval for medical and health research projects involving humans. As this project is not a medical nor health research project, approval from The Ethical Committee of South East Norway was not required. Informed consent was obtained from all participants. Information was provided to the informants on both occasions when they participated in the study. At baseline they received information both orally and on a written handout, and at the follow-up point via e-mail. The students were also informed about participant anonymity and their right to withdraw from the study at any time, without giving any reason. All methods were implemented in accordance with the EU’s General Data Protection Regulation (Regulation 2016/679), and the study adhered consistently to STROBE guidelines.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Taylor, I., Bing-Jonsson, P.C., Finnbakk, E. et al. Development of clinical competence – a longitudinal survey of nurse practitioner students. BMC Nurs 20, 130 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s12912-021-00627-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12912-021-00627-x

Keywords

BMC Nursing

ISSN: 1472-6955

Contact us