The nurse is caring for a client who is pregnant. which nutrition education will the nurse provide?

Aberystwyth University, Information Management, Libraries and Archives, Llanbadarn Centre, AberystwythUK, SY23 3AL

Find articles by Christine Urquhart

Suffolk NHS Primary Care Trust, Public Health Directorate, Rushbrook HousePaper Mill Lane, Bramford, IpswichUK, IP8 4DE

Find articles by Rosemary Currell

University of Salford, School of Health & Society, SalfordUK, M6 6PU

Find articles by Maria J Grant

University of Huddersfield, School of Human & Health Sciences, R1/19 Ramsden BuildingQueensgate, HuddersfieldUK, HD1 3DH

Find articles by Nicholas R Hardiker

Aberystwyth University, Information Management, Libraries and Archives, Llanbadarn Centre, AberystwythUK, SY23 3AL

Suffolk NHS Primary Care Trust, Public Health Directorate, Rushbrook HousePaper Mill Lane, Bramford, IpswichUK, IP8 4DE

University of Salford, School of Health & Society, SalfordUK, M6 6PU

University of Huddersfield, School of Human & Health Sciences, R1/19 Ramsden BuildingQueensgate, HuddersfieldUK, HD1 3DH

Christine Urquhart, ku.ca.reba@ujc.

The nurse is caring for a client who is pregnant. which nutrition education will the nurse provide?
Corresponding author.

Editorial Group: Cochrane Effective Practice and Organisation of Care Group.

A nursing record system is the record of care that was planned or given to individual patients and clients by qualified nurses or other caregivers under the direction of a qualified nurse. Nursing record systems may be an effective way of influencing nurse practice.

To assess the effects of nursing record systems on nursing practice and patient outcomes.

For the original version of this review in 2000, and updates in 2003 and 2008, we searched: the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register; MEDLINE, EMBASE, CINAHL, BNI, ISI Web of Knowledge, and ASLIB Index of Theses. We also handsearched: Computers, Informatics, Nursing (Computers in Nursing); Information Technology in Nursing; and the Journal of Nursing Administration. For this update, searches can be considered complete until the end of 2007. We checked reference lists of retrieved articles and other related reviews.

Randomised controlled trials (RCTs), controlled before and after studies, and interrupted time series comparing one kind of nursing record system with another in hospital, community or primary care settings. The participants were qualified nurses, students or healthcare assistants working under the direction of a qualified nurse, and patients receiving care recorded or planned using nursing record systems.

Two review authors (in two pairs) independently assessed trial quality and extracted data.

We included nine trials (eight RCTs, one controlled before and after study) involving 1846 people. The studies that evaluated nursing record systems focusing on relatively discrete and focused problems, for example effective pain management in children, empowering pregnant women and parents, reducing loss of notes, reducing time spent on data entry of test results, reducing transcription errors, and reducing the number of pieces of paper in a record, all demonstrated some degree of success in achieving the desired results. Studies of nursing care planning systems and total nurse records demonstrated uncertain or equivocal results.

We found some limited evidence of effects on practice attributable to changes in record systems. It is clear from the literature that it is possible to set up the randomised trials or other quasi‐experimental designs needed to produce evidence for practice. Qualitative nursing research to explore the relationship between practice and information use could be used as a precursor to the design and testing of nursing information systems.

Keywords: Humans, Nursing, Nursing Records, Outcome and Process Assessment (Health Care), Patient Care Planning, Professional Practice, Randomized Controlled Trials as Topic

When patients are in hospital or sick at home and visited by a nurse, it is important that the care they receive is recorded properly.  Nurses record a wide variety of information about a patient’s care and progress.  For example, nurses would record a patient’s status while in ICU every hour, or when and how pain medication should be given and when it was given, or the progress of a pregnant  woman visiting a clinic.  These nursing records are a way for nurses to share care information with other nurses, other health care professionals and sometimes with patients.  This is Information that can ensure patient care is consistent when staff changes shifts or information that can be used later as a history of previous care.

But what is the best way to record and share this information? Is there a system or way of recording care information that is best?  It has been suggested that there may be a difference in how nurses practice or how well a patient does with the use of one record system compared to another. 

A review of the effect of different nursing record systems was conducted.  After searching for all relevant studies, 9 studies were found.  These studies compared nursing records filled out on paper with nursing records done on computer; nursing records that were held by patients themselves to records kept at a hospital or clinic; and nursing records which used different types of forms.

The evidence shows that nursing record systems which aim to fix a specific problem, such as reducing lost notes, decreasing the time required for data entry, or the amount of paper files, may be successful at fixing that problem.  But it is uncertain whether changing an entire system of recording nursing care may improve how nurses practice or how well a patient does.

What this review did show, is that there needs to be more work with the nursing professions to understand exactly what needs to be recorded and how it will be used, and that it is important to involve the nursing staff in the design and development of the nursing record systems.   

As health care grows more complex and the boundaries between the professions and different sectors become increasingly blurred, the ability to communicate effectively about patient care is more important than ever. The delivery of good nursing care has always been dependent upon the quality of the information available to the nurse, and nurses have long been recognised as key collectors, generators, and users of patient or client information. Moreover, the role of the nurse in providing 24‐hour care and in coordinating the care given by others means that the exchange and transfer of information is a significant nursing activity.

A nursing record system is the record of care that is planned or given to individual patients and clients by qualified nurses or by other care givers (including nursing students) under the direction of a qualified nurse. The format of these records has varied over time, across different specialties, and in different countries. The development of nursing records has been concerned with their use as vehicles for the storage and exchange of information. They have also been used to support different philosophies of nursing practice. Over the last 30 years, nursing in the UK and North America has been developed by nursing theorists as a planned, problem‐solving activity. Although eminent nurse researchers (Henderson 1982) have suggested that there is more to nursing than problem solving, this has provided the focus for discussion about the provision of nursing care and the recording of information about patient care. The potential effects of recording nursing information in rigid frameworks based on this approach are considerable. The benefits to be expected from the consistent and directed recording of patient care information are clear, and include, for example, patient safety and continuity of care. The possible adverse effects on patient care, nursing practice, and the development of nursing knowledge, of recording patient information in structures which may be inadequate or inappropriate for the purpose, could be highly significant. All that can be readily retrieved and known about the nursing care of a patient or client after the event resides in these paper and electronic systems.

The recognition that good information is necessary for effective nursing practice has led nursing theorists and practitioners, information scientists, and the commercial world to invest considerable resources in the development of computerised nursing information systems. The benefits to patients of this investment are by no means established. For example, an earlier review of nursing information systems (Audit Commission(UK) 1992) was critical of developments that had done no more than automate existing manual systems; and yet investment in these systems continues. A review of what is known about these systems and their effects, therefore, appeared to be necessary.

Since the last update of this systematic review there have been several related reviews published. A review (Urquhart 2005) of qualitative research on nursing record systems addressed some questions raised in the conclusions to the previous update (Currell 2003). This review concluded that the formal record with legal status may not reflect nursing practice and care; the benefits of structured versus free text entry were doubtful and, therefore, time savings hard to realise. Poissant 2005 examined the impact of electronic health records on documentation time of physicians and nurses, and noted that a goal of decreased documentation time may be illusory. In a review of the research on electronic health record systems, Häyrinen 2008 noted that while many studies examined the completeness and accuracy of the documentation, fewer studies examined information use or the impact on communication between different health professionals. This review also noted the lack of evidence on nursing documentation or patient self‐documentation. A systematic review by Müller‐Staub 2006 examined effects on documentation of assessment quality; the frequency, accuracy, and completeness of nursing diagnoses; and on coherence between nursing diagnoses, interventions, and outcomes. The review concluded that standardised nursing diagnoses led to better documentation but that better documentation did not necessarily lead to better patient care outcomes. A narrative review of information systems in nursing (Oroviogoicoechea 2008) stressed the need for a more socio‐technical approach to evaluation; perhaps a realistic evaluation approach would be to consider coherency, context, mechanism, and outcomes with an appropriate mix of methods to answer the research questions. Such multi‐method evaluation is expensive and demands a range of research skills in the evaluation team. Not surprisingly, therefore, in a systematic review of the effects of health information technology on the quality, efficiency, and costs of medical care Chaudhry 2006 found that 25% of the studies came from four academic institutions that had implemented internally developed systems (full details in AHRQ 2006). Delpierre 2004 systematically reviewed the medical literature since 2000 for the impact of computer‐based record systems on the quality of medical practice, and user and patient satisfaction. The review (which identified three studies of nurse satisfaction with computer‐based record systems) concluded, in line with other reviews, that the structure of care and the organisational factors required more consideration in evaluations. A systematic review (York 2007) of the effectiveness of computerised decision support within nursing, combined with empirical research, found limited evidence of effectiveness and concluded that more information was required on the real requirements of nurses for information in decision making.

The objective of the review was to establish the impact of nursing record systems on nursing practice and patient outcomes. The literature suggests that there may be a difference in nursing practice or patient outcomes with the use of one nursing record system compared with another, and that nursing record systems may be an effective medium by which to influence the way nurses practice.

The comparisons made in the review were of the use of any one kind of nurse record system compared with another. The comparison groups included reflect the changes in nursing philosophy and nursing practice over time, and changes in the organisational features for the provision of health care. The developments in health information technology were also reflected in the different types of nursing record systems that the review covers.

The questions for the review were whether there is a measurable difference in nursing practice or patients outcomes between the use of: 1. a structured nursing record system and an unstructured system; 2. a care plan and a nursing record system which does not include a formal care plan; 3. a manual nursing record system and a computerised nursing record system; 4. centrally‐held nursing records and patient‐held nursing records; 5. a nursing record and a multidisciplinary record; 6. a problem‐oriented nursing record and a non‐problem oriented nursing record; 7. daily progress notes and charting by exception (i.e. only recording abnormalities or deviations from the plan instead of recording at regular intervals, even if there is no change or abnormality to report).

The review aimed to identify both beneficial and adverse effects of the use of different nursing record systems. The review also set out to establish gaps in knowledge and identify areas for further research, both in nursing and in informatics.

Types of studies

The types of study designs included were those described in the Cochrane Effective Practice and Organisation of Care Group (EPOC) Module (see 'Methods used in Reviews', in 'Group Details' for complete definitions of study designs). These were:

  • Randomised controlled trials (RCTs);

  • controlled clinical trials;

  • interrupted time series analyses;

  • controlled before and after studies (CBAs).

Types of participants

1. Qualified nurses (how ever defined in the country of origin of the study) and nurse students or other healthcare practitioners working under the direction of a qualified nurse. The term 'nurse' is used to include all qualified nurses, midwives, and health visitors; and to include all those working in hospital, the community, or primary care settings. 2. Patients receiving care that was recorded or planned using different nursing record systems.

Types of interventions

Studies that compared the use of one kind of nursing record system with another in hospital, community, or primary care settings, including: 1. multidisciplinary care records and patient‐held records, where they formed the only or principal record of nursing care for individual patients; 2. systems based on standard care plans, applied to the care of individual patients; 3. systems designed to record specific aspects of direct nursing care and which form an integral part of the nursing record, such as pain control or wound management; 4. records in paper and electronic formats.

We excluded the following systems: 1. nurse management systems, such as those designed for rostering or workload measurement; 2. Systems designed for nurse education, unless they are applied to real patient care; 3. ephemeral or informal means of communicating nursing care, such as nurses' personal notebooks, ward diaries, or verbal communication; 4. systems such as risk assessment instruments which are not designed to be an integral part of the principal nursing record but are adjuncts only.

Types of outcome measures

We included studies if they gave objective measures of provider performance or patient outcomes.

The original review considered only English‐language publications but the updates have included a search for publications in other languages. The EPOC Group Specialised Register, MEDLINE, CINAHL, the Royal College of Nursing (RCN) Database, and the King's Fund Database were the starting points for the search.

The particular difficulties of searching the nursing literature are the lack of abstracts for much of the work, and the changes over time in the keywords used for indexing. The electronic search strategies were gradually refined for each database and the following strategies identified all the studies included in the review. They still identified large amounts of irrelevant material.

For the original review, considerable handsearching of printed indexes included handsearches of the RCN Bibliography of Nursing Literature (1856 to 1983) (including the card index for 1983 which had not been included in either the printed bibliography or the database), the RCN Steinberg Collection, the Royal College of Midwives Midwifery Index (1976 to 1991), and the Cumulative Index to Nursing Literature (CINL) (1956 to 1982). These were carried out to complete the search back to 1948. The other major nursing index is the International Nursing Index, which was included in MEDLINE from 1963. A comparison was made of the International Nursing Index and the Cumulative Index to Nursing Literature for the year 1975. The journals not covered by CINL are the non‐English language journals and a number of the American State Nursing Association journals and newsletters. CINL does include more general health service journals not covered in the International Nursing Index, and also scans the major medical journals. For the purposes of this review, therefore, we thought it was unnecessary to search both the International Nursing Index and CINL.

For the original review, the authors searched a large number of conference proceedings:

Alliance for Engineering in Medicine and Biology; Annual Symposium on Computer Applications in Medical Care; British Computer Society Nursing Specialist Group Conferences; Global Conference on Patient Cards and Computerisation of Health Records; Health Care Computing Conference (UK); IEEE Engineering in Medicine and Biology Society; International Congress on the Use of Computers and Information Science in Nursing; International Society for Systems Science in Health Care; Medical Informatics Europe; The MEDINFO World Conference on Medical Informatics.

For the 2003 update, the authors searched the MEDLINE, EMBASE, CINAHL, British Nursing Index, and Aslib Index to Theses databases (1998 to 2002). We handsearched The Journal of Nursing Administration, Computers in Nursing, and Information Technology in Nursing (up to 2002). We did not update the searches of the other databases and grey literature included in the original review (except for Health Care Computing Conference and Med Info) as the original searches produced little relevant material. For the original review, the authors sent a standard letter outlining the project aims and inclusion criteria to 55 experts in the field of nursing informatics around the world, and sent a similar letter to suppliers of nursing computer systems. The authors also contacted relevant nursing internet groups. There was very little response from outside the UK. The authors sent letters to the authors or institutions involved in studies which were either reported as ongoing at the time of publication, or in which there was inadequate information in the published account. These studies were up to 20 years old, so the lack of response was not surprising. A search for the 2008 update failed to find any further publications on these projects and these studies have now been removed from the list of ongoing studies.

For the 2008 update, we searched (2003 to 2007) MEDLINE (in April 2008), EMBASE (in July 2008), CINAHL (in April 2008), ISI Web of Knowledge, BNI (in August 2008); and ASLIB Index of Theses (not date restricted) (in February 2008). We handsearched Computers, Informatics, Nursing (Computers in Nursing); Information Technology in Nursing; and the Journal of Nursing Administration (2003 to 2007). We also undertook searches of the references lists of retrieved articles, as well as the Agency for Healthcare Research and Quality 2006 report on electronic patient record systems. We searched the conference programmes of recent and upcoming conferences via search engines, and the Commons Ground conference site, to identify ongoing studies. 

Search strategies appear in the appendix. Only one of the two new included studies was in MEDLINE: as in the original review, several databases had to be searched to find relevant studies. 

Two of the authors reviewed all relevant studiesusing the criteria for review set out in the EPOC data collection checklist. We assessed the quality of all eligible trials using the criteria described by the EPOC Group (see 'Editorial information' under 'Group details' for 'Methods used in reviews'). Two reviewing authors (in two pairs) independently assessed the quality of each study and extracted the data, resolving any differences by discussion among all reviewing authors. The EPOC Editor was contacted only for advice on technical points.

We have summarised relevant data on the quality and results of studies in the 'Characteristics of included studies' and 'Results' tables. We excluded studies that were so compromised by flaws in their design or execution as to be unable to provide reliable data; the reasons for exclusion are provided in the 'Characteristics of excluded studies' table and in the 'Results' section of the review. We made considerable efforts to contact the authors of studies that came within the scope of the review and appeared to meet the methodological criteria but for which the published account lacked sufficient information or data to be certain. We also tried to contact the authors of studies that were reported in the literature as 'ongoing' but which could reasonably have been expected to have been completed by now. Some of the studies are more than 20 years old and not only was it impossible to trace most of the authors, some of the organisations had disappeared. Of the six authors who did respond, two had discarded the relevant material. We have removed studies that were listed as ongoing in previous versions of the review (prior to the 2008 update) following a final check to identify any further publications on these studies.

We have summarised and presented the data in natural units. For dichotomous variables in the RCTs, we have reported the absolute percentage differences between the two groups and the percentage differences relative to the control group. For controlled before and after studies, we have reported both the absolute change between the experimental and control groups after the intervention and the percentage change relative to the control group, and also the absolute change from baseline to post‐intervention in both groups, together with the difference of the change between the two groups. We have followed the convention of reporting outcomes as unfavourable events as far as was possible and sensible. In some cases this would have been counter‐intuitive and, although we had aimed for consistency, this has not always been possible. We have, therefore, added tags to some outcomes in the results table to indicate whether the result favoured the experimental group or the control group. We have reported P values as described by the study authors. Because so few studies were identified as being suitable for inclusion in the review, and because of the heterogeneity between studies, it was not necessary to conduct any pooled statistical analyses.

In the 2008 update, and following the assessment of abstracts, the team identified 193 documents of potential relevance to the review; some of these were duplicates as the database searching was done at two different sites. The comparable figures for the 2003 update (publication date limits 2000 to 2002) were MEDLINE (264 retrieved, 18 identified for further analysis); CINAHL (716 retrieved, 21 identified for further analysis); and BNI (15 retrieved, seven identified for further analysis).

 RetrievedIdentified as requiring further analysis
MEDLINE259794
EMBASE20214
CINAHL142930
BNI2290 *
Web of Science/ISI9553
ASLIB Index of Theses**1912

 *This search was done last and no new unique records were identified.

** No date restrictions were applied.

Further analysis resulted in a total of 38 candidate studies. Many of these had to be excluded for reasons of research design. For 17 of the 29 excluded studies, there were insufficient data available about the methods or the results, particularly the nursing contribution to the record (see 'Characteristics of excluded studies' table). Nine studies met all the criteria and have been included in the review. The range of nursing record systems identified in the literature search was wide and included aspects of paper records, computerised records, problem‐oriented records, multidisciplinary records, care planning, patient‐held records, and the siting of records or computer terminals. However, the studies included in the review did not address all of the research questions posed in the review protocol, and we found no appropriate studies addressing questions 1, 2, 5, 6, and 7. There were four studies comparing a manual and a computerised system, which addressed question 3; three studies compared client‐held with centrally‐held records, which addressed question 4; and two studies compared differently structured paper records but did not compare structured with unstructured records, and so did not directly address question 1.

Of the nine studies included in the review, eight were RCTs: two of client‐held maternity records, one of a parent‐held child health record, one of a paediatric pain management sheet, one of a medical record with medical and nursing care planning forms, and three of computerised nursing record systems. One study was a controlled before and after study of a computerised nursing care planning system. These records were all designed for different healthcare and nursing purposes, and it was clearly not appropriate to combine the findings of these studies.

There are two new studies (Bosman 2003; From 2003) in the 2008 update. One study (Scharf 1997) that was included in previous versions has now been excluded, to comply with revised EPOC quality criteria for controlled before and after trials. As indicated above, the previous studies listed as ongoing have been removed. There is one possible ongoing study but only limited information is available.

Studies comparing client‐held records with centrally‐held records

In one of the client‐held maternity record studies (Elbourne 1987) it was hypothesised that the women holding their own maternity records would: be more satisfied with their maternity care, feel more confident and in control, find it easier to communicate with staff, suffer less depression, have better outcomes for labour and delivery, smoke less, be more likely to make use of maternity services, be more likely to breastfeed. It was also hypothesised that the availability of notes would be increased and clerical time saved. It was a RCT in which the necessary overall sample size was calculated to be 280 for the patient satisfaction factors in the study. Data were obtained from four self‐administered patient questionnaires and case notes. There were 317 women recruited to the study and, at the time of the final questionnaire, the response rate was 85% of the patients originally recruited.

Lovell 1987 also hypothesised that giving mothers their own maternity notes would have a positive effect on: their satisfaction with the care they received, their sense of control and self‐confidence, communications with staff, involvement of the babies' fathers, smoking and alcohol behaviour, breastfeeding, and attendance at clinics. They also aimed to assess any practical problems or effects on clinical outcomes. This was a RCT carried out in one hospital antenatal clinic in a socially disadvantaged area of South London. Data were obtained from self‐administered questionnaires at booking, 32 to 34 weeks' gestation, and postnatally (mostly in hospital); clinical and demographic information from the case notes; observations in the antenatal clinic; and 20 semi‐structured interviews with staff. There were 246 mothers considered eligible, before attending the clinic, of whom nine were subsequently found to be ineligible (for example having miscarried or moved away). It was difficult to work out the exact response rates for the questionnaires as the authors reported that the numbers of women responding to different questions varied, and in some tables they only presented the findings as percentages.

Lakhani 1984 aimed to evaluate the efficiency and effectiveness of a parent‐held child health record, as a means of improving communications between healthcare agencies and improving parents' uptake of health services. A RCT was carried out comparing groups of parents given or not given a child health record booklet. The study involved two postnatal wards in one teaching hospital over a period of four months, in 1980, and used a balanced random plan so that each ward was a control ward or a study ward for the same number of weeks during the study. The calculated necessary sample size was 225 in each group assuming an immunisation uptake of 70%, rising by 12% over the study period. No details were provided on adjustments to sample size or analysis with the type of clustering randomisation used. The final sample was 157 babies in the experimental group and 142 in the control group. The methods of evaluation were: interviews with the mothers; questionnaires for the health visitors, clinical medical officers, and general practitioners; and review of the entries in the record booklets.

Studies comparing paper records with differing structures

In the paediatric pain management study (Stevens 1990), the aim was to improve the pain management of children following surgery through the development and testing of a paediatric pain assessment and management flow sheet. This flow sheet was not just a tool for pain assessment but was also used for the whole process of evaluating, treating, and assessing the effectiveness of pain management. The author described the pre‐testing and implementation of the pain sheet that preceded the RCT, which compared the use of the pain sheet with the usual recording method. In the trial, 43 eligible patients were randomly assigned to one of two paediatric surgical units, and 24 nurses were randomly assigned to one of two nursing teams. Data were collected for 48 hours postoperatively (or until the child went home, if sooner) from the nurses' charts and medication records, and from a nurse satisfaction survey.

The planning form study report (From 2003) contained two related studies. The first was a before and after study (with no control) and data from that were not included in the review. The second study was a RCT of the effect on patient care of including a multidisciplinary care‐planning form in the medical record. The care planning was a two‐step process. In step one, the receiving nurse identified problems and drew up plans of action. These were recorded in the nursing records and on a green planning form included in the medical record. In step two, the medical specialist identified problems, plans of action, and a length of stay schedule, and this information was also recorded on the planning form. Patients admitted to the internal medical clinic of a university clinic over a period of six weeks were randomly allocated to continue with the planning form in the medical record (n = 154) or to have the planning form removed (n = 150) (control). The clinic had four specialised sub‐wards. The outcome measures were length of stay (LOS), length of stay comparisons (actual versus planned), risk of readmission, and accomplishment of plan of action. The mean LOS for the four different wards was compared (analysis by ward of discharge).

Studies comparing manual nursing care planning with computerised nursing care planning

One computerised nursing care planning study (Spranzo 1993) used a randomised block pre‐test, post‐test design. Four nursing wards in a large Veteran Affairs medical center were matched on two characteristics (nursing care needs and head nurse motivation) and then randomly assigned to an experimental or control group. The intervention was the introduction, on the experimental wards, of a computerised nursing care planning system; which was compared with the existing paper nursing care plans. The system was for care planning only and did not include assessment or progress notes, so was only one part of the total flow of nursing information. Data were collected contemporaneously by questionnaires to nurses six weeks before the implementation of the computerised system, and three months post‐implementation; by telephone interviews with patients three days after discharge, two months pre‐implementation, and three months post implementation; and by review of patients' clinical records. The number of patients involved in the study was 41 in the experimental group and 32 in the control group at the pre‐test stage, and 40 in both the experimental group and control group at the post‐test stage. There were 19 nurses in the experimental group and 21 in the control group in the pre‐ and post‐test stages of the project. Data were also collected from the hospital computerised administration systems for nursing hours, overtime, and sickness; and also for patients' length of hospital stay. The unit of allocation was nursing wards, although the units of analysis were nursing wards, nurses, and patients. Multiple regression analyses were carried out to control for selected covariates.

In the second study (Daly 2002), in one long‐term care facility, the intervention was the introduction of a computerised care‐planning system incorporating standardised nursing nomenclature, which was compared with an existing paper‐based system. In this study, 30 patients were randomly allocated to either the computerised or written care‐planning system on admission. The four registered nurses in the facility who were computer literate were assigned to the computerised system, and the four nurses who were not computer literate were assigned to the paper‐based system. It appeared that both systems were used for recording care as well as for care planning. Patient demographic data were collected on admission, together with all other study variables. Every month, for six months thereafter, all data were collected for each patient; except the Mini Mental State Examination (MMSE), care plan data, and time for care plan development, which were collected by the investigator every three months. The study lasted for 30 months in total.

The third study (Ammenwerth 2001) compared the conventional paper‐based documentation system in a psychiatric department of a university medical centre with a newly introduced computer‐based nursing documentation system. This was a RCT in which 60 patients were allocated to either the paper‐based or the computerised system on admission to the ward. Ten nurses worked continuously on the ward throughout the study and used both systems. The time period covered by the study was 13 weeks. A mixture of qualitative and quantitative data collection methods were used. All the nurses were interviewed at the beginning and after the end of the data collection, and were asked about their acceptance of computers. The computerised system was installed seven weeks in advance of the study. Measurements were started three weeks after the first patients were admitted and ended three weeks after the last patients were admitted. The average length of patient stay was 20 days. Sixty patients in total were recruited to the study, but full results were reported for only 40 patients, as the first 20 were discounted because of possible learning effects immediately after the training on the use of the system. Later publications by this team on their longitudinal evaluation (listed under Ammenwerth 2001) noted that acceptance of a computerised system may depend on attitudes towards documentation, and the ward culture (Ammenwerth et al 2003); a FITT framework (fit between individuals, task, and technology) was proposed to explain the different patterns of adoption found (Ammenwerth et al 2006). An interrupted time series design was used by the same team to examine the quality and quantity of nursing documentation (Mahler 2007) on four wards, but with only three time points. We could not include this in the present review.

The fourth study (Bosman 2003) compared the manual registration system used on an intensive care unit (ICU) with the Intensive Care Information System that was fully implemented for routine use seven months prior to the trial. This was described as a crossover randomised trial with patients randomly allocated to one or the other arm; the nurses were assigned (in a blinded manner) to the patient, so that the nurses were alternately exposed to both methods. The trial lasted for six weeks. The authors stated that all nurses were experienced and familiar with both methods of charting. Only patients with uncomplicated cardiothoracic surgery were included in the trial (145 out of 174 admitted were eligible). The observers were two experienced ICU nurses; activities observed included a set of admission tasks, and time‐motion analysis was used to observe the two nurses involved in admissions. For the registration tasks, work sampling was applied to observations made every five minutes; the activity was assigned to one of 148 items grouped into four categories (patient care, documentation, unit‐related activities, personal activities). Observations were made up to 11 hours after admission (mean 182 ± 122 min after admission, inter‐quartile 181 min, no reported differences between groups). The work‐sampling methodology was adapted from an existing published scheme. Only validated and manually entered values from the computerised system were collected for comparison, for the first 24 hours of data after ICU admission. Changes over time in the proportion of time spent on documentation and patient care activities were also recorded.

One pilot prototyping study (Choi 2004a) on a hand‐held information system for point of nursing care was identified as a possible ongoing study, but there were no details about the type of evaluation planned.

Allocation

Eight of the nine included studies were RCTs (Ammenwerth 2001; Bosman 2003; Daly 2002; Elbourne 1987; From 2003; Lakhani 1984; Lovell 1987; Stevens 1990).

A power calculation appeared to have been done in three RCT studies (Elbourne 1987; Lakhani 1984; Lovell 1987). Lakhani 1984 used a 'balanced random plan' to allocate wards but there were few other details of the clustering technique used; and outcomes were measured by individual patient (one baby per set of twins included).

The client‐held record studies (Elbourne 1987; Lakhani 1984; Lovell 1987) described how well the control and experimental groups were matched after the randomisation process, with tables comparing baseline characteristics in two (Elbourne 1987; Lovell 1987). Of the nursing care planning, nursing record, and pain management RCTs, three (Bosman 2003; From 2003; Stevens 1990) tabulated the baseline characteristics of the experimental and control groups. Minimal details were provided in two (Ammenwerth 2001; Daly 2002).

In the pain management study (Stevens 1990), both the nurses and patients were randomly allocated. Bosman 2003 was a patient randomised RCT but only nursing care process outcomes were compared, and nurses were not randomised. No details were provided on the patient randomisation process but the authors stated that the nurses were assigned to the patients by a head nurse who was unaware of the patient randomisation results. The patients in the experimental group had higher APACHE II and APACHE III scores than did the controls but were otherwise similar. From 2003 completed care planning prior to randomisation of patients; the groups were broadly similar in demographic characteristics and the patient outcomes measured.

Only one RCT (Elbourne 1987) described adequate allocation concealment.

The ninth included study (a CBA design) was a study of computerised nursing care planning (Spranzo 1993) and was described as a randomised block pre‐test, post‐test design. Four nursing units were randomly allocated to control or experimental groups but the units of analysis for almost all the outcomes were nurses or patients. There were baseline differences between the wards in that the experimental wards had a significantly higher level of patient intensity and a higher nursing workload than the control wards. In the implementation phase there was also a significant difference between the two experimental wards, and the author suggested that this might have added to the stress of implementing the computerised system.

Blinding

Blinded assessment of the outcomes was not reported in any of the studies, and might not have been possible for any of them because of the nature of the interventions. The records that were the source of the data for clinical outcomes were the intervention in each case, and even independent observers of nursing activity with a record system (as described in Bosman 2003) could not be ignorant of the allocation.

The nurses in Ammenwerth 2001 were themselves responsible for recording time spent on care documentation, whereas in Daly 2002 and Bosman 2003 the timings were done by the investigator. From 2003 noted that one of the two investigators was not independent, practising on one of the wards part of the time.

Incomplete outcome data

In one computerised record study (Daly 2002), 30 patients were randomly allocated but four patients died and six were discharged in less than seven months and were not included in the analysis. Bosman 2003 noted that 31 of the 145 eligible admissions were not observed but data were collected on the registration activities for all 145 patients. From 2003 noted that records were reviewed daily but, as not all categories of action could be recorded, the emphasis was on actions demanding collaboration with other departments. Patients were followed up for 120 days from the date of the second medical examination: to collect data on readmissions, date of discharge, and deaths after discharge. Ammenwerth 2001 excluded the first 20 of the 60 patients allocated from the data analysis as the first three weeks counted as the training period for the nurses.

The three client‐held record studies (Elbourne 1987; Lakhani 1984; Lovell 1987) reported the exclusion criteria used after allocation and the reasons for drop‐outs later in the studies. Withdrawals were mainly for medical or social reasons. Elbourne 1987 sent the final questionnaire to 93% of the original randomly allocated participants, and Lovell 1987 noted that most of the withdrawals for medical reasons were picked up in the clinical outcomes. Lakhani 1984 noted that 24% of the 479 mothers who started in the study had left the district after a year; of those interviewed (322 of 343 remaining in the study), data could only be obtained from 299 (62% of the original 479).

Selective reporting

The truncation in the presentation of data and results for publication of all these studies (for example reporting results as percentages only when the total numbers were not specified) has caused some difficulty in assessment for this review.

In Bosman 2003, some of the activities compared were only possible with one or the other of the systems. Time comparisons were reported for the top five most frequently observed documentation activities in both systems, but comparisons of two activities between the systems were not possible as the activities did not fall in the top five of both. The computerised system automatically calculated fluid balance and dealt with laboratory results and both these activities were in the top five of the paper documentation group. With Ammenwerth 2001, the care plan quality was difficult to assess reliably given the lack of care planning with the paper system.

Other potential sources of bias

There were several sources of contamination possible. Elbourne and Lakhani (Elbourne 1987; Lakhani 1984) both reported episodes in which clients from the control group were given the experimental record, and vice versa. They reported the steps taken to deal with this in the analysis. In the computerised nursing care planning study, Spranzo 1993 described steps taken to prevent contamination between the control and experimental wards; but it was not clear in the pain management study (Stevens 1990) whether there might have been contamination between the nurses working on the experimental and the control wards. The effect of explicitly taking the parents' views of the children's pain into account in the experimental group, but not in the control group, was also not clear. The author also noted the variety of ages and diagnoses in the two patient groups, the small sample size, and the lack of independent pain ratings or the consideration of any pain‐relieving interventions other than drugs.

In two computerised nursing record system studies (Ammenwerth 2001; Daly 2002), the paper and computerised systems were being used in the same departments; and in the intensive care information system study (Bosman 2003) nurses were 'alternately exposed' to both paper and computerised charting. In Ammenwerth 2001 the nurses were using both systems and knew which patients had which kind of record; and in Daly 2002, although the nurses were assigned to use one system or the other, it must have been possible for them to take part in the care of patients from the other group. In From 2003 it was unclear how nurses may have used the planning information separately copied into their own records but there seemed to be potential for contamination between the groups.

Several of the studies had unit of analysis errors. In the child health record study (Lakhani 1984), postnatal wards were the unit of allocation but babies were the unit of analysis. In Bosman 2003 the patients were the unit of allocation but nurses (individuals in the registration phase or pairs during admission) were the unit of analysis.

In Spranzo 1993 the unit of analysis error caused difficulties in the analysis and significance of the results. The author also noted the small numbers in the study and that three months from the introduction of the intervention to measurement of outcomes might have been too short a time period. The author noted the possibility of systematic error in data collection and a threat to internal validity through compensatory rivalry between the groups of nurses. However, the author described the selection of potential covariates and the multiple regression analyses undertaken to account for them. This appeared to have been done both logically and thoroughly. Repeated measure ANOVA were computed for each of the study variables, with type of care plan as the independent variable, in one of the other computerised record system studies (Daly 2002). This appeared to have been done systematically and the authors reported on between participants, within participants, and interaction effects.

The effects of timing of intervention, training periods, measurement periods, and the attitudes of nurses were hard to disentangle. In two of the computerised record studies (Ammenwerth 2001; Spranzo 1993), the attitudes of the nurses to computer use were assessed; but there was no mention of this in Daly 2002, only that half the nurses were 'computer literate' and half were not. In Daly 2002 the nurses who were assessed as computer literate were assigned to the computerised system, the non‐computer literate nurses were assigned to the paper system, which made valid comparisons more difficult. The study by Bosman 2003 was conducted some months after implementation of the computerised system, and the authors stated that nurses were familiar with both types of system (paper and computerised).

Studies comparing client‐held records with centrally‐held records

The results of the client‐held record studies (Elbourne 1987; Lakhani 1984; Lovell 1987) showed no consistent positive or negative effect for clients holding their own records. The maternity record studies (Elbourne 1987; Lovell 1987) showed no statistically significant differences in clinical outcomes between the women holding their own maternity notes and those with conventional cooperation cards, except that Lovell 1987 reported significantly more assisted deliveries in the study group. They suggested that this was related to the higher number of women in this group having epidural anaesthesia. Elbourne 1987 reported that women holding their own notes were more likely to say they felt more in control of their pregnancies (author reported rate ratio 1.45; 95% confidence interval (CI) 1.08 to 1.95), and to say they found it easier to talk to the doctors and midwives antenatally (rate ratio 1.73; 95% CI 1.16 to 2.59); although they also reported that women tended to find the notes more difficult to read and understand. Lovell 1987 reported statistically significant differences between the study and control groups for the women who thought they had not been at all well informed during pregnancy (author reported P < 0.01), and for those who had been able to have their chosen companion with them in labour (author reported P < 0.05). Asked about which kind of notes they would prefer in future, Elbourne 1987 reported that women showed a tendency towards the system they were familiar with, although this was greater for women holding their own notes (author reported rate ratio 1.55; 95% CI 1.34 to 1.81); Lovell 1987 reported significantly more women in the study than the control group wishing to carry their notes in a future pregnancy (P < 0.001) and approximately one‐third of the control group also stated a preference for carrying their case notes. No other significant effects were reported, although both studies suggested that there were some administrative benefits because of fewer problems with missing notes; although women did very occasionally forget to take their notes to the clinic they never lost their own notes.

In the parent‐held child health record study (Lakhani 1984), after one year's use the authors reported favourable comments on the booklet: from all the health professionals who responded to the questionnaires, and from the mothers who had received a booklet. There was, however, little apparent difference between the two groups in the uptake of immunisation (diphtheria/tetanus/polio first dose (experimental versus control): 89.8% versus 94.4%; second dose: 75.8% versus 85.2%; third dose: 22.3% versus 31.0%. Pertussis first dose (experimental versus control): 64.3% versus 57.8%; second dose: 58.0% versus 59.2%; third dose: 19.1% versus 19.0%) or developmental checks (first assessment (experimental versus control): 96.2% versus 97.9%; second assessment: 78.3% versus 83.8%).

Studies comparing paper records with differing structures

The pain management study (Stevens 1990) indicated a positive effect for the use of the flow sheet. This was based on the mean pain intensity ratings of the two groups reported on a scale of 0 to 10 as: 6.8/10 in the control group, and 4.2/10 in the experimental group (author reported P < 0.01); measured using an adapted form of the Children's Hospital of Eastern Ontario Pain Scale (CHEOPS). The author also reported that the children in the experimental group were assessed more frequently than those in the control group (5.4 versus 3.9 times in 24 hours, P < 0.01), and the experimental group received more analgesia than the control group (total doses 78 versus 34, P < 0.01). The study was extended for four weeks to give all the nurses experience in using the pain management sheet and in a subsequent satisfaction survey: 15 of the 24 nurses preferred the new flow sheet, eight preferred the existing method, and one was undecided.

In the integrated record study (From 2003), the use of planning forms with the medical record was associated with a higher accuracy of planned length of stay (LOS) (the unadjusted mean difference of actual LOS minus planned LOS was 2.5 ± 5.6 days compared to 3.8 ± 6.5 days). The authors stated that the difference was significant (P = 0.02) when tested in a general linear model adjusting for ward of discharge: adjusted mean difference of 1.5 days (2.5 days compared to 4.0 days longer than planned) (95% CI 0.2 to 2.8 days). The mean LOS for patients with the planning form (using a general linear model) was 6.1 days compared to 7.6 days, a difference of 1.5 days (P = 0.02, 95% CI 0.2 to 2.7 days) (figures in table VII of paper, 6.2 days compared to 7.48 days, were not adjusted for ward of discharge). The authors stated that the accomplishment of the plan of action and the risk of readmission were unaffected.

Studies comparing manual nursing care planning with computerised nursing care planning

The computerised nursing care planning study (Spranzo 1993), after controlling for selected covariates, showed only a negative effect of the computerised system on documented nursing care planning. Care planning increased on the control wards at the time of the post‐test (pre‐test: 28.08 versus 26.61, post‐test: 28.03 versus 33.30) and the author suggested that compensatory rivalry between the nurses might have contributed to this finding. No significant effects on patient outcomes were demonstrated, although there was a nonsignificant inverse relationship between the computerised system and patient satisfaction (pre‐test: 50.83 versus 48.84, post‐test: 49.98 versus 51.55) and readiness for self care (pre‐test: 20.73 versus 20.75, post‐test: 20.23 versus 20.83). There was also an inverse, but not significant, relationship between the computerised system and nurse attitudes to care planning (pre‐test: 67.1 versus 63.2, post‐test: 59.7 versus 63.4). No significant effect was found on nurse sickness, overtime, or job turnover. The baseline imbalance between the two groups may have been responsible for differences in the between‐group and within‐group values for some outcomes in this study.

The study comparing a paper‐based record system with a computerised nursing record system (with a standardised nursing nomenclature) in a long‐term care facility (Daly 2002) showed no differences in patient outcomes between the two groups. The study did, however, show significant differences in the recording process itself. The time taken to produce the computerised record was significantly longer than for the paper‐based record (for example 3.78 h versus 2.31 h for the last time period (P = 0.002) for preparation time differences over all seven time periods measured), although the time spent on documentation generally decreased in both groups over the study period. Nursing diagnoses were similar for the two groups, although the authors reported a few more diagnoses made in the computerised group; there were considerable differences in the number of recorded nursing interventions (author reported P = 0.001) and activities (author reported P = 0.007). The authors reported that the director of nursing at the study site indicated that the nurses using the paper‐based system did not record all the care that was actually given whilst the nurses using the computerised system recorded everything.

The third study comparing paper‐based and computerised nursing records (Ammenwerth 2001) did not include any patient outcomes. The authors reported that planning and documentation of tasks took significantly more time with the computerised system (4.8 min compared to 2.0 min per day, P = 0.004); similarly, report writing took significantly longer (6.6 min compared to 4.7 min per day, P = 0.019). There was no significant difference between the groups for care planning (16.4 min compared to 43.3 min per day, P = 0.131). The authors suggested that this was because only a small number of care plans (11 experimental and six control) were prepared. In this study, the documentation was reviewed by external nurse experts who reported that although the average number of aims and tasks were higher in the computerised care plans, only 80% of the planned tasks were carried out in the experimental group whilst 100% were carried out in the control group. The expert nurses gave a similar rating for the overall quality of the care plans in both groups. The legibility of the computerised plans was considerably better than in the paper‐based plans. In this study the physicians were asked their opinion of the two systems and three of the five doctors said that they read the computerised nursing record more often than in the previous system. The later interrupted‐time series study (three time points) (Mahler 2007) of four wards found that documentation quantity increased after the implementation of the computerised system, and the quality of documentation increased on three of the four wards.

The fourth study, Bosman 2003 compared the proportion of time devoted to different categories of nursing activities as well as the time spent on various documentation activities (recalculated to indicate total time spent based on an eight‐hour shift). Time‐motion analysis for the admission phase indicated that the mean duration of the admission was slightly longer with the computerised system (18.1 ± 4.1 min compared to 16.8 ± 3.1 min, and the difference (1.3 min) was statistically significant (95% CI 0.04 to 2.72). For the registration phase, the nurses using the computerised system spent significantly less time on documentation activities (14.4% of observations compared to 20.5% (difference ‐6.1%; 95% CI ‐8.1 to ‐4.0)) and significantly more time on patient care (61% of observations compared to 54.9% (difference 6.1%; 95% CI 3.5 to 8.8). The differences for unit‐related and personal activities were not significant (difference of proportion 95% CI ‐2.1 to 0.0; ‐1.2 to 3.2, respectively). The difference in proportion of time spent on documentation compared to patient care varied with time after admission, but at the majority of time points the time spent on documentation and patient care varied significantly. The reduction was attributed to the time spent on hourly checks, entering of laboratory results (only done on the manual system), and calculation of fluid balance (only done on the manual system). The average number of vital sign annotations was significantly higher, on 17 out of the 24 hours, for the computerised intensive care information system (ICIS) compared to the paper system. The proportion of observations of time spent on reviewing or writing medical and nurses' notes in fact increased with the ICIS (9.4% compared to 5.0%), as did the shift change documentation (10.1% compared to 6.7%). The logging and validation of hourly checks remained the same as a proportion of documentation activities (29.4% in both groups), although the absolute number of observed logging and validation activities decreased. The estimates of time spent, based on an eight‐hour shift, indicated that the logging and validation of hourly checks took less time with the ICIS (20.3 min compared to 28.8 min) and two activities took longer with the ICIS: the shift change (7.0 min versus 6.6 min) and the reviewing and writing of medical and nurses' notes (6.5 min versus 5.0 min).

This review of the nursing records literature was initiated in 1998 in response to the move to develop effective computerised systems for recording nursing care. It was realised that merely automating existing paper record systems was not the answer, and that the means to develop systems that accurately captured nursing practice lay in first acquiring a deep understanding of the complexities of the art and science of nursing itself. The review of the last 60 years of the literature on nursing records suggested that nurses and other healthcare professionals believe that there should be a link between nurse record keeping and the quality of care that patients receive. Although this review suggests that the body of rigorous research evidence on the topic is still very sparse, there is no doubt that nursing records is a topic that has been widely and extensively discussed in the professional literature. However, none of the studies produced results that could be interpreted as evidence of a change in practice that resulted from a change of record system. The studies indicate that nurses concur with professional bodies (for example ANA 2008; NMC 2008) that there is a link between their clinical practice and the nursing record that is beyond its obvious use as a notekeeping system. The client‐held record studies suggest altered and improved relationships between clients and health professionals; the pain management study sought to demonstrate a direct effect on patient care. The use and effectiveness of nursing care planning as a nursing activity is brought into question by the computerised care planning studies. In the controlled before and after study (Spranzo 1993), the author noted that the measured quality of nursing care remained constant despite the difference in documented care planning, and the study in a long‐term care facility (Daly 2002) showed no differences in patient outcomes between the computerised and paper‐based systems. The expert nurses who reviewed the documentation in the third study (Ammenwerth 2001) noted that there were no differences in the overall quality of the nursing documentation (although the extended study found that documentation quality improved on three of the four wards). Spranzo 1993 suggests that simply automating an existing paper system might not be expected to have an effect on the quality of care, Daly 2002 thought that the use of a standardised nomenclature within the computerised system would have an effect on patient care; but the results of these studies show that whilst the documentation changed the patient care given remained the same. This may not be surprising as in two of these studies the different systems were being used by a small number of nurses on the same ward. Preparation for change may need to be planned more carefully and with more awareness of the needs of nurses. A pre‐test, post‐test study (Thoroddsen 2007) of the implementation of nursing languages in nursing documentation details substantial collaborative work involved in the implementation, as well as research to develop a valid measurement instrument. What is being documented, how, and why deserves attention.

The objective of the review was to establish the impact of nursing record systems on nursing practice and patient outcomes. The identified studies provide no evidence of any measurable difference, in nursing practice or patient outcomes, between the use of one kind of nursing record system or another. There may be social or administrative reasons for giving clients custody of their own records but there is no clear evidence of any clinical or psychological benefit. The results of the pain management study (Stevens 1990) suggest a beneficial effect might be obtained from a highly structured recording system. The study might be repeated, in a larger trial over a longer period of time, and might be extended to the care of adults as well as children, to see whether this is a real effect and whether it could be sustained. The use of a care planning form, with both the nurses' care plan and the medical care plan, that is integrated with a medical record may have an effect on patient care outcomes. Yet we have no details about the use the nurses may have made of a nursing care planning form retained within a separate nursing record, and details about the estimation of accomplishment of plans of action are very limited. There is a need for more research on how a multidisciplinary record might be used by the professionals who contribute to the record. It is unclear whether LOS is a good process indicator to use in relation to patient outcomes (From 2003).

The computerised nursing care planning study (Spranzo 1993) raises a number of important issues. It is well thought out and carefully and thoroughly executed. The author discussed how the equivocal results of this study resembled the conflicting findings of the many other similar (but less well conducted) investigations in this area. The computerised care planning system used here was not linked to a patient assessment system or to progress reporting and did not provide any prompts or reminders. The author noted that the nurses were not involved in the development of the system, so that its use in practice had not been well thought out. She stated that it might thus have been possible to "have moved the Computerised Nurse Care Planning beyond a documentation tool and into the realm of actual use to improve provider strategies for care".

Two other computerised record studies did include the full range of nursing documentation but they too failed to show changes in patient care or patient outcomes, and both studies indicated that more nurse time was required for the computerised systems. However, the numbers of patients and nurses in these studies were very small and larger studies, more rigorously controlled, might provide more robust results. Another computerised record study (Bosman 2003) showed that the proportion of time allocated to patient care increased with the use of computerised system (the proportion of time spent on unit‐related or personal activities remained very similar). The decrease in time spent on documentation is not unexpected, as some of the tasks required for the paper record system were wholly or partly automated with the computerised system (for example logging of hourly checks, laboratory results, and calculating fluid balance). The calculations indicate that the times required for reviewing and writing medical and nurses' notes and shift change documentation were slightly greater with the computerised system, although these activities do not account for as much time as some of the other documentation activities.

The methodological shortcomings of the studies both included and excluded from this review have been discussed in detail above. It is clear that in the field of nursing record systems, as the methodology of nursing, health services and health informatics research develop, almost all these problems could be overcome. Several of the included and excluded studies suggest that an interrupted time series design would be appropriate and feasible, but the difficulty would be to ensure sufficient planning to collect data from an adequate number of time points before systems are changed.

However, Spranzo 1993 provides the clue to the more fundamental problem which appears to have bedevilled the research in this area to date. This is the problem of regarding the nursing record simply as a documentation tool that has to be completed to standards, for example of the Joint Commission on Accreditation of Healthcare Organisations (JCAHO), or as paperwork that takes time to complete which might otherwise be spent at the bedside. One of the criteria for including studies in this review is that there should be objective measures of professional behaviour or patient outcomes, and the studies described here have all targeted their intervention towards some ultimate improvement in patient care. It would seem that it is only as the different purposes of the nursing record, and the ways in which it underpins care, are explored and understood that the right questions can be framed and the appropriate research studies designed, which can then lead the profession towards nursing record systems that are proven to be effective and are experienced as a necessary part of nursing practice.

Qualitative nursing research could provide better understanding of nursing practice and of the kinds of record systems that would fully support effective nursing practice, but a search for qualitative data in this area (Urquhart 2005) revealed a surprisingly small number of studies. Imaginative qualitative research could be used as the precursor to well‐designed trials of nursing information systems in which nurses, health services, system suppliers, and patients could have confidence.

The studies in this review (Bosman 2003; Elbourne 1987; Lakhani 1984; Lovell 1987; Stevens 1990) that set out to solve a relatively discrete and focused problem, for example effective pain management in children; empowering pregnant women and parents; reducing the loss of notes, time spent on data entry of test results, transcription errors, the number of pieces of paper in a record, all demonstrate some degree of success in achieving the desired results. The studies which, despite sophisticated study designs, still leave uncertain and equivocal results are the studies of nursing care planning systems and of the total nurse record. The recent, wider literature shows that, despite the developments in technology and investment in electronic records in health systems over the last 10 years, nursing records remain problematical. Record keeping is still seen as an extra burden, an administrative concern (NHS 2006) that is not an integral part of the care of patients, as professional regulators stress it should be (NMC 2008). Even the literature on the provision of decision support systems has failed to show conclusive benefits for nurses in their practice (York 2007). Many authors have identified the lack of engagement of clinical nurses in the development of nursing record systems as a cause of failure, and this may well be a contributory factor. 

We suggest, however, that the problem lies far deeper, in the nursing professions' understanding of nursing itself and how it is taught and practised. Nursing is variously seen as a process, a problem‐solving activity, or a caring art or science, which all offer different ways of articulating what is done with patients. But so far no demonstrably effective record systems have been developed to support any of these approaches. It is suggested that the design of nurse record systems has to be returned to the profession as an integral part of the development of the theory of nursing.

Further research is required in this area. This review has shown that this is a topic of concern to healthcare professionals and to administrators. However, the focus of this concern and the research questions asked could now be better informed by the growing body of knowledge and expertise in health informatics. There is an opportunity to gain greater understanding of nursing practice through an exploration of the information it uses rather than simply addressing administrative issues, important as these may be. There is still a need for research into the relationship between clinical practice and its understanding and written expression by nurses. It is clear from the literature that the full range of the functions of a clinical nursing record are not well understood, and that exploratory research using qualitative techniques is required before more focused trials are undertaken. Effective nursing record systems will probably be shown to be as diverse as nursing practice itself. The challenge for nursing is to understand what characteristics of nursing practice are best served by which characteristics of record systems (Urquhart 2005). For example, which kind of practice needs a structured record, which kind needs to allow mostly free text? What aspects of nursing care need to be recorded and shared electronically, and which aspects of care are best served by a paper or voice format? Indeed, what aspects of nursing care need to be recorded at all? But the key question is ‐ how will an effective nursing record be recognised? This is a fundamental question which cannot be answered until the purposes of record keeping have been fully articulated. The review shows that this has yet to take place.

These conceptual issues must be tackled, but the need to design and carry through research projects (both quantitative and qualitative) based on sound scientific methods must also be addressed. It is disturbing that so many studies of poor methodological quality should have been found in this topic area as they represent a considerable amount of effort and expense for little benefit or reward. There are many reasons why so much work in this area of nursing is so unsatisfactory. Some of these reasons are related to the lack of basic health informatics research, described above; and some are made explicit in the publications, particularly the late involvement of nursing staff in the procurement and implementation of computerised systems, and the difficulties of carrying out research projects across a number of units within healthcare institutions that are never static. This is particularly well illustrated by the studies by van Gennip 1995 and Burkle 1995. However, the study by Spranzo 1993 shows that it is possible to carry through a well thought out and rigorous investigation; and that many of the studies could easily have been improved. It is clear that RCTs and other experimental and quasi‐experimental designs would be able to address questions in this area. The most valid timing of an RCT needs to be discussed. Bosman 2003 conducted the RCT over six months after implementation of the computerised system, other RCTs have been done close to the time of implementation. Practice changes may require time to develop and this means that longitudinal evaluation may be helpful. For example, this could be done by preparing ahead of time for a change; and taking measurements at appropriate intervals for a time series analysis; or including control units in both the before and after stages of a study and continuing testing beyond the implementation phase of projects, into the maturity of the record system. There are, however, indications that finding a valid control site is difficult (Ammenwerth 2001‐ study by Ammenwerth 2003). The development of effective nursing record systems, together with all health and medical record systems, is certainly a difficult area for research but one in which rigorous research is both necessary and possible.

The review authors wish to acknowledge the support of the Wales Office of Research and Development in Health and Social Care, who funded the original review, and the 2007 to 2008 Department of Health (England) Incentive Scheme for Cochrane reviews and updates for funding for the update. We would like to acknowledge the work of Paul Wainwright, who was a co‐reviewer for the original review. We are also grateful to the EPOC Editorial Team for their support and encouragement. The review and updates could not have been completed without considerable help from the staff of several libraries, in the UK and USA, but particular thanks go to the staff of the libraries at Aberystwyth University, the Royal College of Nursing, University of Salford, and Suffolk Primary Care Trust. And finally, we are very grateful to all those in the nursing research and nursing informatics community who gave us help, support, information about their studies, and encouragement.

Appendix ‐ MEDLINE OVID Search Interface

1.    Evaluation Studies/

2.    Nursing Evaluation Research/

3.    Nursing Administration Research/

4.    "Costs and Cost Analysis"/

5.    Cost‐Benefit Analysis/

6.    exp "Outcome and Process Assessment (Health Care)"/

7.    exp "Task Performance and Analysis"/

8.    Clinical Nursing Research/

9.    Workload/

10.  exp Nursing Staff/

11.  Medical Records/

12.  "Forms and Records Control"/

13.  Medical Records, Problem‐Oriented/

14.  Nursing Records/

15.  Medical Records Systems, Computerized/

16.  Documentation/

17.  Point‐of‐Care Systems/

18.  Patient Care Planning/

19.  Hospital Information Systems/

20.  randomized controlled trial.pt.

21.  controlled clinical trial.pt.

22.  Intervention Studies/

23.  experiment$.tw.

24.  time adj series).tw.

25.  pre test or pretest or (post test or posttest)).tw.

26.  Random Allocation/

27.  impact.tw.

28.  intervention?.tw.

29.  chang$.tw.

30.  evaluat$.tw.

31.  effect?.tw.

32.  comparative study.pt.

33.  1 or 2 or 3 or 4 or 5 or 6 or 7 or 8 or 9 or 10

34.  11 or 12 or 13 or 14 or 15 or 16 or 17 or 18 or 19

35.  20 or 21 or 22 or 23 or 24 or 25 or 26 or 27 or 28 or 29 or 30 or 31 or 32

36.  33 and 34 and 35

37.  limit 36 to yr="2003 ‐ 2007"

o   / indicates subject heading.

o   exp indicates retrieving results using the selected term and all of its more specific terms.

o   .pt. indicates publication type.

o   $ indicates unlimited truncation retrieves all possible suffix variations of the root word.

o   .tw. indicates searching for the exact word or phrase in the titles and/or abstracts of articles.

o   ? indicates a ‘wild card’ can be used within or at the end of a search term to substitute for one or no characters.

Appendix ‐ EMBASE NLH Search 2.0

1.    MEDICAL RECORD/

2.    MEDICAL DOCUMENTATION/

3.    HOSPITAL INFORMATION SYSTEM/

4.    PATIENT CARE PLANNING/

5.    1 OR 2 OR 3 OR 4

6.    EVALUATION/

7.    NURSING EVALUATION RESEARCH/

8.    COST/

9.    COST BENEFIT ANALYSIS/

10.  OUTCOME ASSESSMENT/

11.  TASK PERFORMANCE/

12.  CLINICAL NURSING RESEARCH/

13.  WORKLOAD/

14.  NURSING STAFF/

15.  NURSING ADMINISTRATION RESEARCH/

16.  6 OR 7 OR 8 OR 9 OR 10 OR 11 OR 12 OR 13 OR 14 OR 15

17.  RANDOMIZED CONTROLLED TRIAL/

18.  random*.af

19.  experiment*.af

20.  (time ADJ series).af

21.  ((pre ADJ test) OR pretest OR (post ADJ test) OR posttest).af

22.  impact.af

23.  intervention*.af

24.  chang*.af

25.  control*.af

26.  evaluat*.af

27.  COMPARATIVE STUDY/

28.  CONTROLLED CLINICAL TRIAL/

29.  17 OR 18 OR 19 OR 20 OR 21 OR 22 OR 23 OR 24 OR 25 OR 26 OR 27 OR 28

30.  5 AND 16 AND 29

31.  5 AND 16 AND 29 [Limit to: Publication Year 2003‐2007]

o   / indicates subject heading.

o   * indicates unlimited truncation retrieves all possible suffix variations of the root word.

o   .af indicates a search undertaken in any field.

o   ADJ indicates that the words separated by ADJ have to be next to each other.

Appendix ‐ CINAHL Ovid Search Interface

1.    exp Nursing Protocols/

2.    Nursing Records/

3.    Problem Oriented Records/

4.    Computerized Patient Record/

5.    Charting/

6.    DOCUMENTATION/

7.    Pain Measurement/

8.    Clinical Information Systems/

9.    exp Patient Record Systems/

10.  Hospital Information Systems/

11.  Clinical Assessment Tools/

12.  Nursing Outcomes/

13.  exp "Process Assessment (Health Care)"/

14.  "Record Review"/

15.  exp Evaluation Research/

16.  "Outcomes (Health Care)"/

17.  exp "Task Performance and Analysis"/

18.  Program Evaluation/

19.  Change Management/

20.  "Cost Benefit Analysis"/

21.  "COSTS AND COST ANALYSIS"/

22.  Quality Assurance/

23.  PRODUCTIVITY/

24.  Job Performance/

25.  clinical trial.pt.

26.  exp Pretest‐Posttest Design/

27.  exp Prospective Studies/

28.  Random Assignment/

29.  Comparative Studies/

30.  1 or 2 or 3 or 4 or 5 or 6 or 7 or 8 or 9 or 10

31.  11 or 12 or 13 or 14 or 15 or 16 or 17 or 18 or 19 or 20 or 21 or 22 or 23 or 24

32.  25 or 26 or 27 or 28 or 29

33.  30 and 31 and 32

34.  limit 33 to yr="2003 ‐ 2007"

o   exp indicates retrieving results using the selected term and all of its more specific terms.

o   / indicates subject heading.

o   .pt. indicates publication type.

Appendix British Nursing Index OVID Search Interface

1.      health economics/

2.      "outcomes and prognoses"/

3.      "standards and guidelines"/

4.      patients records/

5.      evaluat*.ti.

6.      evaluat*.ab.

7.      management information systems/

8.      "care plans and planning"/

9.      randomised controlled trial*.ti.

10.  randomised controlled trial*.ab.

11.  randomized controlled trial*.ti.

12.  randomized controlled trial*.ab.

13.  controlled clinical trial*.ti.

14.  controlled clinical trial*.ab.

15.  pre test.ti.

16.  pretest.ti.

17.  pre test.ab.

18.  pretest.ab.

19.  post test.ti.

20.  posttest.ti.

21.  post test.ab.

22.  posttest.ab.

23.  time series.ti.

24.  time series.ab.

25.  impact.ti.

26.  impact.ab.

27.  intervention*.ti.

28.  intervention*.ab.

29.  chang*.ti.

30.  chang*.ab.

31.  effect*.ti.

32.  effect*.ab.

33.  1 or 2 or 3 or 4 or 5 or 6

34.  7 or 8

35.  9 or 10 or 11 or 12 or 13 or 14 or 15 or 16 or 17 or 18 or 19 or 20 or 21 or 22 or 23 or 24 or 25 or 26 or 27 or 28 or 29 or 30 or 31 or 32

36.  33 and 34 and 35

37.  limit 36 to yr="2001 ‐ 2002"

38.  limit 36 to yr="2003 ‐ 2007"

o        / indicates subject heading.

Withdrawn from publication for reasons stated in the review

Experimental nursing record system compared with conventional record

Outcome or subgroup titleNo. of studiesNo. of participantsStatistical methodEffect size
1 Results

Comparison 1 Experimental nursing record system compared with conventional record, Outcome 1 Results.

StudyTimings of Outcome MTargeted BehaviourMain Process EffectMain Outcome EffectNotes
Ammenwerth 200110 weeks for nurse time measurements and 13 weeks for quality of documentation. Pre‐intervention and after 13 weeks for nurse satisfaction. After 13 weeks for physician attitudes.To measure the differences between a computerised nursing documentation system and a paper based systemNurse time spent on documentation: Care planning (Based on 11/20 vs 6/20 patient records) mean time 16.4 mins. vs 43.3.mins. % difference: 62% (intervention group better) Authors report p = 0.131 Planning and documentation of tasks (based on 18/20 vs 13/20 patient records) mean time 4.8 vs 2.0 mins. % difference 140% Authors report p = 0.004 Report writing (based on 19/20 vs 19/20 patient records) mean time 6.6 mins vs 4.7 mins. % difference 40% Authors report p = 0.019 Quality of documentation (n=30 vs 30): Amount of documentation with a complete care plan: 79.3% vs 50% Average no of problems in care plan: 5.6 vs 3.5 % difference 60% Average no of aims in care plan: 11.3 vs 3.3 % difference 242% Average no of tasks in care plan 18.7 vs 3.8 % difference 392% Percentage of documentation where all planned tasks have actually been executed: 80% vs 100% Percentage of documentation in which all items correctly signed: 100% vs 34.7% Percentage of documentation where everything considered legible: 100% vs 14.3% Overall quality (5 point scale 1= minimum quality and 5 = maximum quality) 2.4 vs 2.3. % difference 4% Nurse acceptance of computerised system pre and post intervention: Authors report difference in acceptance of computers as not significant (p = 0.203) but significant difference in acceptance of computers for nursing documentation (p = 0.034) (Actual results not given). Physician acceptance of the computerised nursing documentation system: ( n= 4/5) Authors report that all 4 physicians agreed nursing documentation is important for medical decision making and all now read the nursing reports, but not the care plans.No outcome effects were measured in this study.Nurse documentation time was measured for only 40 study patients, but documentation quality was measured for all 60 patients.
Bosman 20036 consecutive weeks, covering admission and registration phases.During registration, 5300 observations, totalling 441 hours of observation were made (2675 experimental, 2625 control observations)

Observations spanned the time from end of admission up to 11 hours after admission, mean 182±122 minutes after admission

To enhance documentation without increasing proportion of nursing time devoted to documentationAdmission phase:Duration of admission (18.1±4.1 versus 16.8 ± 3.1 minutes), absolute difference +1.3 minutes, relative % change ‐7.7%, (control group better)Registration phase:Percentage of observations on categories of nursing activities:Patient care 61% vs 54.9 %, absolute difference +6.1%, 95% CI (+3.5 to +8.8 ), relative % difference +11.1% (experimental group better)Documentation 14.4% vs. 20.5%, absolute difference ‐6.1%, 95% CI (‐8.1 to ‐4.0), relative % difference ‐29.8%, (experimental group better)Unit‐related 3.3% vs 4.3%, absolute difference ‐1.0%, 95% CI (‐2.1 to +0.0), relative % difference ‐23.3%Personal 21.2% vs 20.3% absolute difference 0.9%, 95% CI(‐1.2 to +3.2), relative % difference ‐4.4%)  Frequently observed documentation activities:Logging/validation of hourly checks: percentage of observations in category (29.4% vs 29.4%, no change); estimated time spent 20.3 vs 28.8 minutes, absolute difference ‐8.5 minutes per shift, relative % difference ‐29.5% (experimental group better) Shift change: percentage of observations in category (10.1% vs 6.7%, relative % difference +50.7%; estimated time spent 7.0 vs 6.6 minutes, absolute difference + 0.4 minutes per shift, relative % difference +6.1% (control group better) 

Reviewing/writing medical/nurses’ notes: percentage of observations in category (9.4% vs 5.0%, relative % change +88%; estimated time spent 6.5 vs 5.0 minutes, absolute difference +1.5 minutes per shift, relative % difference +30.0% (control group better)

No patient outcome effects measuredAdmission data based on 114 admissions (31 admissions not observed(.
Registration phase data based on 145 patients (authors imply this)
Daly 2002All outcomes within 21 days of admission and every month for 6 months. Cognition, care plan data and time for care plan development collected every 3 months.To measure the differences between the use of standardised nursing nomenclature in a computerised nursing care planning system with usual paper based care plans.Nurse time developing care plans: Hours spent at Time Period 1: 7.6 vs 4.27 Time Period 4: 4.35 vs 2.13 Absolute change (post): 2.22 hrs Relative % change (post): 104.2% (control shorter) Absolute change from baseline: ‐3.25 vs ‐2.14 Difference in absolute change: ‐1.11 hours (control shorter) Hours spent at Time Period 1: 7.6 vs 4.27 Time Period 7: 3.78 vs 2.31 Absolute change (post): 1.47 hrs Relative % change (post): 63.6% (control shorter) Absolute change from baseline: ‐3.82 vs ‐1.96 Difference in absolute change: ‐1.86 hours (control shorter) Nos of Nursing Diagnoses: No of diagnoses at Time Period 1: 12 vs 9 Time Period 4: 11 vs 9 Absolute change (post): 2 Relative % change (post): 22.2% Absolute change from baseline: ‐1 vs 0 Difference in absolute change: ‐1 No of diagnoses at Time Period 1: 12 vs 9 Time Period 7: 11 vs 8 Absolute change (post): 3 Relative % change (post): 37.5% Absolute change from baseline: ‐1 vs ‐1 Difference in absolute change: 0 Nos of Nursing Interventions: No of nursing interventions at Time Period 1: 22 vs 9 Time Period 4: 22 vs 9 Absolute change (post): 13 Relative % change (post): 144.4% Absolute change from baseline: 0 Difference in absolute change: 0 No of nursing interventions at Time Period 1: 22 vs 9 Time Period 7: 22 vs 9 Absolute change (post): 13 Relative % change (post): 144.4% Absolute change from baseline: 0 Difference in absolute change: 0 Nos of Nursing Activities: No of nursing activities at Time Period 1: 421 vs 29 Time Period 4: 233 vs 29 Absolute change (post): 204 Relative % change (post): 703.4% Absolute change from baseline: ‐188 vs 0 Difference in absolute change: ‐188 No of nursing activities at Time Period 1: 4212 vs 29 Time Period 7: 235 vs 29 Absolute change (post): 206 Relative % change (post): 710.3% Absolute change from baseline: ‐180 vs 0 Difference in absolute change: ‐180 Nos of Nursing Diagnoses: Nos of Nursing Interventions: Nos of Nursing Activites:Index of Independence in Activities of Daily Living: Difference in mean score at Time Period 1: 3.6 vs 2.9 Time Period 4: 3.4 vs 2.3 Absolute change (post): 1.1 Relative % change (post): 47.8% Absolute change from baseline: ‐0.2 vs ‐0.6 Difference in absolute change: 0.4 Difference in mean score at Time Period 1: 3.6 vs 2.9 Time Period 7: 3.5 vs 2.4 Absolute change (post): 1.1 Relative % change (post): 45.8% Absolute change from baseline: ‐0.1 vs ‐0.5 Difference in absolute change: 0.4 Mini‐Mental State Examination: Difference in mean score at Time Period 1: 20 vs 20 Time Period 4: 22 vs 23 Absolute change (post): ‐1 Relative % change (post): ‐4.3% Absolute change from baseline: 2 vs 3 Difference in absolute change: ‐1 Difference in mean score at Time Period 1: 20 vs 20 Time Period 7: 25 vs 21 Absolute change (post): 4 Relative % change (post): 19% Absolute change from baseline: 5 vs 1 Difference in absolute change: 4 Level of Care: Difference in mean score at Time Period 1: 2 vs 2 Time Period 4: 2 vs 2 Absolute change (post): 0 Relative % change (post): 0% Absolute change from baseline: 0 Difference in absolute change: 0 Difference in mean score at Time Period 1: 2 vs 2 Time Period 7: 2 vs 2 Absolute change (post): 0 Relative % change (post): 0% Absolute change from baseline: 0 vs 0 Difference in absolute change: 0 Pain Score Mean: Difference in mean score at Time Period 1: 4 vs 5 Time Period 4: 5 vs 0 Absolute change (post): 5 Relative % change (post): infinite Absolute change from baseline: 1 vs ‐5 Difference in absolute change: 6 Difference in mean score at Time Period 1: 4 vs 5 Time Period 7: 5 vs 4 Absolute change (post): 1 Relative % change (post): 25% Absolute change from baseline: 1 vs ‐1 Difference in absolute change: 2 Medications Mean: Difference in mean score at Time Period 1: 7 vs 7 Time Period 4: 8 vs 9 Absolute change (post): ‐1 Relative % change (post): ‐11.1% Absolute change from baseline: 1 vs 2 Difference in absolute change: ‐1 Difference in mean score at Time Period 1: 7 vs 7 Time Period 7: 9 vs 9 Absolute change (post): 0 Relative % change (post): 0 Absolute change from baseline: 2 vs 2 Difference in absolute change: 0 Bowel Medications Mean: Difference in mean score at Time Period 1: 2 vs 2 Time Period 4: 2 vs 2 Absolute change (post): 0 Relative % change (post): 0 Absolute change from baseline: 0 vs 0 Difference in absolute change: 0 Difference in mean score at Time Period 1: 2 vs 2 Time Period 7: 2 vs 2 Absolute change (post): 0 Relative % change (post): 0 Absolute change from baseline: 0 vs 0 Difference in absolute change: 0 Weight mean: Difference in mean score at Time Period 1: 136 vs 137 Time Period 4: 133 vs 133 Absolute change (post): 0 Relative % change (post): 0 Absolute change from baseline: ‐3 vs ‐4 Difference in absolute change: 1 Difference in mean score at Time Period 1: 136 vs 137 Time Period 7: 131 vs 137 Absolute change (post): ‐6 Relative % change (post): ‐4.4% Absolute change from baseline: ‐5 vs 0 Difference in absolute change: ‐5 Authors report no statistically significant differences in numbers of constipation episodes, percent of meals eaten, and incidence of alteration in skin integrity.Registered nurse turnover during the study period was 16% (n =8).
Elbourne 1987Note: Full heading for column 2 is 'Timing of Outcome Measurement' Six months post‐partum.To improve women's satisfaction with their maternity care. To increase the availability of the notes. To save clerical resources.Availability of the notes in the antenatal clinic: notes not available for 4% of women in both arms of the trial. Saving clerical resources: Very little time saved at main hospital. Approx. 1 hour per week saved in peripheral clinic. Clinical time saved by eliminating need to write duplicate notes.Smoking cigarettes at the end of pregnancy: 33/161 (20.5%) vs 26/156 (16.7%) Absolute % difference 3.8% Relative % difference 23% (Control better) Intrapartum regional block/general anaesthetic: 32/161 (19.9%) vs 37/156 (23.7%) Absolute % difference ‐3.8% Relative % difference ‐16% Prolonged labour (> 12 hrs): 12/161 (7.5%) vs 8/156 (5.1%) Absolute % difference 2.4% Relative % difference 47% (Control better) Instrumental/operative delivery rate: 32/161 (19.9%) vs 29/156 (18.6%) Absolute % difference 1.3% Relative % difference 7% (Control better) Preterm delivery rate (<37 weeks): 10/161 (6.2%) vs 9/156 (5.8%) Absolute % difference 0.4% Relative % difference 7% Low birthweight (<2500gms): 11/161 (6.8%) vs 12/156 (7.7%) Absolute % difference ‐0.9% Relative % difference ‐12% (experimental better) Stillbirth rate: 0/161 (0%) vs 1/156 (0.64%) Absolute % difference ‐0.64% (experimental better) Neonatal death: 3/161(1.86%) vs 1/156 (0.64%) Absolute % difference 1.22% Relative % difference 191% (control better) Stillbirth/neonatal death: 3/161 (1.86%) vs 2/156 (1.28%) Absolute % difference 0.58% Relative % difference 45% (control better) Not breast feeding at hospital discharge: 38/161(23.6%) vs 30/156 (19.2%) Absolute % difference 4.4% Relative % difference 23% (control better) Not feeling well informed in pregnancy: 5/161 (3.1%) vs 7/156 (4.5%) Absolute % difference ‐1.4% Relative % difference ‐31% (experimental better) Poor communication with staff: 84/161 (52.2%) vs 95/156 (60.9%) Absolute % difference ‐8.7% Relative % difference ‐14% (experimental better) Not 'feeling in control' in pregnancy: 66/161 (41.0%) vs 79/156 (50.6%) Absolute % difference ‐9.6% Relative % difference ‐19% (experimental better) Dissatisfaction with antenatal care: 7/161 (4.4%) vs 1/156 (0.6%) Absolute % difference 3.8% Relative % difference 630% (control better) Negative feelings about forthcoming birth: 29/161 (18.0%) vs 38/156 (24.4%) Absolute % difference ‐6.4% Relative % difference ‐26% (experimental better) Dissatisfaction with intrapartum care: 4/161 (2.5%) vs 3/156 (1.9%) Absolute % difference 0.6% Relative % difference 32% (control better) Father not involved with baby: 15/161 (9.3%) vs 12/156 (7.7%) Absolute % difference 1.6% Relative % difference 21% (control better) Dissatisfaction with maternity care: 5/161 (3.1%) vs 4/156 (2.6%) Absolute % difference 0.5% Relative % difference 19% (control better) Would prefer different care in future: 11/161 (6.8%) vs 44/156 (28.2%) Absolute % difference ‐21.4% Relative % difference ‐76% (experimental better)Outcome data were unavailable for 20‐25% of the 317 women randomly allocated.
From 2003Patients recruited over a 6 week period and followed up for 120 days (total period of study therefore 166 days)Improving implementation of care plansDifference in actual minus planned LOS (comparison of means)Lung disease first ward: mean difference 1.9 ±5.4 vs 4.8 ±5.8 days, relative reduction in difference between actual and planned of 60.4% (experimental group more accurate)Gastrointestinal diseases ward:mean difference 2.9 ±4.5 vs 3.3 ±6.1 days, relative reduction in difference between actual and planned of 12.1% (experimental group more accurate)Lung diseases second ward: mean difference 3.1 ±5.2 vs. 5.9 ±9.3 days, relative reduction in difference between actual and planned of 47.5% (experimental group more accurate)Endocrinology ward 4.7 ±7.7 vs. 5.7 ±6.4 days, relative reduction in difference between actual and planned of 17.5% (experimental group more accurate)Admittance ward (‐0.6 ±1.7) vs (‐0.2 ±1.1) days, relative reduction in difference between actual and planned of ‐200% (control group more accurate)Accomplishment of plan of action (97/154, 63% vs. 102/150, 68%) (absolute difference ‐5%, control group better, difference NS)

Authors state that in a general linear model (GLM), forms were associated with a higher accuracy of planned LOS (p=0.02) by 1.5 days (95% CI 0.2‐2.8 days), mean difference of 2.5 days compared to 4 days longer than planned (experimental group better)

Difference in mean LOS, lung disease first ward, 6.2 vs. 9.1 days, (absolute difference ‐2.9 days), relative reduction 31.9% in mean LOS (experimental group better)Difference in mean LOS gastrointestinal diseases ward, 6.6 vs 7.5 days, (absolute difference ‐0.9 days), relative reduction of  12.0% in mean LOS (experimental group better)Difference in mean LOS lung disease second ward, 7.6 vs 11.0 days, (absolute difference ‐3.4 days), relative reduction of 30.9% in mean LOS (experimental group better)Difference in mean LOS endocrinology ward, 9.1 vs 9.3 days, (absolute difference ‐0.2 days), relative reduction of 2.2% in mean LOS (experimental group better)Difference in mean LOS admittance ward, 1.2 vs 1.2 days, absolute difference 0, relative reduction 0Risk of readmission within 120 days, 41% vs 42% (p=0.80, absolute difference ‐1%, experimental group better, difference not significant)

Authors state that in a general linear model (GLM) planning forms were associated with a decrease in LOS (p=0.02) of 1.5 days (95% CI 0.2 to 2.7 days) from 7.6 to 6.1 days (experimental group better)

Lakhani 198412 months after birth.Improving communication between health care agencies. Improving uptake of immunisation and developmental assessment clinic attendance.None reported.Uptake of immunisation ‐ diphtheria/tetanus/polio 1st dose: 141/157 (89.8%) vs 134/142 (94.4%) Absolute % difference ‐4.6% Relative % difference ‐5% (control better) Uptake of immunisation ‐ diphtheria/tetanus/polio 2nd dose: 119/157 (75.8%) vs 121/142 (85.2%) Absolute % difference ‐9.4% Relative % difference ‐11% (control better) Uptake of immunisation ‐ diphtheria/tetanus/polio 3rd dose: 35/157 (22.3%) vs 44/142 (31.0%) Absolute % difference ‐8.7% Relative % difference ‐28% (control better) Uptake of immunisation ‐ pertussis 1st dose: 101/157 (64.3%) vs 82/142 (57.8%) Absolute % difference 6.5% Relative % difference 11% (experimental better) Uptake of immunisation ‐ pertussis 2nd dose: 91/157 (58.0%) vs 84/142 (59.2%) Absolute % difference ‐1.2% Relative % difference ‐2% (control better) Uptake of immunisation ‐ pertussis 3rd dose: 30/157 (19.1%) vs 27/142 (19.0%) Absolute % difference 0.1% Relative % difference 0.5% (experimental better) 1st developmental assessment: 151/157 (96.2%) vs 139/142 (97.9%) Absolute % difference ‐1.7% Relative % difference ‐2% (control better) 2nd developmental assessment: 123/157 (78.3%) vs 119/142 (83.8%) Absolute % difference ‐5.5% Relative % difference ‐7% (control better)Numbers at the start of the project were 242 study group and 237 control group. The outcome measures are based on 157 (65%) study group and 142 (60%) control group who were still in the District, data was available, responded to interview and owned the book.
Lovell 198732 weeks gestation and postnatally.To improve women's satisfaction with maternity care, sense of control and self confidence, communications with staff, involvement of babies' fathers.Notes unavailable in antenatal clinic at least once: 0/117 (0%) vs 27/120 (22.5%) Absolute % difference ‐22.5% Relative % difference ‐100% (experimental better)Clinical outcomes: Caesarean Section and Instrumental deliveries: 29/117 (24.8%) vs 16/120 (13.3%) Absolute % difference 11.5% Relative % difference 87% Stillbirth or neonatal death: 2/117 (1.7%) vs 2/120 (1.67%) Absolute % difference 0.03% Relative % difference 1.8% Received pain relief in labour: 80/117 (68.4%) vs 73/120 (60.8%) Absolute % difference 7.6% Relative % difference 13% Baby low birth weight (<2500gms): 5/117 (4.3%) vs 11/120 (9.17%) Absolute % difference ‐4.87% Relative % difference ‐53% Health related behaviour: Smoking at 32‐34 weeks gestation: 25/117 (21.4%) vs 28/120 (23.3%) Absolute % difference ‐1.9% Relative % difference ‐8.2% (experimental better) Did not breast feed after delivery: 20/117 (17.1%) vs 23/120 (19.2%) Absolute % difference ‐2.1% Relative % difference ‐10.9% (experimental better) Mothers' satisfaction: Reported disadvantages to carrying record (notes or co‐operation card): 23/117 (19.7%) vs 12/120 (10%) Absolute % difference 9.7% Relative % difference 97% (control better) Found it a nuisance to carry: 6/117 (5.1%) vs 5/120 (4.2%) Absolute % difference 0.9% Relative % difference 21% (control better) No preference for carrying own notes next time: 12/117 (10.3%) vs 62/120 (51.7%). Absolute % difference ‐41.4%. Relative % difference ‐80.1%. (experimental better) (Authors report p<0.0001). Something in the record that worried them or they did not understand: 15/117 (12.8%) vs 13/120 (10.8%) Absolute % difference 2% Relative % difference 19% (control better) Did not ask doctors or midwives to explain it: 17/117 (14.5%) vs 14/120 (11.7%) Absolute % difference 2.8% Relative % difference 23.9% (control better) Not confident about forthcoming labour: 25/117 ( 21.4%) vs 27/120 (22.5%) Absolute % difference ‐1.1% Relative % difference ‐4.9% (experimental better) Not confident with the baby: 3/117 (2.6%) vs 4/120 (3.3%) Absolute % difference ‐0.7% Relative % difference ‐21.2% (experimental better) Found labour and delivery difficult: 40/117 (34.2%) vs 39/120 (32.5%) Absolute % difference 1.7% Relative % difference 5.2% (control better) Felt not at all well informed during labour & delivery: 1/117 (0.9%) vs 12/120 (10%) Absolute % difference ‐9.1% Relative % difference ‐91% (experimental better) (Authors report p = 0.0016) Did not have a companion during labour: 16/117 (13.7%) vs 32/120 (27%) Absolute % difference ‐13.3% Relative % difference ‐49.3% (experimental better) (Authors report p=0.0219) Partner not involved with baby: 8/117 (6.8%) vs 13/120 (10.8%) Absolute % difference ‐4.0% Relative % difference ‐37% (experimental better) Ideas & preferences not considered & taken into account: 5/117 (4.3%) vs 9/120 (7.5%) Absolute % difference ‐3.2% Relative % difference ‐ 42.7% (experimental better) Not satisfied with overall maternity care: 3/117 (2.6%) vs 6/120 (5%) Absolute % difference ‐2.4% Relative % difference ‐48% (experimental better)Authors report 246 women identified as eligible and randomly allocated before first attendance at antenatal clinic, 9 then found to be ineligible. Reviewers have presented all results based on remaining 237, although published results are based on variable numbers. Health related behaviours and satisfaction outcomes are given as percentages only. Numbers calculated by reviewers. Authors report difference in total number of assisted deliveries as statistically significant (p <0.05) but more common in both groups in women who had epidural analgesia.
Spranzo 1993Pre‐intervention and 3 months post‐implementation.To measure the effects of computerised nurse care planning on selected nursing activities and related patient outcomes.Nurse care planning: Pretest mean: 28.08 vs 26.61 Posttest mean: 28.03 vs 33.30 Absolute change (post): ‐5.27 Relative % change (post): ‐15.8% Absolute change from baseline: ‐0.05 vs 6.69 Difference in absolute change: ‐6.74 (control better) Discharge planning: Pretest mean: 10.38 vs 9.03 Posttest mean: 10.68 vs 11.53 Absolute change (post): ‐0.85 Relative % change (post): ‐7.4% Absolute change from baseline: 0.30 vs 2.5 Difference in absolute change: ‐2.2 (control better) Health teaching: Pretest mean: 0.40 vs 0.44 Posttest mean: 0.75 vs 0.77 Absolute change (post): ‐0.02 Relative % change (post): ‐2.6% Absolute change from baseline: 0.35 vs 0.33 Difference in absolute change: 0.02 (*) Perceived nurse involvement: Pretest mean: 16.71 vs 15.31 Posttest mean: 16.53 vs 16.58 Absolute change (post): ‐0.05 Relative % change (post): ‐0.30% Absolute change from baseline: ‐0.18 vs 1.27 Difference in absolute change: ‐1.45 (control better)Patient Outcomes: Satisfaction with nursing care: Pretest mean: 50.83 vs 48.84 Posttest mean: 49.98 vs 51.55 Absolute change (post): ‐1.57 Relative % change (post): ‐3.1% Absolute change from baseline: ‐0.85 vs 2.71 Difference in absolute change: ‐3.56 (control better) Readiness for self‐care: Pretest mean: 20.73 vs 20.75 Posttest mean: 20.23 vs 20.83 Absolute change (post): ‐0.6 Relative % change (post): ‐2.9 Absolute change from baseline: ‐0.5 vs 0.08 Difference in absolute change: ‐0.58 (control better) Patient self‐care knowledge: Pretest mean: 0.804 vs 0.805 Posttest mean: 0.735 vs 0.781 Absolute change (post): ‐0.046 Relative % change (post): ‐5.9% Absolute change from baseline: ‐0.069 vs ‐0.024 Difference in absolute change: ‐0.045 (control better) Length of hospital stay: Pretest mean: 11.61 vs 9.03 Posttest mean: 11.98 vs 8.35 Absolute change (post): 3.63 Relative % change (post): 43.5% Absolute change from baseline: 0.37 vs ‐ 0.68 Difference in absolute change: 1.05 (control better) Nurse outcomes: Nurses' computer attitudes: Pretest mean: 48.5 vs 55.0 Posttest mean: 45.4 vs 51.3 Absolute change (post): ‐5.9 Relative % change (post): ‐11.5% Absolute change from baseline: ‐3.1 vs ‐3.7 Difference in absolute change: 0.6 (*) Head Nurses' perception of nurses' competency: Pretest mean: 62.4 vs 58.2 Posttest mean: 64.7 vs 63.0 Absolute change (post): 1.7 Relative % change (post): 2.7% Absolute change from baseline: 2.3 vs 4.8 Difference in absolute change: ‐2.5 (*) Nurses intent to stay: Pretest mean: 4.6 vs 5.7 Posttest mean: 5.42 vs 5.0 Absolute change (post): 0.42 Relative % change (post): 8.4% Absolute change from baseline: 0.82 vs ‐ 0.7 Difference in absolute change: 1.52 (*) Nurses' work satisfaction: Pretest mean: 154.0 vs 167 Posttest mean: 156.5 vs 168.2 Absolute change (post): ‐11.7 Relative % change (post): ‐7.0% Absolute change from baseline: 2.5 vs 1.2 Difference in absolute change: 1.3 (*) Nurses' perception of current use of Nurse Care Planning (NCP) : Pretest mean: 12.9 vs 11.2 Posttest mean: 9.7 vs 11.2 Absolute change (post): ‐1.5 Relative % change (post): ‐13.4% Absolute change from baseline: ‐ 3.2 vs 0 Difference in absolute change: ‐3.2 (*) Future use of NCP: Pretest mean: 34.2 vs 30.9 Posttest mean: 31.2 vs 31.8 Absolute change (post): ‐0.6 Relative % change (post): ‐1.9% Absolute change from baseline: ‐3.0 vs 0.9 Difference in absolute change ‐3.9 (*) Nurses' opinions of NCP: Pretest mean: 67.1 vs 63.2 Posttest mean: 59.7 vs 63.4 Absolute change (post): ‐3.7 Relative % change: ‐5.8% Absolute change from baseline:‐ 7.4 vs 0.2 Difference in absolute change: ‐7.6 (*) Nurse sick time proportion: Pretest mean: 0.024 vs 0.055 Posttest mean: 0.040 vs 0.042 Absolute change (post): ‐0.002 Relative % change (post): ‐4.8% Absolute change from baseline: 0.016 vs ‐0.013 Difference in absolute change: 0.029 (*) Nurse overtime proportion: Pretest mean: 0.026 vs 0.055 Posttest mean: 0.031 vs 0.026 Absolute change (post): 0.005 Relative % change (post): 19.2% Absolute change from baseline: 0.005 vs ‐ 0.029 Difference in absolute change: 0.034 (control better)Multiple regression analyses carried out to control for selected co‐variates. (*) Caution is required in interpreting this outcome due to potential for baseline imbalance to influence the intervention effect.
Stevens 1990For 48 hours post‐operatively or up to discharge, whichever was sooner.Improving paediatric pain management.Frequency of assessment of child's pain post‐operatively per 24 hours: 5.4 experimental vs 3.9 control Absolute difference 1.5 Relative % difference 39% (experimental better) Numbers of children given analgesia: 17/20 (85%) experimental vs 14/23 (60%) control Absolute % difference 25% Relative % difference 42% (experimental better) Total number of doses of analgesia given: 78 experimental vs 34 control Absolute difference 44 Relative % difference 129% (experimental better) Author reports p< .01 T‐test for these results.Children's pain intensity ratings mean score (range 1‐10) : 4.2 experimental vs 6.8 control Absolute difference ‐2.6 Relative % difference ‐38% (experimental better) Author reports p< .01 T‐testPain intensity in the experimental group was assessed by nurses, parents and patient, but by nurses only in the control group. The ages of the children in both groups ranged from 18 months to 12 years, and the surgical diagnoses were varied.

Other dataNo numeric data

Last assessed as up‐to‐date: 1 November 2008.

DateEventDescription
15 May 2018AmendedCochrane Review withdrawn from publication.

Review first published: Issue 2, 2000

DateEventDescription
12 November 2008New search has been performedReview has been updated
12 November 2008New citation required but conclusions have not changedNew search, new studies
3 September 2008AmendedAdded two new included RCT studies (Bosman, From). Conclusions amended.
25 August 2008AmendedRemoved one small CBA trial (Scharf) from included studies, to meet revised EPOC quality criteria for CBA studies.
8 August 2008AmendedRemoved ongoing studies listed in previous versions of the review.
12 May 2008AmendedConverted to new review format.
16 May 2003New citation required and conclusions have changedSubstantive amendment

MethodsRCT
ParticipantsAll 60 patients admitted to one acute psychiatric ward of a university hospital in a 10‐week period. The mean age of the patients in the intervention group was 48 years and in the control group 40 years. Average length of stay in the intervention group was 20.9 days, and 21.8 days in the control group. Authors state that there was no significant difference in gender between the two groups. There were 12 trained nurses of whom 10 worked on the ward continuously during the study period; 8 nurses returned all questionnaires and of these their average age was 32 years, 3 were male and 5 female. Average years of computer experience was 2.5 h and average weekly working time with computers was 3.5 h at the beginning of the study. 5 physicians working on the ward were asked to complete a questionnaire at the end of the study Country: Germany
InterventionsUse of a computerised nursing documentation system compared with existing paper‐based documentation system
OutcomesRecord keeping: nurse time, quality of documentation, nurses' attitudes to the computerised system and physician attitudes to the contribution of nursing documentation to medical decision making
FundingNot stated
Evidence baseCites previous trials, notes lack of evidence
Ethical approvalNot specifically stated, authors cite a study protocol in the in‐house report (in German)
NotesFirst part of a larger longitudinal evaluation
Risk of bias
BiasAuthors' judgementSupport for judgement
Random sequence generation (selection bias)Unclear riskAll new admissions to the selected ward over a 10‐week period were included in the study. Authors state that there was no significant demographic differences between the groups. Mean duration of stay was similar
Allocation concealment (selection bias)Unclear riskNo details provided of randomisation procedures
Blinding (performance bias and detection bias) All outcomesHigh riskPatients may have been unaware, but no patient outcomes measured. Blinded assessment of nursing practice outcomes not possible
Incomplete outcome data (attrition bias) All outcomesUnclear riskAll questionnaires obtained from 8 of the 10 nurses who worked on the ward continuously. Little care planning conducted with the paper system (6/20 patients only) ‐ authors note, however, that the nurses on the ward are familiar with the nursing process
Selective reporting (reporting bias)Unclear riskCare plan quality difficult to assess reliably given the lack of care planning in the paper system. No quality comparisons noted of the task planning/documentation or the report writing
Other biasUnclear riskNurses documented time required for care planning and documentation themselves. Satisfaction and attitude surveys inevitably subjective, although authors note use of validated questionnaires. Quality checklist constructed to be as objective as possible

MethodsRCT, a type of crossover design
ParticipantsPatients admitted to ICU, over a six‐week period, after uncomplicated cardiothoracic surgery were randomised into two groups, paper registration or computer‐based intensive care management system (ICIS). Patients admitted during the night or at weekends, or who required resuscitation or re‐operation after admission were excluded. Of 174 patients admitted, 145 were eligibleNurses worked on both systems ‐ their patient allocation was determined by a head nurse unaware of patient allocation group

Setting: a 18 bed medical‐surgical ICU in a teaching hospital, The Netherlands

InterventionsUse of a computer‐based system for documentation compared to a paper based system
For the ICIS patient‐nurse duos, all patient documentation was carried out via the ICIS, which captured monitoring data every minute, and the nurse validated the data at least once an hour, and collected other data. For the paper‐record patient‐nurse duos, paper charting was performed as before installation of the ICIS, with hourly recording, and extraction and entry of other data onto dedicated forms. The authors report that nurses using the paper record for a patient abstained from using the ICIS
OutcomesNursing activities during admission (time‐motion analysis). Nursing activities during registration (work sampling), to determine time spent on documentation, patient care, unit‐related and personal activities
Observers (n = 2 experienced ICU nurses) timed nurses completing a set of admission tasks (two nurses per patient in admission phase), and for the registration phase (one nurse per patient) work sampling was applied with observations made every five minutes and assigned to one of 148 items, grouped into four categories (patient care, documentation, unit‐related activities, personal activities). Work sampling methodology adapted from a previous cited study
FundingNot stated, an in‐house evaluation of a clinical information system
Evidence baseUnclear, some trials cited. Work sampling methodology based on previous research
Ethical approvalAuthors note that the Institutional Review Board waived the need for informed consent as "study did not interfere with the treatment of the patient"
Notes
Risk of bias
BiasAuthors' judgementSupport for judgement
Random sequence generation (selection bias)Unclear risk145 eligible admissions approximates to 13% of the annual admissions to ICU after cardiothoracic surgery. The experimental group had significantly higher APACHE II and III scores than the paper group (controls) but no other significant demographic differences. Nurses not randomised ‐ alternately exposed to experimental and control
Allocation concealment (selection bias)Unclear riskNo details provided
Blinding (performance bias and detection bias) All outcomesUnclear riskNurses aware of patient allocation. The head nurse not aware of patient allocation. Two observers assessing nursing activities aware of the patient allocation
Incomplete outcome data (attrition bias) All outcomesUnclear risk31 of the 145 admissions not observed
Selective reporting (reporting bias)Unclear riskSome activities compared were only possible with one or other of the systems. Authors list five most frequently observed documentation activities with both systems, but this means some time comparisons (e.g. registration of intravenous fluids, and validating given medication) are not possible as those activities appeared only in the top five of the computerised system
Could not obtain the electronic supplementary material
Other biasUnclear riskStudy conducted 8 months after implementation of the computerised system. The two observers were experienced ICU nurses, but were employed in the same ICU as the research setting
Patients were unit of allocation, nurses (individuals or pairs) were the unit of analysis. Unclear how many nurses were involved. Potential risk of contamination high. Precision over‐inflated

MethodsRCT
ParticipantsAll patients 65 years of age and over, who became a permanent resident in the health centre over a 30‐month period, and stayed for at least 7 months. 30 residents ‐ 10 experimental group and 10 control group, and 10 excluded (4 died and 6 discharged). Authors report no significant demographic differences between the experimental and control groups. 4 computer literate nurses assigned to care for the experimental group and 4 non‐computer literate nurses assigned to the control group. No significant demographic differences between the nurses in the two groups
Country: USA
InterventionsUse of computerised nursing care plans compared with existing paper‐based care plans
OutcomesPatient outcomes: level of care, activities of daily living, perception of pain, cognitive abilities, number of medications, number of bowel medications, number of constipation episodes, weight, per cent of meals eaten, incidence of alteration in skin integrity Organisational outcomes: number of nursing diagnoses, interventions and activities, and care plan preparation time
FundingNot stated
Evidence baseSome previous trials of computerised care planning cited
Ethical approvalNot stated
Notes
Risk of bias
BiasAuthors' judgementSupport for judgement
Random sequence generation (selection bias)Unclear riskNewly admitted patients to a long‐term care facility were included (not existing patients), over a 30‐month period. 30 residents met the inclusion criteria, all agreed to participate. Authors state that there were no significant demographic differences in the groups (only gender details stated)
Allocation concealment (selection bias)Unclear riskNo details provided of randomisation procedures
Blinding (performance bias and detection bias) All outcomesUnclear riskStandardised instruments used for data collection on patient outcomes at measurement times. Care plan quality could not be blindly assessed
Incomplete outcome data (attrition bias) All outcomesUnclear riskOf the 30 who started in the study, 10 were excluded (death: n = 4, discharge: n = 6)
Selective reporting (reporting bias)Low risk
Other biasUnclear riskThere were existing patients (around 18) in the facility receiving care from the same nurses as in the study

MethodsRCT
ParticipantsAll women booking, at less than 34 weeks pregnant, with one consultant during a six‐month period in 1984. Care provided by midwives, general practitioners and obstetricians. 317 women recruited to the study, of whom 27 found to be ineligible. Sociodemographic characteristics of women in the study and control groups were comparable. At the time of the final questionnaire, response rate was 85% of the patients originally recruited. Patients were the unit of allocation and unit of analysis Country ‐ UK
InterventionsWomen carrying their full obstetric record during pregnancy compared with women carrying conventional cooperation card only
OutcomesClinical outcomes for mother and baby Mothers' satisfaction with care received Staff were also interviewed, and availability of records and changes in use of clerical time were studied but are not analysed here
FundingNuffield Provincial Hospitals Trust
Evidence baseAuthors note the lack of previous RCTs
Ethical approvalApproved by the ethics committee of West Berkshire District
NotesThis study and the study by Lovell et al 1987 have been included in the Effective Care in Pregnancy and Childbirth Database (1993), and are being prepared for inclusion in the Cochrane Database of Systematic Reviews. Clinical outcome data taken from the review by Hodnett et al (1993)
Risk of bias
BiasAuthors' judgementSupport for judgement
Random sequence generation (selection bias)Low riskResearchers independent of care givers used consecutively numbered series of sealed opaque envelopes. Authors state two allocated groups very similar in terms of proportion of those considered ineligible and specific reasons for ineligibility, as well as sociodemographic characteristics, and sociopsychological characteristics. Authors report a power calculation
Allocation concealment (selection bias)Unclear riskWomen aware of their group allocation, and researchers reviewing case notes or cooperation cards aware of allocation
Blinding (performance bias and detection bias) All outcomesUnclear riskQuestionnaires assessed attitudes (authors suggest possibility of a Hawthorne effect). Objective changes in smoking behaviour between groups checked, but not clear if results reported in paper (see Notes)
Incomplete outcome data (attrition bias) All outcomesUnclear riskOut of 290 women allocated (n = 147, n = 143), two immediately withdrew from the control group. A further 17 women withdrew (one for non‐medical reasons). The third (postnatal) questionnaire was not sent to two women for medical reasons
Selective reporting (reporting bias)Low riskMost details provided for attitudes towards patient record holding, authors state direction of findings for clinical outcomes, but no details provided in paper (see Notes)
Other biasUnclear riskAuthors note that there were “at least 10 women whose actual record holding differed from their allocation at some later stage between booking and the end of their maternity care” ‐ mostly as they moved from the area. Authors suggest the possible contamination and the Hawthorne effect may have affected the study findings

MethodsTwo‐part study, with a before and after study that preceded a RCT
Participants304 patients admitted to the Internal Medical Clinic (I) of a university hospital in Denmark, from general practitioners or the casualty ward, over the period 15 February to 31 March 1999. The clinic had four specialised sub‐wards (endocrinological, gastrointestinal, and two lung disease wards). Excluded were patients who were discharged or transferred to another department by the second medical examination, normally done within 24 hours of the start of the receiving procedure. Of the 330 eligible participants, 154 were randomised to the experimental group, 150 to the control group, and 26 had no care plan made (authors refer to higher death rate and higher rate of transfer to other departments)
InterventionsPatients who had care plans incorporated in the medical record were compared to patients who had the care plan removed
In part 2 of the study, care planning for patients admitted to acute medical wards in the Internal Medicine Clinic (I) was a two‐step process. In the first step the receiving nurse identified problems (physical activities of daily living, mental, and social) and plans of action drawn up to solve each problem, recorded in the nursing records and on a green planning form to be included in the medical record. In step 2, the medical specialist identified problems, plans of action and LOS schedule, and this information was also recorded on the planning form. The medical plan and nurses plan were both incorporated, as the care plan, into the medical record
OutcomesLOS, LOS (actual versus planned comparison), risk of re‐admission, accomplishment of plan of action. Also compares mean LOS for different wards treating lung diseases, and the gastrointestinal, or endocrinology wards, with analysis by ward of discharge
FundingAcknowledgements mention the Roikjaer Foundation
Evidence baseCites a systematic review on the effects of discharge plans (but not the previous nursing records systematic review) and tabulates relevant RCTs. Notes compliance with Danish government guidelines on care planning
Ethical approvalDone, approved by the Committee of Ethics of Copenhagen and Frederiksberg
NotesReview focuses on RCT part of the study
Risk of bias
BiasAuthors' judgementSupport for judgement
Random sequence generation (selection bias)Unclear riskOut of 330 patients admitted, 304 were randomised. Patients in the intervention and control groups were comparable in demographics, rate of transfer, death rates and ward of discharge, although the experimental group had a lower proportion of women (57% compared to 69%), with more patients discharged from gastrointestinal diseases ward (22% compared to 17%) and fewer from the admittance ward (18% compared to 23%). Authors state that use of healthcare services before admission and after discharge were also similar (data not shown). Care planning done prior to randomisation
Allocation concealment (selection bias)Unclear riskConsecutively numbered envelopes used, with slips allocated by coin tossing
Blinding (performance bias and detection bias) All outcomesUnclear riskInvestigators not blinded to allocation, and one was not fully independent of care giver responsibilities. Patients not apparently aware of allocation
Incomplete outcome data (attrition bias) All outcomesUnclear riskAuthors note that the medical and nursing records were reviewed daily. Not all categories of actions could be recorded, emphasis was on actions demanding collaboration with other departments. Patients were followed up for 120 days from date of second medical examination ‐ readmissions, date of discharge, deaths after discharge data collected. Problems within different groups of ICD‐10 codes tabulated for both experimental and control patients
Part one study had assessed whether there would be an effect or not, ceiling effect noted in discussion around accomplishment of plans of action
Selective reporting (reporting bias)Low risk
Other biasUnclear riskAuthors note that a GLM was used to test for the effects of planning forms and to test for possible confounding factors. Unit of analysis problem as the intervention was targeted at professionals, but patients unit of allocation and patient records unit of analysis (some mixture of provider/patient outcomes)
Providers cared for both intervention and control groups contemporaneously. It is unclear how nurses may have used the planning information separately copied into their own records, but there seems to be potential for contamination between the groups

MethodsRCT
ParticipantsAll the mothers on two wards during the study period were included. 242 mothers in the study group and 237 in the control group After one year, 117 (24.4%) babies had left the district, 9 could not be traced, 1 was in care, and 4 had died. 322 of the remaining 343 mothers were interviewed. 11 study mothers said they had not been given a booklet and 12 control mothers had been given one, leaving final samples of 157 babies in the experimental group and 142 in the control group All child health professionals in the Health District Country ‐ UK
InterventionsUse of a home‐based child health record compared with conventional child healthcare records
OutcomesThe uptake of immunisations and developmental assessments up to one year after birth were compared
FundingAcknowledgements mention internal support, and the Special Trustees at St Thomas's who funded and supported the work
Evidence baseUnclear, cites use of similar booklets in other countries
Ethical approvalUnclear
NotesThe study included a survey of the use made of the booklets by parents and health professionals, and the accuracy of the entries on the weight charts were checked. The views of the parents and health professionals who had used the booklets were sought through questionnaires and interviews
Risk of bias
BiasAuthors' judgementSupport for judgement
Random sequence generation (selection bias)Unclear risk"A balanced random plan" was used, allocation by postnatal ward so that each ward was a study ward for half the weeks during the four months
The groups were said to be well matched for age, parity, education, first language, mother's place of birth, social class, religion, place of antenatal care, type of delivery, birthweight, and method of feeding on the ward, but there were more single mothers and female babies in the study group than in the control group
Allocation concealment (selection bias)High riskOnce selection made for ward for the week, allocation known
Blinding (performance bias and detection bias) All outcomesUnclear riskDifficult to state whether immunisation uptake was objectively measured
Incomplete outcome data (attrition bias) All outcomesUnclear riskOf the 479 babies who started the study, 343 mothers (for 348 babies) available for interview at the end of the study. Analysis of service uptake on 299 (157 versus 142) with one baby in every set of twins included
Selective reporting (reporting bias)Low risk
Other biasUnclear riskUnit of analysis error as unit of randomisation was the ward and unit of analysis was patients

MethodsRCT
ParticipantsWomen booking at a St Thomas's Hospital antenatal clinic, during a 21‐week period in 1984 246 mothers considered eligible before attending the clinic, of whom 7 were subsequently found to be ineligible (e.g. having miscarried or moved away) and 11 women refused to take part. A further 24 women dropped out at the time of the second questionnaire and another 6 at the time of the third questionnaire. Authors state that women who dropped out later in the study were included in the results. Authors report no statistically significant differences between the characteristics of the study and control groups, although slightly more of the study group were in a stable union and were born within the UK Care provided by midwives, general practitioners, and obstetricians Country ‐ UK
InterventionsWomen carrying their full obstetric record during pregnancy compared with women carrying conventional cooperation card only
OutcomesClinical outcomes for mother and baby Mothers' satisfaction with care received Mothers' health behaviour Staff were interviewed at the beginning of the project but results are not given here Availability of records was noted
FundingCicely Northcote Trust
Evidence basePaper notes lack of evidence
Ethical approvalNot stated in paper. National Perinatal Epidemiology Unit provided advice
NotesThis study and the study by Elbourne et al (1987) have been included in the Effective Care in Pregnancy and Childbirth Database (1993), and are being prepared for inclusion in the Cochrane Database of Systematic Reviews
Risk of bias
BiasAuthors' judgementSupport for judgement
Random sequence generation (selection bias)Unclear riskAuthors report a power calculation. No details provided of randomisation procedures. Some, but not statistically significant sociodemographic and sociopsychological differences reported between the experimental and control groups
Allocation concealment (selection bias)Unclear riskWomen and staff caring for them aware of their allocation
Blinding (performance bias and detection bias) All outcomesUnclear riskAttitudes of women assessed subjectively. Clinical outcomes largely assessed objectively, although allocation may have been apparent to case note reviewers
Incomplete outcome data (attrition bias) All outcomesUnclear riskOf 246 considered eligible, 11 refused. Only 228 were able to complete first questionnaire (mainly medical reasons). Other withdrawals for medical reasons picked up in clinical outcomes reported
Selective reporting (reporting bias)Low riskPaper has accompanying research report with full details of outcomes
Other biasUnclear riskAuthors note that all women had access to their notes while waiting in the antenatal clinic for appointments

MethodsA randomised block pre‐test, post‐test design
ParticipantsFour 40 bed medical/nursing wards in a Veteran Affairs medical center. Registered nurses working on the study wards in both pre‐ and post‐test periods Total of 49 nurses pre‐test. 1 refusal 25 experimental group and 23 control group pre‐test 19 experimental group and 21 control group post‐test (83% follow up) All adult medical patients aged 18 years or over, admitted to the study wards during the pre‐ or post‐test periods, who were expected to be discharged home, and able to be interviewed by telephone Total 222 consented to participate. 11.3% refusal rate. 31% non‐response rate at time of interview 41 experimental group and 32 control group pre‐test 40 experimental group and 40 control group post‐test
Author notes significant differences in race and social support between the patients on the control and experimental wards pre‐test, and suggests that this may have had an effect on the final result. There were also variations in the nursing workload on the experimental wards. Unit of analysis error as wards were unit of allocation and patients and nurses were units of analysis Country ‐ USA
InterventionsIntroduction of a computerised nursing care planning system compared with existing paper system
Outcomes1. Process variables: Nursing care planning, health teaching, discharge planning, perceived nursing involvement 2. Patient outcomes: Self‐care knowledge, readiness for self care, length of hospital stay, patient satisfaction with nursing care 3. Provider outcomes: Nursing care planning, work satisfaction, competency in quality of care, intent to stay, job turnover, overtime and sick time use 4. Ward‐based outcomes, measured by nursing workload and patient acuity 5. The effect of selected process variables on selected patient outcome variables were also analysed but are not included in this review
Author notes that patients do not represent an homogenous population, but patient outcomes have been chosen that could be considered global
FundingResearched conducted for a PhD dissertation
Evidence base
Ethical approval
Notes
Risk of bias
BiasAuthors' judgementSupport for judgement
Random sequence generation (selection bias)Unclear riskPower calculation not reported. Author notes significant differences in race and social support between the patients on the control and experimental wards pre‐test
Allocation concealment (selection bias)Unclear riskThe allocation procedure was not described
Blinding (performance bias and detection bias) All outcomesUnclear riskPatient outcomes (LOS): objective assessment. Nurse outcomes such as sickness, overtime, objective assessment. Chart review, nurse attitudes towards care planning, patient satisfaction ‐ largely subjective assessment, with possibility of bias
Incomplete outcome data (attrition bias) All outcomesUnclear risk83% of nurses followed up (results available pre‐ and post‐test). Patients ‐ 69% follow up. (Total 222 consented to participate. 11.3% refusal rate. 31% non‐response rate at time of interview)
Selective reporting (reporting bias)Low riskFull details in doctoral dissertation. Multiple regression analyses carried out to control for selected covariates
Other biasUnclear riskAuthor notes possibility of systematic error in data collection, and threat to internal validity through compensatory rivalry between the groups of nurses. Unit of analysis error as wards were unit of allocation; and wards, patients, and nurses are units of analysis

MethodsRCT
ParticipantsPostoperative paediatric patients aged 18 months to 12 years 43 eligible patients randomly assigned to one of two paediatric surgical units No significant differences in age, sex, or surgical diagnoses between the study and control groups of children 24 nurses randomly assigned to one of two nursing teams, with no significant differences between the two groups Country ‐ Canada
InterventionsUse of a paediatric pain management sheet compared with conventional nurse charting methods
OutcomesIntensity and duration of postoperative pain The amount and type of analgesia given The length of hospital stay Nurses' satisfaction with the new documentation
FundingNot stated
Evidence baseAuthors outline pre‐testing and validity checking of the intervention questionnaire. Authors note lack of evidence on effective postoperative pain management in children
Ethical approvalNot stated
Notes
Risk of bias
BiasAuthors' judgementSupport for judgement
Random sequence generation (selection bias)Unclear riskAuthor reports that there were no significant differences between the patients assigned to experimental and control groups (some details tabulated in paper)
Author reports that both experimental and control groups of nurses have received training in using both pain assessment and charting methods, and that demographic characteristics were similar
Allocation concealment (selection bias)Unclear riskNo details provided of randomisation procedures. Nurses aware of allocation, patients may have been aware
Blinding (performance bias and detection bias) All outcomesHigh riskThose responsible for pain charting also influenced analgesic administration, authors note that assessment less frequent in the control group. Length of stay a more objective measure but varied according to surgical procedures (and sample size small)
Incomplete outcome data (attrition bias) All outcomesLow riskAll 24 nurses responded to satisfaction survey, patient data provided for all 43 patients allocated
Selective reporting (reporting bias)Low riskSmall sample of 43 patients
Other biasUnclear riskAuthor reports that both experimental and control groups of nurses received training in using both pain assessment and charting methods, and that demographic characteristics were similar

StudyReason for exclusion
Berger 2006Controlled before and after study of the effect of a computerised information system (CIS) on the quality of nutritional support in ICUs. The CIS aided decision support, rather than recording, and the study is excluded as it is categorised as an adjunct to the main nursing record
Burkle 1995Study of the impact of the introduction of a computerised nursing information system in two medical wards of a university hospital. Begun as a controlled before and after study, but no data were collected on the control ward after the introduction of the nursing system, and the system was abandoned before all data had been collected on the experimental ward
Calkin 1995Before and after study (interrupted time series) of the introduction of a computerised hospital maternity system. Aimed to evaluate completeness and accuracy of midwives' labour notes, time spent on record keeping, and midwives' opinions of the system. The data before and after introduction of the system have been aggregated and the author is unable to provide the necessary raw data for analysis of trend etc.
Chan 2004Before and after study of a PDA system in an acute pain service, but no control
Choi 2004A before and after study, two group CBA, excluded under revised EPOC quality criteria
Cohen 1994RCT of parent‐held child health record. Insufficient data published and unable to contact the authors
Darmer 2006An audit of nursing records at time points (three) after implementation of the Swedish VIPS model, but as there are no data from time points prior the study does not qualify as an interrupted time series
Dijkstra 2005Insufficient data on the nursing contribution to care within the diabetes passport system, a patient‐held record
Ferguson 1987Quasi‐experimental before and after study, comparing three types of paper‐based nursing care planning systems. Outcome measures included length of hospital stay, number of re‐admissions, patient satisfaction, nosocomial infections, medication/treatment errors, use of controlled substances, acuity levels, length of shift reports. ANCOVA test results only presented. We have been unable to contact the author
Fraenkel 2003A before and after design, with sufficient data before, but not exactly an interrupted time series design, with only one attitude survey for nurses before and after and some, but not sufficient, data on nursing costs, nursing staff turnover, and pressure sore care
Franklin 2007A before and after study of the impact of a closed‐loop electronic prescribing, automated dispensing, barcode patient identification and electronic medication administration record (EMAR) system on prescribing and administration errors, confirmation of patient identity before administration, and staff time. The study is not a controlled before and after study, and there are insufficient time points to qualify as an interrupted time series
Goldberg 2004A pilot RCT of the addition of a self‐management support module to the record of patients with diabetes. Excluded as nursing practice data not provided and the module is an adjunct to the record, although findings indicate that nurses far more likely to use the module than the physicians
Hamilton 2000Quasi‐experimental study comparing a new nursing assessment recording system for patients with acute stroke, introduced with the implementation of evidence‐based practice guidelines. Clinical outcome data were collected, but this was a before and after study with no control
Happ 1994A quasi‐experimental, pre‐test, post‐test design study to compare the quality of patient care on units with computers at the patient's bedside with the quality of care without bedside computers. Outcome measurements were nursing documentation compliance and patient satisfaction. No numerical results are given. We have been unable to contact the author
Henderson 2004A single‐blind RCT of a joint crisis plan for people with severe mental illness. No details provided of the nursing contribution
Homer 1999RCT of woman‐held records in a hospital antenatal clinic. Client satisfaction data only. No clinical outcomes collected
Jordan 2003Study investigated the impact of a nutrition screening tool on nursing documentation related to nutrition, patient care at mealtimes, and dietician referral. The review criteria exclude systems such as risk assessment instruments which are adjuncts to the main nursing record. We considered the nutrition screening tool to fall into this exclusion category
Keenan 2005A before and after study of a pilot of a technology supported method of documenting, communicating, and tracking the nursing component of the patient’s plan of care for eventual integration into an electronic health record (EHR). Multiple methods were used but this was not a controlled before and after study
Kilgore 1998Study comparing the impact of two clinical information systems in a cardiovascular intensive care unit. Does not meet design criteria as there are insufficient time points for a time series study
Larrabee 2001Study comparing documentation before and after the implementation of a nursing information system in three units in an acute hospital. Study does not meet design criteria as there are insufficient time points for a time series study
Marr 1993A quasi‐experimental before and after study in two nursing units, to evaluate the effect of bedside terminals compared with terminals at the nursing station, on the quality of nursing documentation. Outcome variables were the completeness and timeliness of charting medication administration, daily charting, physical assessment, and nursing admission notes. Results are given as percentages only. The author has been contacted but is unable to provide any other data
Miller 1992A study with a non‐equivalent group design on four nursing units, to compare the effects of a bedside nursing information system on direct patient care, time spent on documentation, and quality of nursing documentation. Results are given as percentages only, and we have been unable to contact the authors
Nahm 2000Modified time series study to compare existing paper system with the introduction of a computerised nursing documentation system. Study does not meet design criteria as there are insufficient time point measurements
Saarinen 2005A before and after study with careful approach to nursing activity analysis before and after CIS implementation (based on activity‐based costing principles) but not a controlled before and after study, and there are not sufficient measurement points for inclusion as an interrupted time series
Scharf 1997A controlled before and after study. Included in 2003 version, excluded in 2008 update according to revised EPOC quality criteria
Smaldone 1992An interrupted time series study to evaluate the implementation of an automated nursing documentation system. Although care plans were reviewed monthly from 5 months before the introduction of the automated system and for 18 months afterwards, the results are presented only as total figures for pre‐ and post‐implementation measures. It is therefore not possible to examine trends or any other statistics. We have been unable to contact the authors for the necessary data
van Gennip 1995Study of the effects of introducing a computerised nursing information system into five hospitals. Initial design was a controlled before and after study, with one experimental and one control ward in each of three hospitals between 1992 and 1995. Outcomes were job satisfaction (but this was only measured after the introduction of the system), workload (but no data is given), and quality of coordination (but this was not measured using standard instruments) Another component of the system was studied in two more hospitals in 1995. The second study examined patient satisfaction, quality of information supply, and occurrence of adverse events, but did not use standard instruments
Volden 1988Non‐equivalent group design with before and after measures, to compare nursing records located at the bedside with records kept centrally. The outcome measures were timeliness of charting, availability of charts, completeness and accuracy of documentation, nurse time used in charting, maintenance of patient confidentiality, and staff satisfaction. Insufficient data for analysis have been published and we were unable to contact the authors
Wright 2006A trial in which allocation to experimental group was done by time (in two out of three weeks, during the recruitment period parents were offered the experimental personal child health record format). There are no provider outcomes, and the patient outcomes concern parent knowledge of child development only

MethodsRCT
Participants20 intensive care nurses, working with patients undergoing catheterization procedures. Setting: Spain
InterventionsUse of individualised care planning compared to standard protocol (within a computerised patient record system)
OutcomesTime required for documentation activities, care quality indicators (e.g. skin care, nutrition/hydration, sleep), nurse attitudes to care planning
Notes

Trial name or titleChoi 2004a
Methods
ParticipantsNursing staff, Korea
InterventionsTrial of a point of care system using a PDA
OutcomesSimulation data only reported
Starting datePrior to 2002
Contact information
NotesNo details provided of future development plans

For the 2008 update, Maria Grant prepared the major database search strategies, ran the searches, and coordinated the sifting and selection processes together with obtaining full text of studies for review. Rosemary Currell, Maria Grant, Nicholas Hardiker and Christine Urquhart sifted the search outputs. Rosemary Currell, Nicholas Hardiker and Christine Urquhart undertook the handsearches. Christine Urquhart edited the review, with contributions from all the team.

  • Aberystwyth University, UK.

    Study leave for Christine Urquhart

  • University of Salford, UK.

    Database searching in particular

  • NHS Wales Office of Research & Development, Wales (For original review only), UK.

    Financial support for original review

  • EPOC Review Group, University of Ottawa, Canada.

  • 2007‐2008 Department of Health (England) Incentive Scheme for Cochrane reviews and updates, UK.

    Financial support for 2008 update

The review authors are aware of no conflicts of interest relevant to this review.

This review is out of date; although it was correct as of the date of publication. For further information, please contact the Managing Editor at EPOC

References to studies included in this review

  • Ammenwerth E, Eichstadter R, Haux R, Pohl U, Rebel S, Ziegler S. A randomized evaluation of a computer‐based nursing documentation system. Methods of Information in Medicine 2001;40:61‐8. [PubMed] [Google Scholar]
    Ammenwerth E, Iller C, Mahler C. IT‐adoption and the interaction of task, technology and individuals: a fit framework and case study. BMC Medical Informatics and Decision Making 2006;6(3):doi 10.1186/1472‐6947/6/3. [PMC free article] [PubMed] [Google Scholar]
    Ammenwerth E, Mansmann U, Iller C, Eichstädter R. Factors affecting and affected by user acceptance of computer‐based nursing documentation: results of a two‐year study. Journal of the American Medical Informatics Association (JAMIA) 2003;10(1):69‐84. [PMC free article] [PubMed] [Google Scholar]
    Mahler C, Ammenwerth E, Wagner A, Tautz A, Happek T, Hoppe B, et al. Effects of a computer‐based nursing documentation system on the quality of nursing documentation. Journal of Medical Systems 2007;31:274‐82. [PubMed] [Google Scholar]
  • Bosman RJ, Rood E, Oudemans‐Van Straaten H, Spoel JI, Wester JPJ, Zandstra DF. Intensive care information system reduces documentation time of the nurses after cardiothoracic surgery. Intensive Care Medicine 2003;29:83‐90. [PubMed] [Google Scholar]
  • Daly JM, Buckwalter K, Maas M. Written and computerized care plans. Organisational processes and effect on patient outcomes. Journal of Gerontological Nursing 2002;28(9):14‐23. [PubMed] [Google Scholar]
  • Elbourne D, Richardson M, Chalmers I, Waterhouse I, Holt E. The Newbury maternity care study: a randomized controlled trial to assess a policy of women holding their own obstetric records. British Journal of Obstetrics and Gynaecology 1987;94(7):612‐9. [MEDLINE: ] [PubMed] [Google Scholar]
    Hodnett ED. Women carrying their own case‐notes during pregnancy. In: Enkin MW, Keirse MJNC, Renfrew MJ, Neilson JP editor(s). Pregnancy and Childbirth module, Cochrane Database of Systematic Reviews. Update Software, 1994. [Google Scholar]
  • From G, Pedersen LP, Hansen J, Christy M, Gjørup T, Thorsgaard N, et al. Evaluating two different methods of documenting care plans in medical records. Clinical Governance 2003;8(2):138‐50. [Google Scholar]
  • Lakhani AD, Avery A, Gordon A, Tait N. Evaluation of a home based health record booklet. Archives of Disease in Childhood 1984;59(11):1076‐81. [MEDLINE: ] [PMC free article] [PubMed] [Google Scholar]
  • Lovell A, Zander L, James C, Foot S, Swan A, Reynolds A. St Thomas' Maternity Case Notes Study. Why not give mothers their own case notes?. London: Cicely Northcote Trust, 1986. [Google Scholar]
    Lovell A, Zander LI, James CE, Foot S, Swan AV, Reynolds A. The St Thomas's Hospital maternity case notes study: a randomised controlled trial to assess the effects of giving expectant mothers their own maternity case notes. Paediatric and Perinatal Epidemiology 1987;1(1):57‐66. [MEDLINE: ] [PubMed] [Google Scholar]
  • Keller L, McDermott S, Alt‐White A. Effects of computerized nurse care planning on selected health care effectiveness measures. Proceedings of the fifteenth annual symposium on computer applications in medical care. New York: McGraw Hill, 1991:38‐41. [PMC free article] [PubMed] [Google Scholar]
    Spranzo L. Effects of computerized nurse careplanning on selected health care effectiveness measures. Unpublished PhD thesis, University of Maryland, 1993. [PMC free article] [PubMed]
  • Stevens B. Development and testing of a pediatric pain management sheet. Pediatric Nursing 1990;16(6):543‐8. [MEDLINE: ] [PubMed] [Google Scholar]

References to studies excluded from this review

  • Berger MM, Revelly J‐P, Wasserfallen J‐B, Schmid A, Bouvry S, Cayeux M‐C, et al. Impact of a computerized information system on quality of nutritional support in the ICU. Nutrition 2006;22:221‐9. [PubMed] [Google Scholar]
  • Burkle T, Kuch R, Passian A, Prokosch U, Dudeck J. The impact of computer implementation on nursing work patterns: study design and preliminary results. MEDINFO 95. Canada: Health Care Computing and Communications Canada Inc. 1995:1321‐5. [MEDLINE: ] [PubMed] [Google Scholar]
    Burkle T, Kuch R, Prokosch HU, Dudeck J. Stepwise evaluation of information systems in a university hospital. Methods of Information in Medicine 1999;38(1):9‐15. [MEDLINE: ] [PubMed] [Google Scholar]
  • Calkin S. An evaluation of the implementation of a computer system into a maternity unit. Unpublished study, internal report. Crawley NHS Trust, 1995.
  • Chan SSM, Chu CPW, Cheng BCP, Chen PP. Data management using the personal digital assistant in an acute pain service. Anaesthesia and Intensive Care 2004;322(1):81‐6. [PubMed] [Google Scholar]
  • Choi SS, Jazayeri DG, Mitnick CD, Chalco K, Bayona J, Fraser HSF. Implementation and initial evaluation of a Web‐based nurse order entry System for multidrug‐resistant tuberculosis patients in Peru. MEDINFO 2004. Amsterdam: IOS Press, 2004:202‐6. [PubMed] [Google Scholar]
  • Cohen SJ, Gitterman BA, Baron AL, Reiner KL, Lynch KR, Frankenburg WK. Improving adherence with preventive pediatric care guidelines through the use of a parent‐held child health record. AHSR & FHSR Annual Meeting Abstract Book. 1994; Vol. 11:113‐4. [Google Scholar]
  • Darmer 2004. The effects of a VIPS implementation programme on nurses' knowledge and attitudes towards documentation. Scandinavian Journal of Caring Sciences 2004;18:325‐32. [PubMed] [Google Scholar]
    Darmer MR, Ankersen L, Nielsen BG, Landberger G, Lippert E, Egerod I. Nursing documentation audit ‐ the effect of a VIPS implementation programme in Denmark. Journal of Advanced Nursing 2006;15:525‐34. [PubMed] [Google Scholar]
  • Dijkstra RF, Braspenning JCC, Huijmans Z, Akkermans RP, Ballegooie E, Have P, et al. Introduction of diabetes passports involving both patients and professionals to improve hospital outpatient diabetes care. Diabetes Research and Clinical Practice 2005;68:126‐34. [PubMed] [Google Scholar]
  • Ferguson G, Hildman T, Nichols B. The effect of nursing care planning systems on patient outcomes. Journal of Nursing Administration 1987;17(9):30‐6. [MEDLINE: ] [PubMed] [Google Scholar]
  • Fraenkel DJ, Cowie M, Daley P. Quality benefits of an intensive care clinical information system. Critical Care Medicine 2003;31(1):120‐5. [PubMed] [Google Scholar]
  • Franklin BD, O'Grady K, Donyai P, Jacklin A, Barber N. The impact of a closed‐loop electronic prescribing and administration system on prescribing errors. Quality and Safety in Health Care 2007;16:279‐84. [PMC free article] [PubMed] [Google Scholar]
  • Goldberg HI, Lessler DS, Mertens K, Eytan TA, Cheadle AD. Self‐management support in a Web‐based medical record: a pilot randomized controlled trial. Joint Commission Journal on Quality and Safety 2004;30(11):629‐35. [PubMed] [Google Scholar]
  • Hamilton S, McLaren SM. Evidence‐based practice in stroke assessment and recording: an evaluation of the implementation of guidelines using a multifaceted strategy. Clinical Effectiveness in Nursing 2000;4:173‐9. [Google Scholar]
  • Happ BA. The effect of point of care technology on the quality of patient care. Proceedings of the 18th annual symposium on computer applications in medical care. Philadelphia: Hanley and Belfus, 1993:183‐7. [MEDLINE: ] [PMC free article] [PubMed] [Google Scholar]
    Happ BA. What is the impact of bedside technology on nursing care?. In: Grobe SJP‐WESP editor(s). Nursing informatics: an international overview for nursing in a technological era. Amsterdam: Elsevier Science, 1994:260‐2. [Google Scholar]
  • Flood C, Byford S, Henderson C, Leese M, Thornicroft G, Sutherby K, et al. Joint crisis plans for people with psychosis: economic evaluation of a randomised control trial. BMJ 2006;333:729‐33. [PMC free article] [PubMed] [Google Scholar]
    Henderson C, Flood C, Leese M, Thornicroft G, Sutherby K, Szmukler G. Effect of joint crisis plans on use of compulsory treatment in psychiatry: single blind randomised controlled trial. BMJ 2004;329:136‐40. [PMC free article] [PubMed] [Google Scholar]
  • Homer CS, Davis GK, Everitt LS. The introduction of a woman‐held record into a hospital antenatal clinic: the Bring Your Own Records Study. Australian and New Zealand Journal of Obstetrics and Gynaecology 1999;39(1):54‐7. [MEDLINE: ] [PubMed] [Google Scholar]
  • Jordan S, Snow D, Hayes C, Williams A. Introducing a nutrition screening tool: an exploratory study in a district general hospital. Journal of Advanced Nursing 2003;44(1):12‐23. [PubMed] [Google Scholar]
  • Keenan G, Yakel E. Promoting safe nursing care by bringing visibility to the disciplinary aspects of interdisciplinary care. AMIA 2005 Symposium Proceedings. AMIA, 2005:385‐9. [PMC free article] [PubMed] [Google Scholar]
  • Kilgore ML, Flint D, Pearce R. The varying impact of two clinical information systems in the cardiovascular intensive care unit. The Journal of Cardiovascular Management 1998;9(2):31‐5. [PubMed] [Google Scholar]
  • Larrabee JH, Boldreghini S, Elder‐Sorrells K, Turner ZM, Wender RG, Hart JM, et al. Evaluation of documentation before and after implementation of a nursing information system in an acute care hospital. Computers in Nursing 2001;19(2):56‐65. [PubMed] [Google Scholar]
  • Marr PB, Duthie E, Glassman KS, Janovas DM, Kelly JB, Graham E, et al. Bedside terminals and quality of nursing documentation. Computers in Nursing 1993;11(4):176‐82. [MEDLINE: ] [PubMed] [Google Scholar]
  • Miller E, Sheridan E. Integrating a bedside nursing information system into a professional practice model. In: Arnold JM editor(s). Computer applications in nursing education and practice. New York: National League for Nursing, 1992:62‐70. [Google Scholar]
  • Nahm R, Poston I. Measurement of the effects of an integrated, point ‐of‐care computer system on quality of nursing documentation and patient satisfaction. Computers in Nursing 2000;18(5):220‐9. [PubMed] [Google Scholar]
  • Saarinen K, Aho M. Does the implementation of a clinical information system decrease the time intensive care nurses spend on documentation of care?. Acta Anaesthesiologica Scandinavica 2005;49:62‐5. [PubMed] [Google Scholar]
  • Scharf L. Revising nursing documentation to meet patient outcomes. Nursing Managment 1997;28(4):38‐9. [MEDLINE: ] [PubMed] [Google Scholar]
  • Smaldone A, Greenberg C. Nursing software: develop your own. In: Arnold JM editor(s). Computer applications in nursing education and practice. New York: National League for Nursing, 1992:120‐32. [Google Scholar]
  • Eurlings F, Asten A, Cozijn H, Klaassen K, Stokman R, van Valkenburg, et al. Effects of a nursing information system in 5 Dutch hospitals. In: Gerdin editor(s). Nursing Informatics. ISO Press, 1997:50‐5. [PubMed] [Google Scholar]
    Gennip E, Klaassen‐Leil C, Stokman R, Valkenburg R. Technology assessment of an integrated nursing information system in three Dutch Hospitals. In: Grobe S, Pluyter‐Wenting E editor(s). Nursing informatics: an international overview for nursing in a technological era. Amsterdam: Elsevier Science, 1994:715‐20. [Google Scholar]
    Gennip E, Kramer H, Enning J, Klassen‐Leil C, Stokman R, Valkenburg R. VISTA: study of effects of an integrated nursing information system in three Dutch Hospitals. Set‐up and intermediate results. Proceedings of Medical Informatics Europe 1994. Proceedings of the twelfth international congress of the European Federation for Medical Informatics. 1994:333‐8. [Google Scholar]
    Gennip E, Willemsen W, Nieman H, Bakker A, Loo RP. How to assess cost‐effectiveness of HIS applications?. MEDINFO 1992. Proceedings of the seventh World Congress on Medical Information. 1992:1209‐15. [Google Scholar]
    Gennip EM, Klaassen‐Leil CC, Stokman R, Valkenburg RK. Costs and effects of a nursing information system in three Dutch hospitals. MEDINFO 1995. Canada: Healthcare Computing and Communications Canada Inc. 1995:1412‐6. [MEDLINE: ] [PubMed] [Google Scholar]
  • Volden CM, Esslinger VM, Johnson ME, Busch DE, Doepke LA. Decentralization of patient charts: what does it accomplish?. Applied Nursing Research 1988;1(3):132‐9. [MEDLINE: ] [PubMed] [Google Scholar]
  • Wright CM, Reynolds L. How widely are personal child health records used and are they effective health education tools? A comparison of two records. Child: Care, Health and Development 2006;32(1):55‐61. [PubMed] [Google Scholar]

References to studies awaiting assessment

  • González Sánchez JA, Corujo Fernández B, Colino Lamparero MJ, López Ortega S, Molina de Arévalo MV, et al. Care plan versus care protocol. Comparative analysis in patients subjected to cardiac catheterism [Plan de cuidados frente a protocolo asistencial. Análisis comparativo en pacientes sometidos a cateterismo cardíaco]. Enferm Intensiva 2006;17(3):104‐14. [PubMed] [Google Scholar]

References to ongoing studies

  • Choi J, Chun J, Lee K, Lee S, Shin D, Hyun S, et al. MobileNurse: hand‐held information system for point of care. Computer Methods and Programs in Biomedicine 2004;74:245‐54. [PubMed] [Google Scholar]

Additional references

  • Southern California Evidence‐based Practice Centre. Costs and benefits of health information technology. AHRQ No. 06‐E006, Evidence report/technology assessment no. 132. Rockville, MD: Agency for Healthcare Research and Quality, US Department of Health and Human Services, 2006. [Google Scholar]
  • American Nurses Association. Documentation and Informatics. http://www.nursingworld.org/MainMenuCategories/ThePracticeofProfessionalNursing/DocInfo.aspx2008.
  • Audit Commission(UK). National Audit Commission for Local Authorities, National Health Service in England and Wales. Caring systems: effective implementation of ward nursing management systems. A handbook for managers of nursing and project managers. London: HMSO, 1992. [Google Scholar]
  • Chaudhry B, Wang J, Wu S, Maglione M, Mojica W, Roth E, et al. Systematic review: impact of health information technology on quality, efficiency and costs of medical care. Annals of Internal Medicine 2006;144:742‐52. [PubMed] [Google Scholar]
  • Currell R, Urquhart C. Nursing record systems: effects of nursing practice and health care outcomes (Cochrane Review). Cochrane Database of Systematic Reviews 2003, Issue 3. [PubMed] [Google Scholar]
  • Delpierre C, Cuzin L, Fillaux J, Alvarez M, Massip P, Lang T. A systematic review of computer‐based patient record systems and quality of care: more randomized clinical trials or a broader approach?. International Journal for Quality in Health Care 2004;16(5):407‐16. [PubMed] [Google Scholar]
  • Henderson V. The nursing process‐‐is the title right?. Journal of Advanced Nursing 1982 Mar;7(2):103‐9. [MEDLINE: ] [PubMed] [Google Scholar]
  • Häyrinen K, Saranto K, Nykänen P. Definition, structure, content, use and impacts of electronic health records: a review of the research literature. International Journal of Medical Informatics 2008;77:291‐304. [PubMed] [Google Scholar]
  • Müller‐Staub M, Lavin MA, Needham I, Achterberg T. Nursing diagnoses, interventions and outcomes – application and impact on nursing practice: systematic review. Journal of Advanced Nursing 2006;56(5):514‐31. [PubMed] [Google Scholar]
  • NHS Care Records Service. Guidance for the NHS about accessing patient information in new and different ways and what this means for patient confidentiality, p.26. NHS Connecting for Health, 2006. [Google Scholar]
  • Nursing and Midwifery Council. Record keeping. Nursing and Midwifery Council, UK, 2008. [Google Scholar]
  • Oroviogoicoechea C, Elliott B, Watson R. Review: evaluating information systems in nursing. Journal of Clinical Nursing 2008;17:567‐75. [PubMed] [Google Scholar]
  • Poissant L, Pereira J, Tamblyn R, Kawasumi Y. The impact of electronic health records on time efficiency of physicians and nurses: a systematic review. Journal of the American Medical Informatics Association 2005;12(5):505‐16. [PMC free article] [PubMed] [Google Scholar]
  • Thoroddsen A, Ehnfors M. Putting policy into practice: pre‐ and posttests of implementing standardized languages for nursing documentation. Journal of Clinical Nursing 2007;16:1826‐38. [PubMed] [Google Scholar]
  • Urquhart C, Currell R. Reviewing the evidence on nursing record systems. Health Informatics Journal 2005;11(1):33‐44. [Google Scholar]
  • York University Department of Health Sciences (with Loughborough and Southampton Universities). How do nurses use new technologies to inform their decision making?. University of York, UK, 2007. [Google Scholar]