Scolaris Content Display Scolaris Content Display

Restorative justice conferencing for reducing recidivism in young offenders (aged 7 to 21)

Collapse all Expand all

Background

Restorative justice is "a process whereby parties with a stake in a specific offence resolve collectively how to deal with the aftermath of the offence and its implications for the future" (Marshall 2003). Despite the increasing use of restorative justice programmes as an alternative to court proceedings, no systematic review has been undertaken of the available evidence on the effectiveness of these programmes with young offenders. Recidivism in young offenders is a particularly worrying problem, as recent surveys have indicated the frequency of re‐offences for young offenders has ranged from 40.2% in 2000 to 37.8% in 2007 (Ministry of Justice 2009)

Objectives

To evaluate the effects of restorative justice conferencing programmes for reducing recidivism in young offenders.

Search methods

We searched the following databases up to May 2012: CENTRAL, 2012 Issue 5, MEDLINE (1978 to current), Bibliography of Nordic Criminology (1999 to current), Index to Theses (1716 to current), PsycINFO (1887 to current), Social Sciences Citation Index (1970 to current), Sociological Abstracts (1952 to current), Social Care Online (1985 to current), Restorative Justice Online (1975 to current), Scopus (1823 to current), Science Direct (1823 to current), LILACS (1982 to current), ERIC (1966 to current), Restorative Justice Online (4 May 2012), WorldCat (9 May 2012), ClinicalTrials.gov (19 May 2012) and ICTRP (19 May 2012). ASSIA, National Criminal Justice Reference Service and Social Services Abstracts were searched up to May 2011. Relevant bibliographies, conference programmes and journals were also searched.

Selection criteria

Randomised controlled trials (RCTs) or quasi‐RCTs of restorative justice conferencing versus management as usual, in young offenders.

Data collection and analysis

Two authors independently assessed the risk of bias of included trials and extracted the data. Where necessary, original investigators were contacted to obtain missing information.

Main results

Four trials including a total of 1447 young offenders were included in the review. Results failed to find a significant effect for restorative justice conferencing over normal court procedures for any of the main analyses, including number re‐arrested (odds ratio (OR) 1.00, 95% confidence interval (CI) 0.59 to 1.71; P = 0.99), monthly rate of reoffending (standardised mean difference (SMD) ‐0.06, 95% CI ‐0.28 to 0.16; P = 0.61), young person’s remorse following conference (OR 1.73, 95% CI 0.97 to 3.10; P = 0.06), young person's recognition of wrongdoing following conference (OR 1.97, 95% CI 0.81 to 4.80; P = 0.14), young person's self‐perception following conference (OR 0.95, 95% CI 0.55 to 1.63; P = 0.85), young person's satisfaction following conference (OR 0.42, 95% CI 0.04 to 4.07; P = 0.45) and victim's satisfaction following conference (OR 4.05, 95% CI 0.56 to 29.04; P = 0.16). A small number of sensitivity analyses did indicate significant effects, although all are to be interpreted with caution.

Authors' conclusions

There is currently a lack of high quality evidence regarding the effectiveness of restorative justice conferencing for young offenders. Caution is urged in interpreting the results of this review considering the small number of included studies, subsequent low power and high risk of bias. The effects may potentially be more evident for victims than offenders. The need for further research in this area is highlighted.

PICOs

Population
Intervention
Comparison
Outcome

The PICO model is widely used and taught in evidence-based health care as a strategy for formulating questions and search strategies and for characterizing clinical studies or meta-analyses. PICO stands for four different potential components of a clinical question: Patient, Population or Problem; Intervention; Comparison; Outcome.

See more on using PICO in the Cochrane Handbook.

Restorative justice conferencing for reducing recidivism in young offenders

The number of young people who commit offences remains an area of concern in many countries, particular considering the high rate of those who then go on to reoffend. An increasingly popular technique used with young offenders, as an alternative to normal court proceedings, is to conduct a Restorative Justice Conference. This conference involves a meeting between the offender, the victim or victims, the supporters of both and a conference coordinator. The conference gives all individuals involved a chance to share their experience and to decide together how best to repair the harm caused by the offence. It is believed that providing an opportunity for the offender to make amends for what they have done, along with the victim's forgiveness, increases the satisfaction of all those involved and reduces the likelihood of reoffending. The purpose of this review was to look at whether young people who are part of a restorative justice conference are less likely to reoffend than those who go through normal court proceedings. Four randomised controlled trials were included in this review. Findings indicate that there was no difference between those who are part of restorative justice conferences and those in normal court proceedings in terms of the rate of reoffending after the intervention. There was also no difference between these two groups in terms of a change in their self‐esteem or their satisfaction with the process. Results may indicate that victims who are part of a restorative conference are more satisfied than those who are part of court proceedings. The quality of the included studies was low. More high quality research using a design where participants are randomly allocated to an intervention or control group is needed.

Authors' conclusions

Implications for practice

Due to the overall low quality of the included studies in this review, it is difficult to state with certainty the implications for the continued practice of restorative justice conferencing. While most included studies demonstrated low risk of selection bias and reporting bias, there is an unclear risk of performance bias, detection bias and attrition bias, and a high risk of self‐selection bias throughout all studies, which makes it difficult to place any firm reliance on the results of these studies, and subsequently, this review. In addition, caution must be taken considering the small number of included studies on which these results are based. The primary purpose of the review was to consider the effectiveness of the conference for young offenders, and the evidence from the review suggests that it provides no additional benefit over normal court processes. However, from the victims' point of view, the experience of restorative justice conferencing may provide significant benefit over normal court processes.

Implications for research

This review has highlighted the need for further research in this area. With regards to study design, further attempts at randomised controlled trials are strongly encouraged. In particular, the possibility of blinding participants and outcome assessors should be further explored to further reduce the potential bias in these studies. The process of selection and assignment to the study also requires close attention, in order to ensure the process remains regulated and unbiased. It is also recommended that every effort is made to limit the amount of missing data in the research, and to account in full for all those missing. It may also be of use to further explore the post‐intervention aspects of the process, specifically, the participant's agreement with and adherence to the conference plan. It was surprising that only one included study reported on the adherence to the plan (Bethlehem Experiment), considering one of the primary purposes of the conference is to create this plan, and participants subsequent behaviour is likely to be strongly connected to their willingness to complete this plan. We plan to update this review within 24 months as per Cochrane requirements, following the protocol outlined in this review. For further information regarding potential methodological issues relevant to this review update, see Table 1.

Summary of findings

Open in table viewer
Summary of findings 1. Restorative justice conferencing for reducing recidivism in young offenders (aged 7 to 21 years)

Restorative justice conferencing for reducing recidivism in young offenders

Patient or population: Offenders aged 7 to 21 years
Settings: Youth justice
Intervention: Restorative justice conference

Outcomes

Illustrative comparative risks* (95% CI)

Relative effect
(95% CI)

No of Participants
(studies)

Quality of the evidence
(GRADE)

Comments

Assumed risk

Corresponding risk

Control

Restorative justice conference

Number reoffending
administrative data
Follow‐up: 1 year

Study population

OR 1
(0.59 to 1.71)

1029
(2 studies)

⊕⊝⊝⊝
very low1,2,3

518 per 1000

518 per 1000
(388 to 648)

Moderate

482 per 1000

482 per 1000
(354 to 614)

Post‐intervention monthly offending rate (any offence)
administrative data
Follow‐up: 1 year

The mean post‐intervention monthly offending rate (any offence) ranged across control groups from
0.065 to 0.067

The mean post‐intervention monthly offending rate (any offence) in the intervention groups was
0.06 standard deviations lower
(0.28 lower to 0.16 higher)

321
(2 studies)

⊕⊕⊝⊝
low1,3

SMD ‐0.06 (‐0.28 to 0.16)

Remorse
participant interviews
Follow‐up: 1 year

Study population

OR 1.73
(0.97 to 3.1)

217
(2 studies)

⊕⊝⊝⊝
very low1,3,4

452 per 1000

588 per 1000
(445 to 719)

Moderate

448 per 1000

584 per 1000
(440 to 716)

Recognition of wrongdoing
participant interviews
Follow‐up: mean 7 years

Study population

OR 1.97
(0.81 to 4.8)

217
(2 studies)

⊕⊝⊝⊝
very low1,3,5,6

548 per 1000

705 per 1000
(495 to 853)

Moderate

539 per 1000

697 per 1000
(486 to 849)

Self‐perception
participant interviews
Follow‐up: 1 year

Study population

OR 0.95
(0.55 to 1.63)

217
(2 studies)

⊕⊝⊝⊝
very low1,3,7

478 per 1000

465 per 1000
(335 to 599)

Moderate

467 per 1000

454 per 1000
(325 to 588)

Young offender satisfaction
participant interviews
Follow‐up: 12 to 24 months

Study population

OR 0.42
(0.05 to 3.81)

467
(2 studies)

⊕⊝⊝⊝
very low1,3,8

836 per 1000

682 per 1000
(203 to 951)

Moderate

791 per 1000

614 per 1000
(159 to 935)

Victim/key stakeholder satisfaction with overall process
participant interviews
Follow‐up: 12 to 24 months

Study population

OR 4.03
(0.59 to 27.75)

428
(2 studies)

⊕⊝⊝⊝
very low1,3,9

690 per 1000

900 per 1000
(568 to 984)

Moderate

640 per 1000

878 per 1000
(512 to 980)

*The basis for the assumed risk (e.g. the median control group risk across studies) is provided in footnotes. The corresponding risk (and its 95% confidence interval) is based on the assumed risk in the comparison group and the relative effect of the intervention (and its 95% CI).
CI: Confidence interval; OR: Odds ratio

GRADE Working Group grades of evidence
High quality: Further research is very unlikely to change our confidence in the estimate of effect
Moderate quality: Further research is likely to have an important impact on our confidence in the estimate of effect and may change the estimate
Low quality: Further research is very likely to have an important impact on our confidence in the estimate of effect and is likely to change the estimate
Very low quality: We are very uncertain about the estimate

1 Random allocation procedures were adequate. However, the risk of bias due to absence of blinding procedures and self‐selection was high
2 Heterogeneity indicated by the I2 statistic (70%), although no significant detection was indicated (P = 0.07)
3 Only two included studies make it difficult to ascertain the likelihood of publication bias
4 Review authors' choice of item to use as measure of remorse is somewhat subjective
5 Review authors' choice of item to use as measure of recognition of wrongdoing is somewhat subjective
6 There is moderate heterogeneity according to the I2 statistic (59%), but this is not supported by the statistical significance (P = 0.12)
7 Review authors' choice of item to use as measure of self‐perception is somewhat subjective
8 There is moderate heterogeneity according to the I2 statistic (87%), but this is not supported by the statistical significance (P = 0.44)
9 There is moderate heterogeneity according to the I2 statistic (87%), but this is not supported by the statistical significance (P = 0.16)

Background

Description of the condition

A recent survey on the extent of youth crime in England and Wales indicated that 22% of young people aged 10 to 25 years admitted to committing an offence in the past 12 months, with close to half of these offences classified as severe (Roe 2008). According to the United States Department of Justice, while the percentage of juvenile arrests may have decreased slightly from 2007 to 2008, overall rates remain problematic, with 16.2% of violent crime arrests and 26.1% of property crime arrests involving those under the age of 18 (U.S. Department of Justice 2009). It is estimated that approximately half of all youth crime concerns theft and handling of stolen goods (Muncie 2004). A range of factors have been identified that appear to increase the risk that a young person will engage in criminal behaviour, and that shape the frequency, duration and persistence of offending. These include psychosocial factors such as socioeconomic deprivation, family conflict, families with a history of criminal or antisocial behaviour and substance misuse (Farrington 1989; Farrington 1996), and environmental factors (Rutter 2006; Rutter 2007), and genetic and biological factors (Garland 2002; Arsenault 2003). In general, most crime and most serious crime is committed by males, with approximately 80% of young offenders being male (Muncie 2004). However, more attention has been paid to offending among females in recent years (Whyte 2009).

The age of criminal responsibility varies. Some countries set it as low as seven years and others as low as 18 (Siegal 2008): in some jurisdictions young people can be viewed as 'minors' up until age 21. The age of criminal responsibility may also vary with gender, as in Iran where the age of criminal responsibility begins at nine for females, but 15 for males (Palme 1997). There is, therefore, no one definition of 'young offender'.

Recidivism rates amongst young offenders is significant. In New Zealand, 67% of offenders aged from 16 to 19 were reconvicted within two years of their previous offence (Triggs 2005). In England and Wales, the frequency of re‐offences for young offenders ranged from 40.2% in 2000 to 37.8% in 2007 (Ministry of Justice 2009). In Northern Ireland, re‐offending rates were reported as rising from 39.3% in 2005 to 41.8% in 2006 (Tate 2009). Reported recidivism rates are also likely to be an underestimate of the actual occurrence of the problem, as they only provide information on offences recorded by the judicial system, and do not take into account offences for which offenders have not been identified, or which victims have failed to report. Recidivism rates are also likely to be further constrained by the fact that even when a crime is brought to police attention, there is no guarantee it will be recorded. This decision will depend on three broader contexts: the current political context, the organisational context of policing priorities and the situational context of how the crime was reported (Coleman 1996). A young person who has committed an offence can face a variety of outcomes, from informal warnings, through restorative cautions, to referral for prosecution.

Description of the intervention

Restorative justice has been described as "a process whereby parties with a stake in a specific offence resolve collectively how to deal with the aftermath of the offence and its implications for the future" (Marshall 2003). Stakeholders include the victim, the offender (or perpetrator) and the broader community (Morris 2002). Different names have been given to the process of restorative justice, including Victim‐Offender Mediation, Community Reparative Boards, Referral Orders, Family Group Conferencing and Circle Sentencing. Family Group Conferences are distinguished by the involvement of the young person's family or support network in the overall process (Bazemore 2001).

Typically, the process will begin with a conference facilitator contacting both the victim and the offender to explain the process and inviting them to attend, making it clear that their attendance is voluntary. At this time, both the victim and offender are asked to name an individual who will also be invited to attend as their supporter. All willing parties then meet with the facilitator, usually in a neutral location. The conference proceedings begin with the offender being asked to describe the incident, followed by all other participants describing the impact of the incident on their lives. The victim is asked to identify the desired outcomes from the conference, followed by all participants contributing to the process of determining how the offender may best repair the harm caused by their actions. The conference ends with all participants signing an agreement that outlines the expectations and commitments decided upon as a result of this conference (Bazemore 2001).

The focus of the conference is not to determine guilt or innocence, but to consider an appropriate plan of action or "conference plan". These plans generally include one or more of: an apology to the victim, reparation or restitution to the victim or community, work or service to the community, restrictions on conduct, and treatment, for example to help overcome an addiction. The plan will be tailored to the age of the young person.

These restorative conferences may be ordered by the courts (court‐ordered) or recommended as an alternative to court proceedings by the police or public prosecution officer (diversionary). At a minimum, the participants in this conference are the young person who committed the offence, the conference coordinator, a police officer (or a representative from the criminal justice system) and an appropriate adult, for example, the young person's parent or guardian. The victim is encouraged to attend but is under no obligation, and in some instances the victim may be represented by another party.

These conferencing models are also used in other areas, such as child maltreatment (Dignan 2001). In these circumstances, families or those with significant relationships with the child in question come together to work collaboratively to resolve issues and develop plans that address the child's safety and well‐being (Knoke 2009). This review, however, will focus only on conferencing procedures aimed at young people who have committed a crime.

How the intervention might work

There are a number of theories as to how restorative conferences bring about change. Some have suggested that young people justify their behaviour and participation in a crime internally, using "techniques of neutralization" (Matza 1964), such as denying that any real injury was caused by their actions, for example, viewing theft as 'borrowing', or a gang fight as a 'private dispute'. The process of a restorative conference is thought to make it more difficult to maintain such justifications; face to face contact with the victim and the subsequent discussion, together with increased awareness of the harm their actions caused, challenge such denials and justifications. Bandura conceptualised this process as the Reversal of Moral Disengagement (Bandura 1990). Others have suggested that the process of restorative conferencing provides a remedial opportunity for moral development in young offenders who may hitherto have had limited exposure to morally formative experiences (Barton 2003). The offender's apology and the victim's forgiveness are generally regarded as essential parts of the process of emotional healing and the key to the successful outcomes of satisfaction and reducing recidivism (Retzinger 1996).

Sherman's Defiance Theory suggests that a possible cause of recidivism is the individual's perception that their punishment was 'unfair', leading to defiance of the law. Conversely, if they had perceived their punishment to be fair, it is more likely to have resulted in compliance with the law (Sherman 1993). Tyler's theory of procedural justice, in which a young person who feels they have been treated fairly by the justice proceedings may be less likely to break the law again, further supports this (Tyler 2005). For most individuals, a fair procedure is not just related to how favourable the outcome may be perceived to be, but also to factors such as neutrality, lack of bias, honesty, efforts to be fair, politeness and respect. There is evidence from young people to that effect, which they attribute to being part of a collaborative endeavour, rather than a bystander in normal court proceedings.

One of the core theories of restorative justice, on which the outcomes of this review are primarily based, is the Reintegrative Shaming Theory (Braithwaite 1989; Braithwaite 2001). The stigmatisation of offenders that occurs within conventional justice procedures is thought to be associated with the experience of shame. Braithwaite suggested that this stigmatising shame could be counterproductive, potentially alienating the offender (Braithwaite 1989; Braithwaite 2001). Restorative justice emphasises social processes that involve a disapproval of offending, rather than the offender, as this is thought more likely to have a more positive impact on a young person's cognitive and social development and self‐esteem than conventional justice processes. By focusing on the action, rather than the person, restorative justice minimises stigmatisation. Although restorative justice aims to shame offenders by confronting a young person with the impact of his or her actions, the requirement that they make reparation provides the means of forgiveness (Maruna 2007). Shame in restorative justice is therefore 'reintegrative' and is thought to bring about better outcomes, but by definition it hinges on the presence of the victim.

It is hypothesised that reintegration and forgiveness are more likely to occur if the young person not only recognises that they have caused harm as a result of their actions (that is, recognition of wrongdoing), but in addition, are willing to take responsibility for it and make restorative gestures to express their remorse (Young 2001). Expression of remorse is not only a further useful indicator of the young person's recognition of wrongdoing, but is also perhaps one of the more beneficial outcomes from the victim's perspective.

All of the above suggests that the restorative justice process may have a differential impact on a young person's self‐concept (that is, the multi‐dimensional construct of identity, self‐esteem, self‐efficacy and personal agency (McAdams 1996; Eccles 2002; Ward 2007)) than traditional criminal justice approaches. If successful, this restorative justice process should allow the young person to reintegrate into the community without the negative stigmatising shame usually associated with retributive justice, thus leading to comparatively better self‐perception.

In restorative conferences involving families, all parties are encouraged to accept responsibility for their actions, including the young person's family, who play a part in the creation of and adherence to the conference plan (Walgrave 2003). Previous evaluations of the conferencing model have indicated a 38% decrease in recidivism for young offenders, compared to a 6% increase in recidivism for adults convicted of drink‐driving (Sherman 2000).

The theory and practice of restorative justice are not uncontested. Critics argue that what began as an organic, community process has become an increasingly streamlined, police‐led process, with the risk that the police will improvise and act as judge and jury, thus eroding the legal rights of the young offender (Young 2001). In fact, a young offender remains entitled to consult a lawyer during this process, but more efforts are being made to have conferences facilitated by non‐police bodies and held in more neutral venues (Campbell 2006). Other criticisms of restorative conferencing include: net‐widening, in which those who commit very minor offences and who might previously have received a warning are caught up in a more substantial process (O'Mahony 2004); the potential trivialisation of crime, with the result that acts such as male violence towards women become a private matter to be dealt with away from the courts; and uncertainty about what the term 'restorative justice' means or what this process is able to 'restore': a sense of offender responsibility, offender sense of control or a belief that the overall process and outcomes were fair (Morris 2002). In response others have pointed out that restorative procedures take crime more seriously than court proceedings by focusing on the harm caused by the offender’s actions and finding ways they can specifically make amends for their actions (Morris 2002).

Some have expressed doubt as to the potential effectiveness of a brief intervention, given the years of social disadvantage and exclusion that many offenders are likely to have faced, and other factors linked with youth offending and desistance from crime. In particular, the interrelationships between lack of educational, training and employment opportunity and youth crime have been well documented (Burnett 2004; Hayward 2004). Similarly, the links between substance misuse and youth offending have been well documented (Britton 2008). It is argued that addressing such needs where identified is essential to reduce future offending (Burnett 2004). One of the aims of restorative justice interventions is to address the implications of offending for the future. Therefore, addressing such issues may be relevant for the 'successful' outcome of an intervention.

There is also uncertainty about the impact of restorative conferences on the victim, when he or she attends. Some victims report feelings of empowerment and resolution of their grief and distress, leading to emotional healing, and state that the 'humanising' of the offender has, for some, minimised the fear they had as a 'victim'. Others, however, report more negative experiences, for example, when faced with a conference facilitator who was perceived to have an inappropriate style or be insufficiently well prepared; or when the offender had an uncooperative attitude (for example, was aggressive, argumentative or uninformative); or when the victim felt coerced into taking part (Umbreit 1994). It is possible that both that the victim's experience and attitude towards the conference could contribute to the overall experience of the young offender, and that a negative victim outcome could be considered an important adverse effect to take into account in the overall evaluation of the intervention.

There is also uncertainty about some aspects of process. The introduction of court‐ordered conferences mean that some offenders agree to participate because they feel that they have no choice, which may affect their motivation and compliance (Campbell 2006). The effectiveness of conferences may be a function of the severity of the young person's initial offence. Some studies suggest that restorative conferences can lead to a large drop in post‐intervention rates of serious offences such as youth violence, but that such reductions were not evident for those convicted for less severe offences such as shoplifting or property offending (Sherman 2000).

Why it is important to do this review

Although reduction of recidivism is not a primary aim of restorative justice, it is a key policy concern. Furthermore, while recidivism is one measure of 'effectiveness', it is by no means the only focus, and the emergent evidence suggests that there are other ancillary benefits that are also relevant to policy‐makers. Restorative justice techniques are gaining an increasingly higher profile, with conferencing models being implemented in North America, Australia, New Zealand, and parts of Europe, and a primary aim to institutionalise these programmes as part of the justice process (Bazemore 2001). Therefore, it is clearly of importance to determine primarily whether this approach does hold any demonstrable benefits specifically for this population in terms of reducing re‐offending over the standard judicial proceedings, and to explore whether there are any particular issues regarding implementation of the programmes that play a vital role in the outcome of the procedure. Most previous reviews of restorative justice conferencing have taken a broad focus, for example, including results concerning both adult and juvenile offenders (Miers 2001). This systematic review assesses the evidence of restorative justice conference for young offenders.

Objectives

To evaluate the effects of restorative justice conferencing programmes for reducing recidivism in young offenders.

To explore process and implementation issues in relation to programme effects on recidivism and improving participants' self‐concept. There was insufficient information from the studies included in this review to address this objective, but it may be possible to address it in future updates.

Methods

Criteria for considering studies for this review

Types of studies

We included randomised controlled trials (RCTs) or quasi‐RCTs. Eligible methods of quasi‐random allocation would include alternation, date of birth, or case record number. We included studies comparing restorative justice conferencing programmes to management as usual.

Types of participants

In order to ensure the international relevance of this review, we included studies where participants were young people aged between 7 and 21 who admitted to, or had been found guilty of, any offence, and who were deemed eligible for a restorative justice programme, by the individual study authors. Participant's 'eligibility for a restorative justice programme' was determined by factors including that they must be first‐time juvenile offenders (Bethlehem Experiment; Indianapolis Experiment), have no outstanding warrants or bonds (RISE JPP Experiment; RISE JPS Experiment), must not have committed a felony level crime, drug/alcohol crime, or sex offence (Bethlehem Experiment), must either have committed an offence of criminal mischief, disorderly conduct, theft, conversion (shoplifting) or battery (Indianapolis Experiment), and must make full admission of responsibility (RISE JPP Experiment; RISE JPS Experiment).

Types of interventions

Restorative justice conferences that follow the previously outlined definition of a restorative justice programme were eligible, specifically programmes whereby "parties with a stake in a specific offence resolve collectively how to deal with the aftermath of the offence and its implications for the future" (Marshall 2003).

Programmes that include all of the following features were eligible:

  1. minimum attendees included the young person, a conference coordinator, an appropriate adult (for example, the young person's parent or guardian) and a representative from a key stakeholder group (for example, the victim of the crime, a representative of the victim of the crime, a member of the community affected or a representative of the justice community);

  2. young person attended of their own free will;

  3. all parties were involved in the construction of a conference plan with a primary aim of reparation;

  4. where appropriate, plans were approved by the appropriate authorities.

Programmes that will not be eligible and therefore excluded are those in which victim‐offender mediation occurs separate to the meeting with the parents/guardians. In these programmes, the parties with a stake in the offence (specifically the young person's victim and the young person's parent/guardian) are not working as a collective, and therefore do not fit the previously outlined definition of a restorative justice conference.

Management as usual

Depending on the area in which the study takes place, the definition of 'management as usual' may differ. For example, in Bethlehem, PA, management as usual includes formal adjudication through the magistrate court system (Bethlehem Experiment). In Indianapolis, IN, the usual course of action may include alternative diversionary practices, such as victim‐offender mediation, volunteer services, teen court or garden projects (Indianapolis Experiment).

Types of outcome measures

Where feasible, comparisons are made at the following specific follow‐up periods:

    • one year after conference takes place;

    • two years after conference takes place;

    • more than two years after conference takes place.

Primary outcomes

  • Recidivism rate as measured by administrative data*

  • Post‐intervention rates of offending as measured by self‐report

Secondary outcomes

  • Young person's sense of remorse

  • Young person's recognition of wrongdoing

  • Young person's self‐perception

  • Characteristics of the post‐intervention offence, specifically:

    • post‐intervention offending with the same offence;

    • severity of the post‐intervention offence.

  • Young person's satisfaction with overall process*

  • Victim/key stakeholder satisfaction with overall process*

  • Change in social circumstances, including:

    • change in employment status (for example, from unemployed to employed);

    • return to education;

    • increased attempts to attend or develop training;

    • increased or decreased substance misuse.

  • Adherence to conference plan

Outcomes indicated by an asterisk (*) were used to populate the summary of findings Table 1, where data permitted. Where data were insufficient, we have provided a narrative account of the outcomes.

Search methods for identification of studies

We ran the first set of searches in May 2011. Updated searches were run in November 2011 and May 2012, apart from ASSIA, NCJRS and Social Services Abstracts because they were no longer available to us.

Electronic searches

The following databases were searched.

  1. Cochrane Central Register of Controlled Trials (CENTRAL), 2012 Issue 5, searched 4 May 2012

  2. Ovid MEDLINE, 1948 to current, last searched 4 May 2012

  3. PsycINFO (Ovid),1806 to current, last searched 17 May 2012

  4. PsycINFO (EBSCOhost)),1887 to current, last searched 16 May 2011

  5. Science Direct; 1823 to current, last searched 4 May, 2012

  6. SCOPUS, 1823 to current, last searched 10 May 2012

  7. LILACS, 1982 to current, last searched 5 May 2012

  8. Social Sciences Citation Index, 1970 to current, last searched 5 May 2012

  9. Social Care Online (SCIE),1985 to current, last searched 4 May 2012

  10. ERIC (Proquest) 1966 to current, last searched 4 May 2012

  11. ERIC (Dialog Datastar) 1966 to current, last searched 9 May 2011

  12. ASSIA ‐ Applied Social Sciences Index and Abstract (CSA),1987 to current, last searched 9 May 2011

  13. NCJRS ‐ National Criminal Justice Reference Service (CSA), all available years, last searched 9 May 2011

  14. Sociological Abstracts ( Proquest) 1952 to current, last searched 4 May 2012

  15. Social Services Abstracts (CSA), 1979 to current, last searched 9 May 2011

  16. WorldCat, all available years, searched 9 May 2012

  17. Index to Theses, all available years, last searched 4 May 2012

  18. Bibliography of Nordic Criminology, 1999 to current, last searched 4 May 2012

  19. Restorative Justice Online, 1975 to current, last searched 4 May 2012

  20. ClinicalTrials.gov, last searched 19 May 2012

  21. International Clinical Trials Registry Platform (ICTRP), last searched 19 May 2012

The search strategy for each database can be found in Appendix 1.

Search filters for RCTs were used where appropriate. No language or date restrictions were applied.

Searching other resources

Bibliographies of included and excluded studies were scanned for possible additional references of interest.

The American Society of Criminology Conference Programme was reviewed in order to identify relevant trials.

The European Forum for Victim‐Offender Mediation and Restorative Justice and the International Centre for Criminal Law Reform and Justice Policy were also searched, in order to identify additional relevant grey literature.

Authors and key scholars were contacted to identify any additional ongoing or missed studies.

Data collection and analysis

For details of decisions made at protocol stage but which were not implemented in this review, please see Table 1.

Open in table viewer
Table 1. Additional methods for future updates

Issue

Method

Objectives

If future updates identify studies with sufficient information, we will address the second objective of this review, viz: To explore process and implementation issues in relation to programme effects on recidivism and improving participants' self‐concept.

Outcomes

Attention must be paid to recidivism rates that reflect crimes committed prior to the intervention, but for which judicial proceedings have only begun after the intervention. Care will be taken to ensure that these rates are not falsely reflected as post‐intervention offending.

Cluster‐randomised trials

If insufficient information is available to control for clustering, we will enter data into RevMan using individuals as the unit of analyses. We will then perform sensitivity analyses to assess the potential bias that may occur as a result of the inadequately controlled clustered trials. We would also perform sensitivity analyses if the ICCs had been obtained from external sources.

Studies with multiple intervention groups

 

If two or more interventions groups are compared to an eligible control group, the intervention group that most closely follows the previously outlined definition of a restorative justice conference will be included in the meta‐analysis. The decisions made during this process will be clearly outlined in the review. Some studies may also include more than one control group, who undergo different yet equally eligible forms of "management as usual". In this situation, the control groups will be combined to create a single pair‐wise comparison. If this strategy poses a problem for investigation of heterogeneity, each group would be compared separately as part of a subgroup analyses. The sample size for the shared comparator group will be split accordingly for subgroup analyses to prevent the same comparator participants being included twice (Higgins 2011).

Dealing with missing data

Data that are missing at random (due, for example, to postal disruptions) can be ignored as the reasons are unlikely to be related to the outcomes of the missing data. In this case, we will analyse data using an available case analysis.

Where continuous data are missing, we will impute data using a 'last observation carried forward' approach. Where cases are missing from the first outcome measure, sample means values will be imputed.

Assessment of heterogeneity

Future updates will describe the clinical and methodological heterogeneity of the included studies, as done in this review. If unexpected variability arises, it will be discussed in full.

Assessment of reporting biases

When sufficient studies are available for inclusion in this review, we will assess publication and other reporting biases through the use of visual inspection of funnel plots along with trim and fill analyses.

Subgroup analysis and investigation of heterogeneity

If the number of included studies is sufficient, subgroup analyses will be used to examine:

  • the differential effects of interventions by the severity of the offence, specifically whether those with more serious offences respond differently to the conferences than those with more minor offences;

  • the differential effects of interventions by the gender of the young person who has committed the offence;

  • the differential effects of interventions by the presence of the personal victim versus the presence of a victim representative or no victim at the conference; and

  • the differential effects of interventions by diversionary versus court‐ordered conferences.

Sensitivity analysis

We will perform sensitivity analysis to assess whether the findings of this review are robust to the decisions made in the process of obtaining them. When the data permit, we will perform sensitivity analysis by reanalysis, excluding studies according to study quality issues, including those with low sample size, high risk of bias, or high attrition and dropout rate, and whether randomisation occurred pre‐charge, post‐charge but pre‐sentencing, or post‐sentencing, and before or after agreement to participate in the study.

Selection of studies

Three authors (GM, NC, NL) independently selected and assessed studies to determine whether they met the inclusion criteria for this review. Any disagreements between the authors were resolved through discussion.

Data extraction and management

Two authors (NC, NL) extracted data independently and entered data into a piloted data extraction form (Appendix 2). Any disagreements between the authors were resolved through discussion. Data extracted included the following:

  • study characteristics (study author(s), year of publication, citation and contact details, study design, study duration, details of attrition, and risk of bias concerns);

  • participant characteristics (number randomised, age of participants, gender distribution, geographical location of study, and type and severity of offence);

  • intervention characteristics (aim of the intervention, who was present at the intervention, time between crime and intervention, duration of the intervention; number of interventions, source of the intervention (that is, diversionary or court‐ordered), construction of a conference plan and completion of a conference plan);

  • comparison characteristics (form of 'management as usual', frequency of 'management as usual', duration of 'management as usual', time between crime and 'management as usual');

  • outcome characteristics (details on all primary and secondary outcomes, measures used, length of follow‐up and summary data, including means, standard deviations, confidence intervals and significance levels for continuous data and proportions for dichotomous data).

Assessment of risk of bias in included studies

Using the data extraction form, two authors (NL, NC) independently assessed each study for risk of bias and assigned each selected study to one of the following categories as outlined in the Cochrane Handbook for Systematic Reviews of Interventions (Higgins 2011):

  • high risk of bias;

  • low risk of bias;

  • unclear or unknown risk of bias.

Assessments of risk of bias for each study was based on the following criteria as outlined by the Cochrane Handbook for Systematic Reviews of Interventions (Higgins 2011).

  1. Sequence generation (was the allocation sequence adequately generated?)

  2. Allocation concealment (was allocation adequately concealed?)

  3. Blinding of participants, personnel and outcome assessors (was knowledge of the allocated intervention adequately prevented during the study?)

  4. Incomplete outcome data (were incomplete outcome data adequately addressed?)

  5. Selective outcome reporting (are reports of the study free of suggestion of selective outcome reporting?)

  6. Other sources of bias (was the study apparently free of other problems that could put it at a high risk of bias?)

Measures of treatment effect

For dichotomous outcome data (recidivism, self‐concept/satisfaction scores), we calculated effect sizes as odds ratios (ORs) with 95% confidence intervals (CIs). We converted continuous outcome data (post‐intervention monthly rate of reoffending) into standardised mean differences (SMDs) and presented data with 95% CIs.

Unit of analysis issues

Cluster‐randomised trials

Cluster‐randomised trials are possible in this area of research, as allocation to the intervention group may occur by jurisdiction or by community as opposed to by individual offender. We anticipated that investigators would have controlled for a clustering effect when presenting their results. We contacted authors for further information if this was unclear. If the clustering effect was not controlled for, we requested individual participant data to calculate an estimate of the intracluster correlation coefficient (ICC). If individual participant data were not available, we searched for external estimates of the ICC from similar studies or available resources. As an appropriate ICC could not be found from any available resources, we sought statistical advice and were advised to use an ICC of 0.5 to re‐analyse the trial data to obtain approximate correct analyses. We then entered these data into the Cochrane Collaboration's statistical software, Review Manager 2008, to analyse effect sizes and confidence intervals using the generic inverse variance method (Higgins 2011).

Cross‐over trials

Cross‐over trials are unlikely in this area. Those who are part of both a restorative intervention and full standard court proceedings are likely to do so because the conference was terminated and court proceedings were implemented as an alternative. Had this occurred, we would have excluded these participants from this review.

Studies with multiple intervention groups

Multiple observations are a possibility in this area, hence the decision to define specific follow‐up intervals. We did not find any studies with multiple intervention groups for this version of the review.

Dealing with missing data

We contacted the original investigators to request missing data. Where this was not possible, we made assumptions regarding whether the data were 'missing at random' or 'not missing at random' and followed the recommendations of the Cochrane Handbook for Systematic Reviews of Interventions (Higgins 2011).

Data that are not missing at random are likely to be missing for reasons related to the outcomes of the missing data. For example, if a participant agrees to take part in a trial, but is unhappy with the outcome of allocation, or goes on to commit a post‐intervention offence, s/he may be unwilling to complete any follow‐up interviews or questionnaires on their experience. In such a situation, where dichotomous data were missing, we imputed data with the assumption that the participants experienced the less favourable outcome (for example, "recidivism did occur" or "they were not satisfied").

Data imputation may not be possible in all situations, for example, if insufficient information was given regarding the exact number missing from each group. Should this occur, we will analyse only the available data.

We conducted sensitivity analyses to examine the impact on the results of changes in the assumptions made about missing data. For example, where dichotomous data cases were missing, we also explored the possibility that those missing experienced the positive outcome and imputed data based on this assumption also.

Where studies had missing summary data, such as missing standard deviations, we derived these where possible using calculations provided in the Cochrane Handbookfor Systematic Reviews of Interventions (Higgins 2011).

We have specified the methods used to address any missing data in the Characteristics of included studies tables. If imputation was not possible, we outline the reasons for this in the text.

Assessment of heterogeneity

We examined clinical heterogeneity by inspecting each included study for variability in the participants, interventions or outcomes described. If unexpected variability had arisen, we would have discussed it in full in the review.

We examined methodological heterogeneity by inspecting each included study for variability in the study design and risk of bias. If unexpected variability had arisen, we would have discussed it in full in the review.

We assessed statistical heterogeneity using the Chi2 statistic and its P value, the I2 statistic and by visual inspection of the forest plots.

Assessment of reporting biases

Publication and other reporting biases could not be assessed due to the small number of included studies. Although it is regrettable that this version of the review could not ascertain with more precision the likelihood of reporting bias, it is possible that in future updates, more than four studies could be included in the review, thus allowing for a less equivocal conclusion to be reached on this issue (Table 1).

Data synthesis

Meta‐analysis was performed on the results when data from at least two included studies were available. Due to the expected heterogeneity among included studies, we performed a random‐effects meta‐analysis using an inverse variance weighting method. When meta‐analysis was inappropriate, we provide a narrative description of the individual study results. We performed both fixed‐effect and random‐effects analyses as part of our sensitivity analyses.

Subgroup analysis and investigation of heterogeneity

Due to the small number of included studies, it was not possible to conduct subgroup analysis in this review.

Sensitivity analysis

Sensitivity analyses were performed by reanalysis, without adjusting for a cluster effect, without imputing data for the missing participants, imputing data for the missing participants assuming they experienced the positive outcome and removing the "decline" group from the experimental group in the Bethlehem Experiment.

Results

Description of studies

Results of the search

A systematic search for this review was conducted in May 2011. A total of 512 records of potential trials were identified. Following inspection of the titles and abstracts, 388 records were deemed irrelevant and discarded. Full texts were obtained and read for the remaining 124 records. A further 70 records were deemed irrelevant and discarded.

The search was run again in November 2011. Most databases identified no new records since the previous search. The databases ASSIA, NCJRS and Social Services Abstracts were no longer accessible to the authors and could not be searched again. Index to Theses identified four new records and Social Care Online identified six new records. Three databases were run on new platforms using new strategies, and subsequently identified an additional 11 (PsycINFO), 85 (Social Sciences Citation Index) and 44 (Sociological Abstracts) records. In total, 148 of these new records were deemed irrelevant and discarded. The remaining two records were screened and subsequently added to the list of excluded studies.

The search was re‐run in May 2012. Most databases identified no new records since the previous search. The ERIC database was run on a new platform using new strategies and subsequently identified an additional 32 records. Six of the databases identified an additional 10 (Social Care Online), six (Sociological Abstracts), four (LILACS), three (Social Sciences Citation Index), five (Science Direct), and 14 (PsycInfo) new records. This most recent search also included two online trial registers, which identified an additional 26 records (Clinicaltrials.gov) and 16 records (ICTRP). In total, 115 of these new records were deemed irrelevant and discarded. The remaining one record were screened and subsequently added to the included studies list.

See Figure 1 for the study flow diagram.


Study flow diagram

Study flow diagram

Included studies

A total of four studies (16 citations) met the inclusion criteria for this review. Nine records were categorised as studies awaiting classification. See also Characteristics of included studies; Characteristics of excluded studies; Characteristics of studies awaiting classification.

Location of studies

The Bethlehem Police Family Group Conferencing Project took place in Bethlehem, Pennsylvania, USA (Bethlehem Experiment).

The Indianapolis Juvenile Restorative Justice Experiments took place in Indianapolis, Indiana, USA (Indianapolis Experiment).

The Reintegrative Shaming Experiments (RISE) took place in Canberra, Australia, and provided data for two separate experiments, the RISE Juvenile Property Personal Victims experiment (RISE JPP Experiment) and the Juvenile Property Shoplifting experiment (RISE JPS Experiment).

Study design

All four studies were randomised trials. The Indianapolis Experiment randomly assigned individual offenders. However, the RISE JPP Experiment, the RISE JPS Experiment and the Bethlehem Experiment randomly assigned cases or offences, regardless of whether they involved one or more individual offenders. Analyses were then conducted at the level of the individual offender, without adjusting for potential cluster effects. Following consultation with statisticians, the decision was made to follow the more conservative route of adjusting for the effects of cluster randomisation when analysing these studies. ICCs were not provided for any of the included studies. Failure to identify an ICC from any suitable similar studies led to the decision to estimate an ICC of 0.5, as recommended by the consulted statistician.

Participants

Participants were eligible for the Bethlehem Experiment if they were under the age of 18, were first time offenders and admitted responsibility for the crime. Those with felony level crimes, drug or alcohol crimes, or sex offences were ineligible, resulting in only participants who had committed property crimes and crimes of violence.

Study authors provided follow‐up data for participants in the intervention group, participants in the control group and participants who were assigned to the intervention group, but declined to participate. For the purpose of this review, participants in the intervention group and the 'decline' group were combined to create one group, allowing all participants to be analysed based on assigned treatment, rather than treatment delivered.

Participants were eligible for the Indianapolis Experiment if they were first‐time offenders under the age of 14 years, who had not been arrested for a serious violent offence and who admitted responsibility for the offence.

The RISE studies provided data on four separate experiments, examining the effect of the intervention on four separate groups of offenders: those charged with drink driving offences, those charged with youth violence offences, those charged with juvenile property offences and those charged with juvenile shoplifting offences. Because the drink driving experiment accepted participants of any age, and the youth violence offences accepted participants up to the age of 30 years, (and disaggregated data were not available), the results from these two experiments were considered ineligible and thus excluded from this review. Participants were eligible for the remaining RISE JPP Experiment and RISE JPS Experiment if they were under the age of 18 years, had no outstanding warrants and admitted responsibility for the offence. Previous offences did not render participants ineligible, unless there was an outstanding warrant.

Interventions

All interventions involved a meeting between the victim, the offenders, supporters of both the victim and offender, and a liaison officer. All present were given the opportunity to discuss the crime and its effects. Each intervention concluded with the construction of a reparation plan. The neutrality of the location of interventions varied, including police stations (RISE JPP Experiment; RISE JPS Experiment), "monitored settings" (Bethlehem Experiment) and schools/libraries/ community centres (Indianapolis Experiment). The average duration of each intervention's conference was 34 minutes for the Bethlehem Experiment, 43 minutes for the Indianapolis Experiment, 85 minutes for the RISE JPP Experiment and 70 minutes for the RISE JPS Experiment. All conferences were diversionary rather than court‐ordered.

Outcomes
Primary outcomes

Recidivism rate as measured by administrative data

Recidivism was measured by all four included studies. Recidivism is reported in the RISE studies as a one‐year post‐intervention monthly offending rate across groups for both the JPP Experiment (RISE JPP Experiment) and the JPS Experiment (RISE JPS Experiment). Recidivism is reported in the Bethlehem Experiment and the Indianapolis Experiment as a percentage of each group who were re‐arrested at 12‐month follow‐up ) and at 24‐month follow‐up, respectively. Although in the original protocol, the intention was to conduct separate analyses for 12‐ and 24‐month follow‐ups, a post‐hoc decision was made to combine all data at the furthest end point, thus allowing the Bethlehem Experiment and the Indianapolis Experiment to be combined in a meta‐analysis.

Post‐intervention rates of offending as measured by self‐report

None of the included studies reported recidivism using self‐reported rates of offending. All used administrative data.

Secondary outcomes

Young person's sense of remorse

Young people's remorse following the conference was measured in the RISE experiments (RISE JPP Experiment; RISE JPS Experiment), using offenders' responses from structured interviews conducted by a trained RISE interviewer after the intervention. Remorse was measured as participants agreement or disagreement with the statement "At treatment, I felt ashamed of what I did".

A second wave of interviews was conducted two years post intervention. However, as the analyses for these interviews were reported as "still in progress", this review only considers data from the first wave interviews.

Young person's recognition of wrongdoing

Young people's recognition of wrong‐doing following the conference was measured in the RISE experiments (RISE JPP Experiment; RISE JPS Experiment), using offenders' responses from structured interviews conducted by a trained RISE interviewer after the intervention. Recognition of wrong‐doing was measured as participants agreement or disagreement with the statement "At treatment, I felt my offence was wrong".

A second wave of interviews was conducted two years post intervention. However, as the analyses for these interviews were reported as "still in progress", this review only considers data from the first wave interviews.

Young person's self‐perception

Young people's self‐perception following the conference was measured in the RISE experiments (RISE JPP Experiment; RISE JPS Experiment), using offenders' responses from structured interviews conducted by a trained RISE interviewer after the intervention. Self‐perception was measured as participants agreement or disagreement with the statement "I felt that my self‐respect decreased".

A second wave of interviews was conducted two years post intervention. However, as the analyses for these interviews were reported as "still in progress", this review only considers data from the first wave interviews.

Characteristics of the post‐intervention offence, specifically post‐intervention offending with the same offence as that for which the offender was 'conferenced', and severity of the post‐intervention offence

None of the included studies assessed the characteristics of the post‐intervention offence.

Young person's satisfaction with overall process

Both the Bethlehem Experiment and the Indianapolis Experiment measured young person's satisfaction with the overall process at 12‐month and 24‐month follow‐up, respectively, using questionnaires. Following enquiries with the authors of Indianapolis Experiment, a more up‐to‐date data set than was publicly available was provided for the satisfaction scores. In both studies, participants' responses were recorded on an ordinal scale. For the purpose of analyses in this review, these were converted to dichotomous outcomes of number of participants satisfied and not satisfied. For the Indianapolis Experiment's five‐point scale, young people who stated they were "very satisfied" and "satisfied" were combined to create the "satisfied" group, and those who stated they were "dissatisfied", "very dissatisfied" or "neither" were combined to create the "dissatisfied group. For the Bethlehem experiment's four‐point scale, young people who stated they were "very satisfied" and "satisfied" were combined to create the "satisfied" group, and those who stated they were "dissatisfied" and "very dissatisfied" were combined to create the "dissatisfied group.

Victim/key stakeholder satisfaction with overall process

Both the Bethlehem Experiment and the Indianapolis Experiment measured the victim's satisfaction with the overall process at a 12‐month follow‐up ) and a 24‐month follow‐up,) respectively, using questionnaires. A more up‐to‐date data set than publicly available for the victim's satisfaction scores in the Indianapolis Experiment was provided by the study authors. In both studies, participants' responses were recorded on an ordinal scale. For the purpose of analyses, the responses on these scales were converted to dichotomous outcomes of number of participants satisfied and not satisfied. For the Indianapolis Experiment's 5‐point scale, victims who stated they were "very satisfied" and "satisfied" were combined to create the "satisfied" group, and those who stated they were "dissatisfied", "very dissatisfied" or "neither" were combined to create the "dissatisfied group. For the Bethlehem Experiment's 4‐point scale, victims who stated they were "very satisfied" and "satisfied" were combined to create the "satisfied" group, and those stated they were "dissatisfied" and "very dissatisfied" were combined to create the "dissatisfied group.

Change in social circumstances, including: employment, education, training and substance misuse

Change in social circumstances was reported as "Prevalence of life events" in both RISE experiments using responses from interviews with the offenders conducted after the intervention (RISE JPP Experiment; RISE JPS Experiment). However, as no data were provided on social circumstances prior to the intervention, the data cannot be used to assess the degree of participant 'change' in social circumstances.

Adherence to conference plan

This was only reported by the Bethlehem Experiment.

Outcomes measured by studies but not included in this review

Bethlehem Experiment

  • Conference observations and coordinator performance evaluations

  • Change in police attitudes and role orientation (as measured by an officer attitudinal and work environmental survey)

  • Victim's perception of fairness, victim's belief that the offender was adequately held accountable for the offence committed, victim's perception that their opinion regarding the offence and circumstances were adequately considered in this case (as measured by victim survey, sent at least two weeks after deposition)

  • Offender's experience of fairness, offender's belief that they were adequately held accountable for the offence committed, offender's attitude towards the victim (as measured by offender survey, sent at least two weeks after deposition)

  • Parent of offender satisfaction, parent's experience of fairness, parent's belief that their child was adequately held accountable for the offence committed, parent's perception that their opinion regarding the offence and circumstances were adequately considered in this case, parent's views on the likelihood that their child will commit another/similar offence, parent's views on if the payment/community service agreement was fair to the parent/victim/offender, parent's attitude towards their child, parent's opinion of their child, parent's perception regarding the victim's opinion of their child (as measured by parent survey, sent at least two weeks after deposition)

Indianapolis Experiment

  • Post conference/diversion surveys with offending youths, victims, victim's supporters, offender's parents or supporters, measuring participation in conference/designated diversion programme, perception of participant behaviour during conference, value of programme, sense of justice

  • One‐year follow‐up interview with offender, measuring family and peer relationships, school performance, work involvement

  • One‐year follow‐up interview with victim, measuring sense of justice, degree to which victim had input into how case was handled, re‐victimisation

RISE JPP Experiment

  • Offender's reactions to the conference, including their view on emotional intensity, perceived procedural justice, perceived retributive justice, perceived reintegrative shaming (including remorse and recognition and wrongdoing), perceived stigmatic shaming, perceived forgiveness, perceived anger, perceived defiance, perceived legitimacy, perceived informal social control, perceived deterrence, self‐projected compliance, perceived self‐stigma (including self‐perception), as measured by post conference interviews

  • The victim's perspective on the process, including financial harm, emotional harm, notification of proceedings, presence at proceedings, and victims' reactions to their treatment, (as measured by post‐conference interviews)

  • Police attitudes towards court and conference (as measured by post‐conference questionnaire)

RISE JPS Experiment

  • Offender's reactions to the conference, including their view on emotional intensity, perceived procedural justice, perceived retributive justice, perceived reintegrative shaming (including remorse and recognition and wrongdoing), perceived stigmatic shaming, perceived forgiveness, perceived anger, perceived defiance, perceived legitimacy, perceived informal social control, perceived deterrence, self‐projected compliance, perceived self‐stigma (including self‐perception), as measured by post conference interviews

  • The victim's perspective on the process, including financial harm, emotional harm, notification of proceedings, presence at proceedings, and victims' reactions to their treatment, (as measured by post conference interviews)

  • Police attitudes towards court and conference (as measured by post‐conference questionnaire)

Statistical heterogeneity

The statistical heterogeneity was measured for each outcome through use of the Chi2 statistic and its P value, the I2 statistic. Caution is recommended when interpreting the subsequent results, as with the inclusion of only two studies in each meta‐analysis, the precision of each analysis is low.

Clinical heterogeneity

There was no unexpected variability in the clinical heterogeneity in each included study. The participants in each included study were of a similar age (maximum age 14 to 18 years). The interventions all followed a similar format and closely adhered to a restorative justice conference programme. Similar outcomes of recidivism were measured by all included studies.

Methodological heterogeneity

There was no unexpected variability in the methodological heterogeneity in each included study. All included studies made use of a RCT design, and all similar levels of low or unclear risk of bias, it was judged that there was no unexpected variability in the methodological heterogeneity in each included study.

Excluded studies

A total of 32 records (23 studies) were excluded from this review. Of these records, 16 records were excluded because they did not involve random allocation or quasi‐random allocation. Seven records were excluded because they involved interventions in which the meeting between the victim and offender occurred separately to the family group conference. Including these studies may have distorted results, as a crucial component of a restorative justice conference is that all parties are encouraged to accept responsibility for their actions, including the young person's family. Therefore, these interventions may not have been as effective as a restorative conference. Three records were excluded because the age range of the participants went beyond the eligibility criteria for this review. Including older participants may have distorted results, as it is expected that this type of restorative justice intervention is more effective for young offenders.The remaining six records were excluded for various reasons, including no evaluation data provided (three records), a focus on child welfare rather than youth justice (one record), a focus on police officers' experience and understanding (one record) and recruitment from a youth justice conference but for other research purposes (one record).

Risk of bias in included studies

The Indianapolis Experiment had a total sample size of 782 (400 experimental and 382 control). The Bethlehem Experiment allocated a total of 215 offences (143 experimental, 72 control), consisting of 292 offenders (189 experimental, 103 control). The RISE JPP Experiment allocated 117 cases involving 143 offenders. However, many of these cases were still in progress at the time of analysis. Therefore, results from this study are based on the 108 cases (135 offenders: 73 experimental, 62 control) completed to date. The RISE JPS Experiment allocated 173 cases involving 249 offenders. However, many of these cases were still in progress at the time of analysis. Therefore, results from this study are based on the 162 cases (238 offenders: 124 experimental, 114 control) completed to date.

Full details of risk of bias assessment for each study can be found in the Characteristics of included studies tables and is displayed graphically in Figure 2 and Figure 3.


'Risk of bias' summary: review authors' judgements about each risk of bias item for each included study

'Risk of bias' summary: review authors' judgements about each risk of bias item for each included study


'Risk of bias' graph: review authors' judgements about each risk of bias item presented as percentages across all included studies

'Risk of bias' graph: review authors' judgements about each risk of bias item presented as percentages across all included studies

Allocation

Sequence generation and allocation concealment were both adequately conducted across all studies. Methods of allocation included the use of a random number generator (Bethlehem Experiment), random selection from a pile of sealed brown envelopes (Indianapolis Experiment), and a quasi‐random number generator (RISE JPP Experiment; RISE JPS Experiment).

Blinding

No study made any reference to procedures to blind either the participant or outcome assessors to the intervention. However, due to the nature of the intervention, it is unlikely to have been feasible to blind participants in any of the studies. Blinding of outcome assessors however, may have been feasible, as administrative data could be "blind". As insufficient information was provided by all studies on this issues, the overall assessment for this criteria remains 'unclear'.

Incomplete outcome data

Study authors were confident that attrition rates for the outcome of recidivism were low across all included studies, due to the use of administrative data, and by analysing participants based on "assigned treatment" rather than "treatment completed", minimising attrition bias.

The risk of bias arising from incomplete outcome data was judged to be 'unclear' or 'high' for all remaining outcomes across all four studies. For satisfaction outcomes, the Bethlehem Experiment had a response rate of 84% for participants in the intervention group and 63% for participants in the control group, while for the 'self‐esteem' outcome, the RISE JPP Experiment and the RISE JPS Experiment completed interviews with respectively 73% and 87% of their intervention groups, and 77% and 72% of their control groups.

The most likely reason for attrition was participant failure, that is, the participants who were missing were likely to have reoffended since the intervention, or have felt low satisfaction with the overall process. Therefore, when missing data were imputed in this review, the assumption was made that the missing participants experienced the negative outcomes. Attrition rates for the 'satisfaction' data in the Indianapolis Experiment were particularly problematic since no information was given regarding the exact percentage missing from each group. Authors were contacted to clarify this issue, but they were only able to provide an approximate total number of 200 participants missing, and were unable to provide any further detail regarding the exact number missing in each group. Due to this, and the large proportion missing, the decision was made not to attempt any imputations for this study and to analyse using an available case analysis. Indianapolis Experiment was rated as 'high' risk of bias.

Selective reporting

Reporting bias appeared to vary across the studies. While not every study included the primary outcome of recidivism, there appeared no evidence that other outcomes were planned and then omitted from the results. Three of the four studies were rated as 'low'. One of the studies failed to report their significance values in full (Bethlehem Experiment) and so we rated this as 'high' risk of bias.

Other potential sources of bias

Self‐selection bias was highly likely across all four studies, as participation was voluntary and required offenders to make a full admission of responsibility.

Effects of interventions

See: Summary of findings 1 Restorative justice conferencing for reducing recidivism in young offenders (aged 7 to 21 years)

Except where stated, we conducted all sensitivity analyses planned: reanalysing the data without imputing data for the missing participants, imputing data for the missing participants assuming they experienced the positive outcome, removing the "decline" group from the experimental group in the Bethlehem Experiment using a fixed‐effect model, and without adjusting for a cluster effect. The reason for reanalysing without a cluster effect is that because not all participants were cluster‐randomised across all studies, the decision to treat all as cluster‐randomised trials could underestimate the overall effect. By analysing without a cluster effect, it is possible to explore the less conservative option and determine whether a potential overestimation of the effect instead could reach significance.

Recidivism rate as measured by administrative data

All four included studies looked at the impact of intervention on recidivism. Data from Bethlehem Experiment and Indianapolis Experiment were measured in the same way, recording the number of participants re‐arrested following intervention, thus allowing them to be combined in a meta‐analysis.

Number re‐arrested

The pooled estimate using a random‐effects model was 1.00 (OR) (95% CI 0.59 to 1.71; P = 0.99), that is, no statistically significant difference was detected in favour of the intervention (Analysis 1.1). The I2 statistic indicates 70% of the variation in the point estimates is due to heterogeneity.

Sensitivity analysis

The test for overall effect for all sensitivity analyses failed to reach statistical significance.

Monthly rate of reoffending

Both the RISE JPP Experiment and the RISE JPS Experiment recorded recidivism as a post‐intervention monthly rate of offending. Data from these two studies were combined in a separate meta‐analysis (Analysis 1.2).

The pooled estimate using a random‐effects model was ‐0.06 (SMD) (95% CI ‐0.28 to 0.16; P = 0.61), that is, no statistically significant difference was detected in favour of the intervention. The I2 statistic indicates 0% of the variation in the point estimates is due to heterogeneity.

Sensitivity analysis

Only two of the sensitivity analyses were performed for this outcome. Data for this outcome were re‐analysed without adjusting for a cluster effect and using a fixed‐effect model. The test for overall effect still failed to reach statistical significance. No data were imputed for this outcome, negating the need for sensitivity analyses with alternative imputations.

Post‐intervention rates of offending as measured by self‐report

No data for this outcome were available to be included in a meta‐analysis.

Young person's sense of remorse

Only the RISE JPP Experiment and the RISE JPS Experiment looked at the impact of intervention on the young person’s sense of remorse following the intervention. The pooled estimate using a random‐effects model was 1.73 (OR) (95% CI 0.97 to 3.10; P = 0.06), that is, no significant difference was detected in favour of the intervention. The I2 statistic indicates 13% of the variation in the point estimates is due to heterogeneity (Analysis 8.1).

Sensitivity analysis

The test for overall effect for all sensitivity analyses failed to reach statistical significance.

Young person's recognition of wrongdoing

Only the RISE JPP Experiment and the RISE JPS Experiment looked at the impact of intervention on the young person's recognition of wrongdoing following the intervention. The pooled estimate using a random‐effects model was 1.97 (OR) (95% CI 0.81 to 4.80; P = 0.14), that is, no significant difference was detected in favour of the intervention (Analysis 14.1). The I2 statistic indicates 59% of the variation in the point estimates is due to heterogeneity.

Sensitivity analysis

Only the sensitivity analysis that reanalysed data using a fixed‐effect model reached statistical significance (OR 1.88, 95% CI 1.08 to 3.27; P = 0.03) (Analysis 19.1). The I2 statistic indicates 59% of the variation in the point estimates is due to heterogeneity. The Chi2 statistic failed to reach significance (Chi2 = 2.43 on 1 degrees of freedom, P = 0.12).

Young person's self‐perception

Only the RISE JPP Experiment and the RISE JPS Experiment looked at the impact of intervention on the young person's self perception following the intervention. The pooled estimate using a random‐effects model was 0.95 (OR) (95% CI 0.55 to 1.63; P = 0.85), that is, no significant difference was detected in favour of the intervention (Analysis 20.1). The I2 statistic indicates 0% of the variation in the point estimates is due to heterogeneity.

Sensitivity analysis

The test for overall effect for all sensitivity analyses failed to reach significance.

Characteristics of the post‐intervention offence

No data for this outcome were available to be included in a meta‐analysis.

Young person's satisfaction with overall process

Two of the included studies measured the number of young people who, after the intervention had taken placed, said that, overall, they were satisfied with the process (Bethlehem Experiment; Indianapolis Experiment). However, the pooled estimate using a random‐effects model was 0.42 (OR) (95% CI 0.04 to 4.07; P 0.45), that is, no significant difference was detected in favour of the intervention (Analysis 26.1). The I2 statistic indicates 88% of the variation in the point estimates is due to heterogeneity.

Sensitivity analysis

One of the sensitivity analyses reached statistical significance, when the missing participants were assumed to have experienced the positive outcome (OR 0.16, 95% CI 0.05 to 0.55; P = 0.003) (Analysis 29.1). The I2 statistic indicates 0% of the variation in the point estimates is due to heterogeneity.

Victim/key stakeholder satisfaction with overall process

Two of the included studies measured the number of victims who, after the intervention had taken placed, said that, overall, they were satisfied with the process (Bethlehem Experiment; Indianapolis Experiment). However, the pooled estimate using a random‐effects model was 4.05 (OR) (95% CI 0.56 to 29.04; P = 0.16), that is, no statistically significant difference was detected in favour of the intervention (Analysis 33.1). The I2 statistic indicates 88% of the variation in the point estimates is due to heterogeneity.

Sensitivity analysis

Two of the sensitivity analyses reached statistical significance. The first (Analysis 36.1), when the "decline" group was removed from the experimental group in the Bethlehem Experiment (OR 6.24, 95% CI 2.28 to 17.11; P = 0.0004). The I2 statistic indicates 49% of the variation in the point estimates is due to heterogeneity.

The second of the sensitivity analyses to reach statistical significance was when the data were reanalysed using a fixed‐effect model (OR 2.89, 95% CI 1.71 to 4.89; P < 0.0001) (Analysis 37.1). The I2 statistic indicates 88% of the variation in the point estimates is due to heterogeneity. The Chi2 statistic reached statistical significance (Chi2 = 8.16 on 1 degrees of freedom, P = 0.004). The large amount of heterogeneity indicated by results strongly suggests that the results from the original random‐effects model is more appropriate.

Change in social circumstances

No data for this outcome were available to be included in a meta‐analysis.

Adherence to conference plan

The Bethlehem Experiment was the only study to refer to offender's adherence to the conference plan, stating that 94% of the offenders complied with the terms of the agreement.

Discussion

Summary of main results

Overall, this review did not find reliable evidence that the use of restorative justice conferencing is more effective for young offenders than the use of normal court processing. Across all the meta‐analyses conducted on the recidivism outcomes, no significant main effects were identified.

Young person's sense of remorse, recognition of wrongdoing and their self‐perception failed to change significantly, except in one sensitivity analysis in which participants' 'recognition of wrongdoing' was analysed using a fixed‐effect model. Results indicated that participants in the experimental group were significantly more likely to recognise that their offence was wrong than participants in the control group. Yet analyses also indicate that 59% of the variation in point estimates may be attributed to heterogeneity. While the source of the heterogeneity cannot be concretely determined, due to the insufficient number of studies for subgroup analyses, it is possible that it may be attributed to the variation in participant characteristics, considering it could not be attributed to variations in the intervention, as both were part of the same RISE intervention (RISE JPP Experiment; RISE JPS Experiment). Overall, considering this potential heterogeneity, it is likely that reliance on the original results of the random‐effects model may be advisable.

For the meta‐analyses conducted on participants' satisfaction with the overall process, no result reached statistical significance, with the exception of one sensitivity analysis, where the results were analysed and data were imputed for the missing participants assuming that they experienced the positive outcome (that is, that they were satisfied). However, the assumption that all missing participants were satisfied with the overall process is problematic. If true, it seems more likely that they would have been more willing to continue participation in the research. However, it is not possible conclusively to determine the reasons for the missing data and therefore, all results, regardless of the imputation procedure, must be interpreted with caution.

Results from the meta‐analyses conducted on the victims' satisfaction also failed to reach statistical significance, with the exception of one sensitivity analysis, where victims in the Bethlehem Experiment whose associated offenders had been assigned to the treatment group, but declined to participate (n = 32), were removed from the analyses, thus comparing victims whose offenders were part of the treatment group (n = 54) with the control group (n = 35). These results suggest that victims in the experimental group experienced greater satisfaction than those in the control group. There is an argument that it may be more appropriate to conduct this analysis in this way, as while the young offenders in the decline group where there by choice, victims in the decline group were not, and therefore their low levels of satisfaction are understandable. By not diluting the group of "experimental" victims with the inclusion of "decline" victims who had no experience of the conference, the results are perhaps more reflective of the real benefits that could be experienced by victims involved in restorative justice conferences. This is promising and could indicate the usefulness of these restorative justice conferences for victims.

Overall completeness and applicability of evidence

Due to the inclusion criteria of juveniles aged 7 to 21 years, it was necessary to exclude three potential studies which could have increased the power of this review, but would have made the results less applicable to a "young offender" population, as per the objective. Study authors were contacted requesting the data pertaining only to those aged 7 to 21, but the study authors were unable to provide this data. These studies were therefore excluded because, while their intervention was eligible, the participant characteristics were not eligible. It is likely that including these studies may have weakened results further. For example, had participants from the RISE drink‐driving experiment been included in the meta‐analyses, it is possible that the effect would have decreased further, as this study resulted in a small increase in offences after the intervention (Sherman 2000).

The offences for which participants were arrested were relatively consistent across the four included studies, with most participants presenting with either violent or property offences. This could raise questions over the applicability of results to more serious offences including drink driving, sexual offences and drug offences. The numbers of included studies in this review are small in number, with only four eligible interventions identified. Two of the four were located in United States, with the remaining two in Australia. Some could argue this may further limit the extent to which these results can be applied internationally, considering the differing social, political and economic contexts across countries.

A common reason for which studies were excluded from this review was that the victim‐offender mediation occurred separately to the meeting with the parent/guardian. These studies were excluded because a key component of a restorative justice conference was for the family of the offender to share in the responsibility. Overall, these studies failed to find a significant effect following the intervention on recidivism or relationships (Lane 2005; Brank 2008). Therefore, including these studies in this review may only have reduced the effects further.

In all four studies, young offenders were entered into the programme at police discretion. This could lead to a potential issue regarding the generalisability of these results, as it is difficult to ascertain the exact process behind these decisions made by the police in each location. This uncertainty regarding their consistency could lead to problems in replicating the exact procedure across contexts.

Quality of the evidence

The overall quality of the evidence is different to summarise. All studies were clear and explicit in their methods of random allocation, but were subject to bias across a number of other domains. For example, no study made reference to blinding participants in their study. Whilst this is understandable considering the difficulty in blinding a participant to a psychosocial intervention such as this, it does not remove the risk of bias. High attrition levels were evident across all studies, which leads to difficulty in making firm conclusions regarding whether those missing are missing at random or missing due to experiencing negative outcomes (for example, reoffending, or being dissatisfied with the overall process). One likely risk of bias across all studies is that of selection bias, not only from the participants who can only participate voluntarily, but also from the police officers making their initial recommendations to the study. Consequently, it is important to remain tentative when drawing conclusions from any of these studies.

Potential biases in the review process

We made every attempt to follow the protocol of this review when selecting outcomes from included studies to report. However, the possibility remains that the outcomes reported are a biased representation of those collected by the study authors, for example, when selecting questionnaire items that most closely reflect the outcome of participants' self‐concept. There is also potential bias in the review authors' decision to assume that missing participants are more likely to have experienced the negative outcome. Finally, the estimated intracluster correlation used in analysis may also be subject to bias. The review authors took statistical advice in selecting a method of analysis for the potential cluster adjustment, and the advice given by the statistician was to use an estimated average ICC of 0.5 to re‐analyse the trial data and obtain approximate correct analyses. Although based on the sound statistical advice, the possibility cannot be ruled out that use of this 0.5 figure was biased.

Agreements and disagreements with other studies or reviews

Previous published reports of restorative justice conferences suggested that, descriptively, the interventions appear to be effective. Yet closer inspection of the statistical results published in the original studies that were included in this systematic review reveal that many of the results initially fail to reach statistical significance, and combining data from these studies has failed to identify any significant effect for reducing recidivism.

All of the outcomes of interest to this review were originally reported in the Indianapolis Experiment, the RISE JPP Experiment, and the RISE JPS Experiment and also failed to reach significance in those studies. However, the Bethlehem Experiment presented results separately for violent and property offenders, and indicated that while property offenders demonstrated a "negligible" difference, violent offenders who were conferenced were significantly less likely to offend than those who were unable to be conferenced (P < 0.05). This raises the possibility that the intervention is more effective for violent offenders than other offenders. However, it was not possible to explore this statistically in this review, as neither of the other two eligible studies in this review included participants charged with violent offences.

There are few systematic reviews of restorative justice conferencing completed which would be adequately homogeneous with which to compare the results of this review. Those that have been completed previously have either taken a broader focus than this current review, for example, including results concerning both adult and juvenile offenders (Miers 2001), or provided only a narrative review, and were therefore lacking in meta‐analytical results (Sherman 2007). The narrative accounts of these earlier reviews both indicated that restorative conferencing would appear to be effective in reducing recidivism and increasing the satisfaction of participants. However, without any objective statistical data, it is difficult to reliably compare the results of these earlier reviews with this current review.

Study flow diagram

Figures and Tables -
Figure 1

Study flow diagram

'Risk of bias' summary: review authors' judgements about each risk of bias item for each included study

Figures and Tables -
Figure 2

'Risk of bias' summary: review authors' judgements about each risk of bias item for each included study

'Risk of bias' graph: review authors' judgements about each risk of bias item presented as percentages across all included studies

Figures and Tables -
Figure 3

'Risk of bias' graph: review authors' judgements about each risk of bias item presented as percentages across all included studies

Comparison 1: Recidivism, Outcome 1: Number reoffending

Figures and Tables -
Analysis 1.1

Comparison 1: Recidivism, Outcome 1: Number reoffending

Comparison 1: Recidivism, Outcome 2: Post intervention monthly offending rate (any offence)

Figures and Tables -
Analysis 1.2

Comparison 1: Recidivism, Outcome 2: Post intervention monthly offending rate (any offence)

Comparison 2: Recidivism without cluster adjustment, Outcome 1: Number reoffending

Figures and Tables -
Analysis 2.1

Comparison 2: Recidivism without cluster adjustment, Outcome 1: Number reoffending

Comparison 2: Recidivism without cluster adjustment, Outcome 2: Post intervention monthly offending rate (any offence)

Figures and Tables -
Analysis 2.2

Comparison 2: Recidivism without cluster adjustment, Outcome 2: Post intervention monthly offending rate (any offence)

Comparison 3: Recidivism without imputed data or cluster adjustment, Outcome 1: Number reoffending

Figures and Tables -
Analysis 3.1

Comparison 3: Recidivism without imputed data or cluster adjustment, Outcome 1: Number reoffending

Comparison 4: Recidivism (imputing positive outcome), Outcome 1: Number reoffending

Figures and Tables -
Analysis 4.1

Comparison 4: Recidivism (imputing positive outcome), Outcome 1: Number reoffending

Comparison 5: Recidivism (imputing positive outcome) without cluster adjustment, Outcome 1: Number reoffending

Figures and Tables -
Analysis 5.1

Comparison 5: Recidivism (imputing positive outcome) without cluster adjustment, Outcome 1: Number reoffending

Comparison 6: Recidivism (without decline group), Outcome 1: Number reoffending

Figures and Tables -
Analysis 6.1

Comparison 6: Recidivism (without decline group), Outcome 1: Number reoffending

Comparison 7: Recidivism (fixed‐effect), Outcome 1: Number reoffending

Figures and Tables -
Analysis 7.1

Comparison 7: Recidivism (fixed‐effect), Outcome 1: Number reoffending

Comparison 7: Recidivism (fixed‐effect), Outcome 2: Post intervention monthly offending rate (any offence)

Figures and Tables -
Analysis 7.2

Comparison 7: Recidivism (fixed‐effect), Outcome 2: Post intervention monthly offending rate (any offence)

Comparison 8: Young person's sense of remorse, Outcome 1: Remorse

Figures and Tables -
Analysis 8.1

Comparison 8: Young person's sense of remorse, Outcome 1: Remorse

Comparison 9: Young person's sense of remorse without cluster adjustment, Outcome 1: Remorse

Figures and Tables -
Analysis 9.1

Comparison 9: Young person's sense of remorse without cluster adjustment, Outcome 1: Remorse

Comparison 10: Young person's sense of remorse without imputed data of cluster adjustment, Outcome 1: Remorse

Figures and Tables -
Analysis 10.1

Comparison 10: Young person's sense of remorse without imputed data of cluster adjustment, Outcome 1: Remorse

Comparison 11: Young person's sense of remorse (imputing positive outcome), Outcome 1: Remorse

Figures and Tables -
Analysis 11.1

Comparison 11: Young person's sense of remorse (imputing positive outcome), Outcome 1: Remorse

Comparison 12: Young person's sense of remorse (imputing positive outcome) without cluster adjustment), Outcome 1: Remorse

Figures and Tables -
Analysis 12.1

Comparison 12: Young person's sense of remorse (imputing positive outcome) without cluster adjustment), Outcome 1: Remorse

Comparison 13: Young person's sense of remorse (fixed‐effect), Outcome 1: Remorse

Figures and Tables -
Analysis 13.1

Comparison 13: Young person's sense of remorse (fixed‐effect), Outcome 1: Remorse

Comparison 14: Young person's recognition of wrongdoing, Outcome 1: Recognition of wrongdoing

Figures and Tables -
Analysis 14.1

Comparison 14: Young person's recognition of wrongdoing, Outcome 1: Recognition of wrongdoing

Comparison 15: Young person's recognition of wrongdoing without cluster adjustment, Outcome 1: Recognition of wrongdoing

Figures and Tables -
Analysis 15.1

Comparison 15: Young person's recognition of wrongdoing without cluster adjustment, Outcome 1: Recognition of wrongdoing

Comparison 16: Young person's recognition of wrongdoing without imputed data or cluster adjustment, Outcome 1: Recognition of wrongdoing

Figures and Tables -
Analysis 16.1

Comparison 16: Young person's recognition of wrongdoing without imputed data or cluster adjustment, Outcome 1: Recognition of wrongdoing

Comparison 17: Young person's recognition of wrongdoing (imputing positive outcome), Outcome 1: Recognition of wrongdoing

Figures and Tables -
Analysis 17.1

Comparison 17: Young person's recognition of wrongdoing (imputing positive outcome), Outcome 1: Recognition of wrongdoing

Comparison 18: Young person's recognition of wrongdoing (imputing positive outcome) without cluster adjustment, Outcome 1: Recognition of wrongdoing

Figures and Tables -
Analysis 18.1

Comparison 18: Young person's recognition of wrongdoing (imputing positive outcome) without cluster adjustment, Outcome 1: Recognition of wrongdoing

Comparison 19: Young person's recognition of wrongdoing (fixed‐effect), Outcome 1: Recognition of wrongdoing

Figures and Tables -
Analysis 19.1

Comparison 19: Young person's recognition of wrongdoing (fixed‐effect), Outcome 1: Recognition of wrongdoing

Comparison 20: Young person's self‐perception, Outcome 1: Self‐perception

Figures and Tables -
Analysis 20.1

Comparison 20: Young person's self‐perception, Outcome 1: Self‐perception

Comparison 21: Young person's self‐perception without cluster adjustment, Outcome 1: Self‐perception

Figures and Tables -
Analysis 21.1

Comparison 21: Young person's self‐perception without cluster adjustment, Outcome 1: Self‐perception

Comparison 22: Young person's self‐perception without imputed data or cluster adjustment, Outcome 1: Self‐perception

Figures and Tables -
Analysis 22.1

Comparison 22: Young person's self‐perception without imputed data or cluster adjustment, Outcome 1: Self‐perception

Comparison 23: Young person's self‐perception (imputing positive outcome), Outcome 1: Self‐perception

Figures and Tables -
Analysis 23.1

Comparison 23: Young person's self‐perception (imputing positive outcome), Outcome 1: Self‐perception

Comparison 24: Young person's self‐perception (imputing positive outcome) without cluster adjustment, Outcome 1: Self‐perception

Figures and Tables -
Analysis 24.1

Comparison 24: Young person's self‐perception (imputing positive outcome) without cluster adjustment, Outcome 1: Self‐perception

Comparison 25: Young person's self‐perception (fixed‐effect), Outcome 1: Self‐perception

Figures and Tables -
Analysis 25.1

Comparison 25: Young person's self‐perception (fixed‐effect), Outcome 1: Self‐perception

Comparison 26: Young person's satisfaction with overall process, Outcome 1: Young offender satisfaction

Figures and Tables -
Analysis 26.1

Comparison 26: Young person's satisfaction with overall process, Outcome 1: Young offender satisfaction

Comparison 27: Young person's satisfaction without cluster adjustment, Outcome 1: Young offender satisfaction

Figures and Tables -
Analysis 27.1

Comparison 27: Young person's satisfaction without cluster adjustment, Outcome 1: Young offender satisfaction

Comparison 28: Young person's satisfaction without imputed data or cluster adjustment, Outcome 1: Young offender satisfaction

Figures and Tables -
Analysis 28.1

Comparison 28: Young person's satisfaction without imputed data or cluster adjustment, Outcome 1: Young offender satisfaction

Comparison 29: Young person's satisfaction (imputing positive outcome), Outcome 1: Young offender satisfaction

Figures and Tables -
Analysis 29.1

Comparison 29: Young person's satisfaction (imputing positive outcome), Outcome 1: Young offender satisfaction

Comparison 30: Young person's satisfaction (imputing positive outcome) without cluster adjustment, Outcome 1: Young offender satisfaction

Figures and Tables -
Analysis 30.1

Comparison 30: Young person's satisfaction (imputing positive outcome) without cluster adjustment, Outcome 1: Young offender satisfaction

Comparison 31: Young person's satisfaction (without decline group), Outcome 1: Young offender satisfaction

Figures and Tables -
Analysis 31.1

Comparison 31: Young person's satisfaction (without decline group), Outcome 1: Young offender satisfaction

Comparison 32: Young person's satisfaction (fixed‐effect), Outcome 1: Young offender satisfaction

Figures and Tables -
Analysis 32.1

Comparison 32: Young person's satisfaction (fixed‐effect), Outcome 1: Young offender satisfaction

Comparison 33: Victim/key stakeholder satisfaction with overall process, Outcome 1: Victim/key stakeholder satisfaction with overall process

Figures and Tables -
Analysis 33.1

Comparison 33: Victim/key stakeholder satisfaction with overall process, Outcome 1: Victim/key stakeholder satisfaction with overall process

Comparison 34: Victim/key stakeholder satisfaction without imputed data, Outcome 1: Victim/key stakeholder satisfaction with overall process

Figures and Tables -
Analysis 34.1

Comparison 34: Victim/key stakeholder satisfaction without imputed data, Outcome 1: Victim/key stakeholder satisfaction with overall process

Comparison 35: Victim/key stakeholder satisfaction (imputing positive outcome), Outcome 1: Victim/key stakeholder satisfaction with overall process

Figures and Tables -
Analysis 35.1

Comparison 35: Victim/key stakeholder satisfaction (imputing positive outcome), Outcome 1: Victim/key stakeholder satisfaction with overall process

Comparison 36: Victim/key stakeholder satisfaction (without decline group), Outcome 1: Victim/key stakeholder satisfaction with overall process

Figures and Tables -
Analysis 36.1

Comparison 36: Victim/key stakeholder satisfaction (without decline group), Outcome 1: Victim/key stakeholder satisfaction with overall process

Comparison 37: Victim/key stakeholder satisfaction (fixed‐effect), Outcome 1: Victim/key stakeholder satisfaction with overall process

Figures and Tables -
Analysis 37.1

Comparison 37: Victim/key stakeholder satisfaction (fixed‐effect), Outcome 1: Victim/key stakeholder satisfaction with overall process

Summary of findings 1. Restorative justice conferencing for reducing recidivism in young offenders (aged 7 to 21 years)

Restorative justice conferencing for reducing recidivism in young offenders

Patient or population: Offenders aged 7 to 21 years
Settings: Youth justice
Intervention: Restorative justice conference

Outcomes

Illustrative comparative risks* (95% CI)

Relative effect
(95% CI)

No of Participants
(studies)

Quality of the evidence
(GRADE)

Comments

Assumed risk

Corresponding risk

Control

Restorative justice conference

Number reoffending
administrative data
Follow‐up: 1 year

Study population

OR 1
(0.59 to 1.71)

1029
(2 studies)

⊕⊝⊝⊝
very low1,2,3

518 per 1000

518 per 1000
(388 to 648)

Moderate

482 per 1000

482 per 1000
(354 to 614)

Post‐intervention monthly offending rate (any offence)
administrative data
Follow‐up: 1 year

The mean post‐intervention monthly offending rate (any offence) ranged across control groups from
0.065 to 0.067

The mean post‐intervention monthly offending rate (any offence) in the intervention groups was
0.06 standard deviations lower
(0.28 lower to 0.16 higher)

321
(2 studies)

⊕⊕⊝⊝
low1,3

SMD ‐0.06 (‐0.28 to 0.16)

Remorse
participant interviews
Follow‐up: 1 year

Study population

OR 1.73
(0.97 to 3.1)

217
(2 studies)

⊕⊝⊝⊝
very low1,3,4

452 per 1000

588 per 1000
(445 to 719)

Moderate

448 per 1000

584 per 1000
(440 to 716)

Recognition of wrongdoing
participant interviews
Follow‐up: mean 7 years

Study population

OR 1.97
(0.81 to 4.8)

217
(2 studies)

⊕⊝⊝⊝
very low1,3,5,6

548 per 1000

705 per 1000
(495 to 853)

Moderate

539 per 1000

697 per 1000
(486 to 849)

Self‐perception
participant interviews
Follow‐up: 1 year

Study population

OR 0.95
(0.55 to 1.63)

217
(2 studies)

⊕⊝⊝⊝
very low1,3,7

478 per 1000

465 per 1000
(335 to 599)

Moderate

467 per 1000

454 per 1000
(325 to 588)

Young offender satisfaction
participant interviews
Follow‐up: 12 to 24 months

Study population

OR 0.42
(0.05 to 3.81)

467
(2 studies)

⊕⊝⊝⊝
very low1,3,8

836 per 1000

682 per 1000
(203 to 951)

Moderate

791 per 1000

614 per 1000
(159 to 935)

Victim/key stakeholder satisfaction with overall process
participant interviews
Follow‐up: 12 to 24 months

Study population

OR 4.03
(0.59 to 27.75)

428
(2 studies)

⊕⊝⊝⊝
very low1,3,9

690 per 1000

900 per 1000
(568 to 984)

Moderate

640 per 1000

878 per 1000
(512 to 980)

*The basis for the assumed risk (e.g. the median control group risk across studies) is provided in footnotes. The corresponding risk (and its 95% confidence interval) is based on the assumed risk in the comparison group and the relative effect of the intervention (and its 95% CI).
CI: Confidence interval; OR: Odds ratio

GRADE Working Group grades of evidence
High quality: Further research is very unlikely to change our confidence in the estimate of effect
Moderate quality: Further research is likely to have an important impact on our confidence in the estimate of effect and may change the estimate
Low quality: Further research is very likely to have an important impact on our confidence in the estimate of effect and is likely to change the estimate
Very low quality: We are very uncertain about the estimate

1 Random allocation procedures were adequate. However, the risk of bias due to absence of blinding procedures and self‐selection was high
2 Heterogeneity indicated by the I2 statistic (70%), although no significant detection was indicated (P = 0.07)
3 Only two included studies make it difficult to ascertain the likelihood of publication bias
4 Review authors' choice of item to use as measure of remorse is somewhat subjective
5 Review authors' choice of item to use as measure of recognition of wrongdoing is somewhat subjective
6 There is moderate heterogeneity according to the I2 statistic (59%), but this is not supported by the statistical significance (P = 0.12)
7 Review authors' choice of item to use as measure of self‐perception is somewhat subjective
8 There is moderate heterogeneity according to the I2 statistic (87%), but this is not supported by the statistical significance (P = 0.44)
9 There is moderate heterogeneity according to the I2 statistic (87%), but this is not supported by the statistical significance (P = 0.16)

Figures and Tables -
Summary of findings 1. Restorative justice conferencing for reducing recidivism in young offenders (aged 7 to 21 years)
Table 1. Additional methods for future updates

Issue

Method

Objectives

If future updates identify studies with sufficient information, we will address the second objective of this review, viz: To explore process and implementation issues in relation to programme effects on recidivism and improving participants' self‐concept.

Outcomes

Attention must be paid to recidivism rates that reflect crimes committed prior to the intervention, but for which judicial proceedings have only begun after the intervention. Care will be taken to ensure that these rates are not falsely reflected as post‐intervention offending.

Cluster‐randomised trials

If insufficient information is available to control for clustering, we will enter data into RevMan using individuals as the unit of analyses. We will then perform sensitivity analyses to assess the potential bias that may occur as a result of the inadequately controlled clustered trials. We would also perform sensitivity analyses if the ICCs had been obtained from external sources.

Studies with multiple intervention groups

 

If two or more interventions groups are compared to an eligible control group, the intervention group that most closely follows the previously outlined definition of a restorative justice conference will be included in the meta‐analysis. The decisions made during this process will be clearly outlined in the review. Some studies may also include more than one control group, who undergo different yet equally eligible forms of "management as usual". In this situation, the control groups will be combined to create a single pair‐wise comparison. If this strategy poses a problem for investigation of heterogeneity, each group would be compared separately as part of a subgroup analyses. The sample size for the shared comparator group will be split accordingly for subgroup analyses to prevent the same comparator participants being included twice (Higgins 2011).

Dealing with missing data

Data that are missing at random (due, for example, to postal disruptions) can be ignored as the reasons are unlikely to be related to the outcomes of the missing data. In this case, we will analyse data using an available case analysis.

Where continuous data are missing, we will impute data using a 'last observation carried forward' approach. Where cases are missing from the first outcome measure, sample means values will be imputed.

Assessment of heterogeneity

Future updates will describe the clinical and methodological heterogeneity of the included studies, as done in this review. If unexpected variability arises, it will be discussed in full.

Assessment of reporting biases

When sufficient studies are available for inclusion in this review, we will assess publication and other reporting biases through the use of visual inspection of funnel plots along with trim and fill analyses.

Subgroup analysis and investigation of heterogeneity

If the number of included studies is sufficient, subgroup analyses will be used to examine:

  • the differential effects of interventions by the severity of the offence, specifically whether those with more serious offences respond differently to the conferences than those with more minor offences;

  • the differential effects of interventions by the gender of the young person who has committed the offence;

  • the differential effects of interventions by the presence of the personal victim versus the presence of a victim representative or no victim at the conference; and

  • the differential effects of interventions by diversionary versus court‐ordered conferences.

Sensitivity analysis

We will perform sensitivity analysis to assess whether the findings of this review are robust to the decisions made in the process of obtaining them. When the data permit, we will perform sensitivity analysis by reanalysis, excluding studies according to study quality issues, including those with low sample size, high risk of bias, or high attrition and dropout rate, and whether randomisation occurred pre‐charge, post‐charge but pre‐sentencing, or post‐sentencing, and before or after agreement to participate in the study.

Figures and Tables -
Table 1. Additional methods for future updates
Comparison 1. Recidivism

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

1.1 Number reoffending Show forest plot

2

1029

Odds Ratio (IV, Random, 95% CI)

1.00 [0.59, 1.71]

1.2 Post intervention monthly offending rate (any offence) Show forest plot

2

321

Std. Mean Difference (IV, Random, 95% CI)

‐0.06 [‐0.28, 0.16]

Figures and Tables -
Comparison 1. Recidivism
Comparison 2. Recidivism without cluster adjustment

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

2.1 Number reoffending Show forest plot

2

1074

Odds Ratio (IV, Random, 95% CI)

1.01 [0.59, 1.73]

2.2 Post intervention monthly offending rate (any offence) Show forest plot

2

373

Std. Mean Difference (IV, Random, 95% CI)

‐0.05 [‐0.26, 0.15]

Figures and Tables -
Comparison 2. Recidivism without cluster adjustment
Comparison 3. Recidivism without imputed data or cluster adjustment

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

3.1 Number reoffending Show forest plot

2

1004

Odds Ratio (IV, Random, 95% CI)

1.06 [0.55, 2.07]

Figures and Tables -
Comparison 3. Recidivism without imputed data or cluster adjustment
Comparison 4. Recidivism (imputing positive outcome)

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

4.1 Number reoffending Show forest plot

2

1029

Odds Ratio (IV, Random, 95% CI)

1.01 [0.56, 1.80]

Figures and Tables -
Comparison 4. Recidivism (imputing positive outcome)
Comparison 5. Recidivism (imputing positive outcome) without cluster adjustment

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

5.1 Number reoffending Show forest plot

2

1074

Odds Ratio (IV, Random, 95% CI)

1.03 [0.56, 1.89]

Figures and Tables -
Comparison 5. Recidivism (imputing positive outcome) without cluster adjustment
Comparison 6. Recidivism (without decline group)

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

6.1 Number reoffending Show forest plot

2

937

Odds Ratio (IV, Random, 95% CI)

0.81 [0.63, 1.05]

Figures and Tables -
Comparison 6. Recidivism (without decline group)
Comparison 7. Recidivism (fixed‐effect)

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

7.1 Number reoffending Show forest plot

2

1029

Odds Ratio (IV, Fixed, 95% CI)

0.90 [0.70, 1.15]

7.2 Post intervention monthly offending rate (any offence) Show forest plot

2

321

Std. Mean Difference (IV, Fixed, 95% CI)

‐0.06 [‐0.28, 0.16]

Figures and Tables -
Comparison 7. Recidivism (fixed‐effect)
Comparison 8. Young person's sense of remorse

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

8.1 Remorse Show forest plot

2

217

Odds Ratio (IV, Random, 95% CI)

1.73 [0.97, 3.10]

Figures and Tables -
Comparison 8. Young person's sense of remorse
Comparison 9. Young person's sense of remorse without cluster adjustment

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

9.1 Remorse Show forest plot

2

250

Odds Ratio (IV, Random, 95% CI)

1.69 [0.98, 2.93]

Figures and Tables -
Comparison 9. Young person's sense of remorse without cluster adjustment
Comparison 10. Young person's sense of remorse without imputed data of cluster adjustment

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

10.1 Remorse Show forest plot

2

186

Odds Ratio (IV, Random, 95% CI)

1.72 [0.91, 3.24]

Figures and Tables -
Comparison 10. Young person's sense of remorse without imputed data of cluster adjustment
Comparison 11. Young person's sense of remorse (imputing positive outcome)

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

11.1 Remorse Show forest plot

2

217

Odds Ratio (IV, Random, 95% CI)

1.56 [0.81, 2.98]

Figures and Tables -
Comparison 11. Young person's sense of remorse (imputing positive outcome)
Comparison 12. Young person's sense of remorse (imputing positive outcome) without cluster adjustment)

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

12.1 Remorse Show forest plot

2

250

Odds Ratio (IV, Random, 95% CI)

0.97 [0.41, 2.32]

Figures and Tables -
Comparison 12. Young person's sense of remorse (imputing positive outcome) without cluster adjustment)
Comparison 13. Young person's sense of remorse (fixed‐effect)

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

13.1 Remorse Show forest plot

2

217

Odds Ratio (IV, Fixed, 95% CI)

1.72 [1.00, 2.95]

Figures and Tables -
Comparison 13. Young person's sense of remorse (fixed‐effect)
Comparison 14. Young person's recognition of wrongdoing

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

14.1 Recognition of wrongdoing Show forest plot

2

217

Odds Ratio (IV, Random, 95% CI)

1.97 [0.81, 4.80]

Figures and Tables -
Comparison 14. Young person's recognition of wrongdoing
Comparison 15. Young person's recognition of wrongdoing without cluster adjustment

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

15.1 Recognition of wrongdoing Show forest plot

2

250

Odds Ratio (IV, Random, 95% CI)

1.85 [0.77, 4.47]

Figures and Tables -
Comparison 15. Young person's recognition of wrongdoing without cluster adjustment
Comparison 16. Young person's recognition of wrongdoing without imputed data or cluster adjustment

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

16.1 Recognition of wrongdoing Show forest plot

2

186

Odds Ratio (IV, Random, 95% CI)

2.15 [0.87, 5.35]

Figures and Tables -
Comparison 16. Young person's recognition of wrongdoing without imputed data or cluster adjustment
Comparison 17. Young person's recognition of wrongdoing (imputing positive outcome)

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

17.1 Recognition of wrongdoing Show forest plot

2

217

Odds Ratio (IV, Random, 95% CI)

1.92 [0.82, 4.52]

Figures and Tables -
Comparison 17. Young person's recognition of wrongdoing (imputing positive outcome)
Comparison 18. Young person's recognition of wrongdoing (imputing positive outcome) without cluster adjustment

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

18.1 Recognition of wrongdoing Show forest plot

2

250

Odds Ratio (IV, Random, 95% CI)

1.85 [0.85, 4.05]

Figures and Tables -
Comparison 18. Young person's recognition of wrongdoing (imputing positive outcome) without cluster adjustment
Comparison 19. Young person's recognition of wrongdoing (fixed‐effect)

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

19.1 Recognition of wrongdoing Show forest plot

2

217

Odds Ratio (IV, Fixed, 95% CI)

1.87 [1.06, 3.28]

Figures and Tables -
Comparison 19. Young person's recognition of wrongdoing (fixed‐effect)
Comparison 20. Young person's self‐perception

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

20.1 Self‐perception Show forest plot

2

217

Odds Ratio (IV, Random, 95% CI)

0.95 [0.55, 1.63]

Figures and Tables -
Comparison 20. Young person's self‐perception
Comparison 21. Young person's self‐perception without cluster adjustment

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

21.1 Self‐perception Show forest plot

2

250

Odds Ratio (IV, Random, 95% CI)

0.94 [0.57, 1.55]

Figures and Tables -
Comparison 21. Young person's self‐perception without cluster adjustment
Comparison 22. Young person's self‐perception without imputed data or cluster adjustment

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

22.1 Self‐perception Show forest plot

2

186

Odds Ratio (IV, Random, 95% CI)

1.25 [0.65, 2.39]

Figures and Tables -
Comparison 22. Young person's self‐perception without imputed data or cluster adjustment
Comparison 23. Young person's self‐perception (imputing positive outcome)

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

23.1 Self‐perception Show forest plot

2

217

Odds Ratio (IV, Random, 95% CI)

1.32 [0.68, 2.55]

Figures and Tables -
Comparison 23. Young person's self‐perception (imputing positive outcome)
Comparison 24. Young person's self‐perception (imputing positive outcome) without cluster adjustment

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

24.1 Self‐perception Show forest plot

2

250

Odds Ratio (IV, Random, 95% CI)

1.34 [0.73, 2.49]

Figures and Tables -
Comparison 24. Young person's self‐perception (imputing positive outcome) without cluster adjustment
Comparison 25. Young person's self‐perception (fixed‐effect)

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

25.1 Self‐perception Show forest plot

2

217

Odds Ratio (IV, Fixed, 95% CI)

0.95 [0.55, 1.63]

Figures and Tables -
Comparison 25. Young person's self‐perception (fixed‐effect)
Comparison 26. Young person's satisfaction with overall process

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

26.1 Young offender satisfaction Show forest plot

2

467

Odds Ratio (IV, Random, 95% CI)

0.42 [0.05, 3.81]

Figures and Tables -
Comparison 26. Young person's satisfaction with overall process
Comparison 27. Young person's satisfaction without cluster adjustment

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

27.1 Young offender satisfaction Show forest plot

2

503

Odds Ratio (IV, Random, 95% CI)

0.42 [0.05, 3.81]

Figures and Tables -
Comparison 27. Young person's satisfaction without cluster adjustment
Comparison 28. Young person's satisfaction without imputed data or cluster adjustment

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

28.1 Young offender satisfaction Show forest plot

2

425

Odds Ratio (IV, Random, 95% CI)

0.25 [0.06, 1.08]

Figures and Tables -
Comparison 28. Young person's satisfaction without imputed data or cluster adjustment
Comparison 29. Young person's satisfaction (imputing positive outcome)

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

29.1 Young offender satisfaction Show forest plot

2

467

Odds Ratio (IV, Random, 95% CI)

0.16 [0.05, 0.55]

Figures and Tables -
Comparison 29. Young person's satisfaction (imputing positive outcome)
Comparison 30. Young person's satisfaction (imputing positive outcome) without cluster adjustment

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

30.1 Young offender satisfaction Show forest plot

2

503

Odds Ratio (IV, Random, 95% CI)

0.24 [0.06, 0.96]

Figures and Tables -
Comparison 30. Young person's satisfaction (imputing positive outcome) without cluster adjustment
Comparison 31. Young person's satisfaction (without decline group)

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

31.1 Young offender satisfaction Show forest plot

2

408

Odds Ratio (IV, Random, 95% CI)

0.63 [0.03, 13.49]

Figures and Tables -
Comparison 31. Young person's satisfaction (without decline group)
Comparison 32. Young person's satisfaction (fixed‐effect)

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

32.1 Young offender satisfaction Show forest plot

2

467

Odds Ratio (IV, Fixed, 95% CI)

0.85 [0.49, 1.49]

Figures and Tables -
Comparison 32. Young person's satisfaction (fixed‐effect)
Comparison 33. Victim/key stakeholder satisfaction with overall process

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

33.1 Victim/key stakeholder satisfaction with overall process Show forest plot

2

428

Odds Ratio (IV, Random, 95% CI)

4.03 [0.59, 27.75]

Figures and Tables -
Comparison 33. Victim/key stakeholder satisfaction with overall process
Comparison 34. Victim/key stakeholder satisfaction without imputed data

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

34.1 Victim/key stakeholder satisfaction with overall process Show forest plot

2

369

Odds Ratio (IV, Random, 95% CI)

4.33 [0.66, 28.43]

Figures and Tables -
Comparison 34. Victim/key stakeholder satisfaction without imputed data
Comparison 35. Victim/key stakeholder satisfaction (imputing positive outcome)

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

35.1 Victim/key stakeholder satisfaction with overall process Show forest plot

2

428

Odds Ratio (IV, Random, 95% CI)

3.95 [0.50, 30.90]

Figures and Tables -
Comparison 35. Victim/key stakeholder satisfaction (imputing positive outcome)
Comparison 36. Victim/key stakeholder satisfaction (without decline group)

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

36.1 Victim/key stakeholder satisfaction with overall process Show forest plot

2

370

Odds Ratio (IV, Random, 95% CI)

6.22 [2.31, 16.74]

Figures and Tables -
Comparison 36. Victim/key stakeholder satisfaction (without decline group)
Comparison 37. Victim/key stakeholder satisfaction (fixed‐effect)

Outcome or subgroup title

No. of studies

No. of participants

Statistical method

Effect size

37.1 Victim/key stakeholder satisfaction with overall process Show forest plot

2

428

Odds Ratio (IV, Fixed, 95% CI)

2.45 [1.39, 4.30]

Figures and Tables -
Comparison 37. Victim/key stakeholder satisfaction (fixed‐effect)