Research and Evaluation 2017


Recent Projects

Summary of Impact Research New Zealand Ltd Projects 2017


Brainwave Trust Aotearoa - 2017

Impact Research NZ was commissioned by Brainwave Trust Aotearoa to review their existing documents and evaluate the effectiveness of their programmes and seminars for those attending. The aim of the project was to develop and pilot a Results Based Accountability (RBA) framework and tools to measure their activities from the perspectives of key stakeholders and to provide baseline data. Training in RBA was provided to Brainwave staff and a RBA manual was developed to enable.

Brainwave in the future to evaluate the effectiveness of their activities. Brainwave Trust Aotearoa is a charitable trust that aims to raise public awareness around healthy brain development in babies, young children and adolescents. They deliver seminars and programmes based on robust scientific research to a variety of organisations and individuals who have an interest in ensuring the safety and wellbeing of young New Zealanders.

The project involved seven key areas for investigation:

  • The views of staff and Educators were sought via an online survey on how effective the organisation is in achieving its aims and objectives, the quality of presentation and programme development and delivery as well as areas for improvement.
  • Brainwave School’s programme asked secondary school students via an online survey and student focus group about the effectiveness of the programme. Staff members were asked via an online survey about the alignment with the school curriculum and areas for improvement.
  • Brainwave School’s programme (Health Achievement Standard) – students were asked via an online survey about how well the programme contributed to them achieving their Health Achievement Standard.
  • Canterbury Vulnerable Families Initiative programme was designed for families living in low socio-economic areas affected by the Canterbury earthquakes. Selected parents and caregivers were invited to share their experiences of attending seminars via a focus group and online survey. Professionals from referring agencies such as CYF, police and Plunket via an online survey were invited to share their views on the effectiveness of the seminar for those who they referred.
  • The views of groups and organisations who book Brainwave presentations were asked via an online survey if their needs and expectations were met by the presentations.
  • The views of Brainwave Trustees were asked via an online survey whether the organisation was on track to achieve its vision and mission, as well as adhering to the principles of its strategic direction and the effectiveness of the programmes.
  • Key stakeholders (e.g. NGOs, professionals working with vulnerable children and adolescents) were asked via an online survey about their engagement with Brainwave and how well the presentations were received by those attending and areas for improvement.

An overall synthesis report was provided to Brainwave which highlighted key findings that will be used to inform their strategic direction and utilisation of the newly created RBA framework.

Habitat For Humanity Auckland - 2017

Impact Research NZ was commissioned by Habitat for Humanity Auckland to undertake a social impact research project to inform their future direction. A Results Based Accountability (RBA) framework was developed and implemented. Two RBA workshops were held with senior management with the aim to increase the awareness of the RBA framework and how it can be utilised by Habitat for Humanity Auckland to improve its service outcomes leading to impact. A RBA manual was also provided to Habitat for Humanity Auckland to enable them to evaluate their future programmes and activities.

Habitat for Humanity Auckland offer programmes to help low-income earners in their living situations, providing them with services to maintain and repair their homes, and assistance towards home ownership.

The project involved four key areas under investigation: The status of their current programmes, perceptions of the current rental housing market, views on a potential new programme and the current funding landscape. Data was gathered via the following methods.

  • Habitat for Humanity Auckland “A Brush with Kindness” (ABWK) and “Critical Home Repairs” (CHR) programmes. The views of clients were sought via telephone interviews about their experiences of the programmes as well as areas for improvement. The view of the ABWK programme manager was also sought via a face-to-face interview about the effectiveness of
  • the programmes and potential future direction.
  • Rotary Club members were asked via an online survey and property managers via a telephone survey about their perceptions of the current rental housing market and a proposed new programme being developed by the organisation.
  • Selected Habitat for Humanity Auckland tenants shared their experiences of renting via a focus group.
  • Representatives from philanthropic trusts, local and national government were asked via face-to-face interviews about their perceptions of the current funding landscape and a proposed new programme being developed by the organisation.

An overall report provided a high level synthesis of the key findings to inform the future direction of Habitat for Humanity Auckland and its programmes. RBA workshops ensured buy-in from senior managers who are responsible for implementing RBA with their teams.

Enliven Home-Based Support service RBA refresh - 2017

Impact Research NZ was commissioned by Presbyterian Support Northern to conduct a refresh of its current RBA framework for the Enliven Home-Based Support service. The purpose of this project was to evaluate the perspectives’ of key stakeholder groups to inform the development and utilisation of a new RBA framework for future use.

Enliven provides a range of home-based support services to clients who, as a result of aging or disability, are unable to carry out day to day tasks around the home. The focus of the service is to assist clients to remain healthy, maximise their independence and engage with their community. Clients are supported to achieve their own goals, receive help with personal care and household tasks.

Data was collected from the following groups: Representatives from the Ministry of Health, Home and Community Health Association, DHBs that Enliven contracts to, Enliven clients, staff and management.

  • A document review was used to inform questions for interviews and surveys with key stakeholder groups.
  • A selected group of Enliven clients were surveyed via telephone interviews about their experiences of receiving the Enliven service and suggestions for improvement.
  • Key contacts from DHBs who contract Enliven, the Ministry of Health and Home and Community Health Association and were sought via face-to-face interviews about the Enliven service and reporting requirements.
  • The Enliven Quality Committee were surveyed via a focus group to gain their insights into current data collection practices, suggestions for additional data collection and potential changes to service delivery in response to changing client needs.
  • New client satisfaction surveys were designed and piloted in telephone interviews with a selection of Enliven Home-based support clients.

The results from all key stakeholder groups were used to inform the development and utilisation of a newly created RBA framework for ongoing use.

Enliven Bay of Plenty Home - Based Support Establishment with the Disabilities Resource Centre - 2017

Impact Research NZ was commissioned by Presbyterian Support Northern (PSN) to design and develop a Results Based Accountability framework for future evaluation in response to the partnership of Enliven Bay of Plenty (BOP) with the Disability Resource Centre (DRC).

The perspectives of all key stakeholder groups were gathered through a series of interviews and focus groups to inform the RBA framework and toolkit.

Data was collected from the following groups: Representatives from the Ministry of Health, Home and Community Health Association, DHBs that Enliven contracts to, Enliven clients, staff and management and DRC staff and management.

  • Key contacts from the Ministry of Health and the Bay of Plenty DHB were surveyed via face-to-face interviews about the Enliven service and reporting requirements.
  • The Enliven Quality Committee were surveyed via a focus group to gain their insights into current data collection practices, suggestions for additional data collection and potential changes to service delivery in response to changing client needs.
  • A focus group was conducted with DRC staff and a face-to-face interview is to be conducted with a key contact from the DRC.
  • Survey instruments were designed and delivered via online surveys with Enliven and DRC staff.

The results from all key stakeholder groups were used to inform the development and utilisation of a newly created RBA framework and toolkit for ongoing use by Enliven BOP and DRC.

Lifeline RBA Evaluation - 2017

Impact Research NZ was commissioned by Presbyterian Support Northern (PSN) to review their existing documents and processes and to pilot and establish a RBA framework for the 24/7 and Suicide Crisis (Tautoko) helplines.

The main areas of interest were: The quality factors of a helpline and the indicators of the service that were helpful to callers.

  • Data was collected via a document review.
  • A RBA framework and workshop was held with the CEO of PSN and Lifeline’s Executive Director.
  • Focus groups with Lifeline staff and volunteers in Auckland and Christchurch were conducted to gain their perspectives around current data collection practices and suggestions for future data collection.
  • A face-to-face interview was conducted with a member of Lifeline’s management for additional context.
  • Survey instruments were piloted to evaluate the effectiveness of the 24/7 and Suicide Crisis Helpline (Tautoko) from the perspectives of callers.

An overall report provided a high level synthesis of key findings from all stakeholder groups to inform the future direction of Lifeline, its processes and services for callers. The newly created RBA framework and toolkit enabled Lifeline to conduct future evaluations of the 24/7 and Suicide Crisis (Tautoko) helplines from the perspectives’ of callers.

A Women’s Refuge Trust - 2017

Impact Research NZ was commissioned by the Trust to review their existing documents and develop and trial a new RBA framework for the ongoing evaluation of the support that it provides and to inform the Trust’s future strategic direction.

The Trust provides support to women and their children who have previously or are currently experiencing the effects of family violence. Activities include the provision of residential or community-based support, advocacy and advice, education, safety plans and community-based awareness of the effects and prevention of domestic violence.

  • Data was collected via a document review.
  • RBA surveys were developed and piloted with:
    • Six current and past community outreach and refuge clients to elicit their opinions and experiences of the support received from the Trust and suggestions for potential service improvements.
    • Four members of Trust staff to gain their understanding of their role and opinions of the effectiveness of the Trust for women and children that they support.
    • Six members of the Board of Trustees for their opinions regarding the effectiveness of the support that the Trust provides.
    • Twenty-three key contacts from agencies and community organisations that have involvement with the Trust to gain an understanding of their satisfaction with their organisation’s relationship with the Trust and potential service improvements.

The results from all key stakeholder groups and workshops with Trust staff were used to inform the development and utilisation of a newly created RBA framework for ongoing use. A RBA manual was prepared and provided to KTAT to enable them to evaluate their services and programmes in the future.

SHINE in School programme - 2017

Impact Research NZ was commissioned by Shine, a division of Presbyterian Support Northern (PSN) to review their existing documents and evaluation processes as well as to develop and trial a new RBA framework and to undertake an evaluation of their SHINE in School programme.

The SHINE in School programme is currently delivered to students in years nine to 13 in a total of 14 secondary schools and youth alternative education providers in the Auckland region by a team of three educators. Presentations may be held during school assemblies and students are also able to engage in workshops which provide them with information aimed at increasing their understanding around healthy relationship and the effects of family violence. Student leaders are supported to organise community-based events aimed at raising awareness among a wider audience and act as advocates for peers experiencing family violence.

  • Data was collected via a document review.
  • Three online RBA surveys were developed and trialled with:
    • Twenty-seven students who had participated in the SHINE in School programme to gain their experiences of the programme and suggestions for potential programme improvements.
    • Three school staff who had been involved with the SHINE in School programme to gain their opinions if its effectiveness for students in their school.
    • Four key contacts of community groups that had been involved with SHINE in School programme events to gain their opinions of the relevance and effectiveness of events for raising public awareness of community-based support services
  • Face-to-face interviews were conducted with three members of Shine management and two educators to gain their opinions of the effectiveness of the SHINE in School programme and the processes currently utilised to deliver and evaluate the programme.
  • A face-to-face interview was conducted with a member of PSN management for additional context.

An overall report provided a high level synthesis of key findings from all stakeholder groups to inform the future direction and processes of the SHINE in School programme. The newly created RBA framework and RBA manual was prepared and provided to Shine to enable the SHINE in School programme to be evaluated in the future. An RBA workshop was conducted with nominated Shine staff members to further inform them of the processes involved in conducting RBA evaluations.


Our People
At Impact Research NZ we believe that our people are our most valuable assets. With researchers and Research Associates who are leaders in their fields, our combined experience and expertise encompasses a broad range of social sector interests.
Read more


Our Research and Evaluation
Research and evaluation are now seen as essential elements in the provision of the social services, and provide the means of measuring outcomes for clients, and informing service improvement.

Read more


Contact Us
Impact Research NZ
PO Box 9591 Newmarket
Auckland 1149
Phone: +64 027 612 4335
Email: This email address is being protected from spambots. You need JavaScript enabled to view it.
Read more