Review of MLA's Monitoring and Evaluation Systems

Summary

Beginning in 13/14 a series of projects were initiated to streamline MLA's monitoring and evaluation processes within the Extension Team, test run a new process and determine what changes in the internal MLA contracting, reporting and data management processes are needed in order to make best use of the framework and the data provided.

Through project E.PPR.1403 - Monitoring and evaluation tools  a Monitoring and Evaluation Contracting and Reporting Guide (MLA M&E Guide) was developed. Two programs were identified to be used as pilots and additional projects / activities were identified to test against the recommended MLA M&E Guide and determine how best this could be implemented and embedded in the MLA monitoring, evaluation and reporting culture. The two pilots covered:

• Producer Demonstration Sites – focussing on producer involvement and participatory R&D processes
• EDGEnetwork® – focussing on skill development in farm management and business.

The project assessed the effectiveness of the newly developed process as well as its practicality and 'fit for purpose' within MLA. During the project the MLA team members undertook internal reviews of the Aims, Outcomes and Systems of the two pilots, including canvassing views of key stakeholders, managers and personnel. The QualDATA and MLA team also reviewed key internal MLA systems which might need adjustment including backend systems such as legal, finance, milestone approvals, computer programs to enable effective implementation of the MER system. Further, it assisted in the planning process for the next phase of implementation across MLA which will see the process fully operationalized.

Following on from the above project, B.PPR.1501 - MLA evaluation framework development: Phase Three was contracted. The purpose of this project was for QualDATA, to complete the pilot testing of the 'Monitoring and Evaluation (M&E) Framework' and an accompanying MLA M&E Guide. There may be scope to apply this process more widely across MLA with expansion to R&D projects and greater alignment of metrics across MLA including to higher level MLA wide frameworks. Phase Three concluded the piloting of the EDGEnetwork® and the PDS project systems. A range of systems, metrics, processes and requirements were developed and a template developed for further review.

The key findings of the project were:

• There was strong support both internally in MLA and externally amongst key partners and collaborators (agencies and private sector) to continue implementing an impact reporting culture and systems within MLA. The basic structure to do so is now in place – based on the work with the two pilot projects – and provides the necessary building blocks and momentum for change.
• A range of tasks are required to continue implementing an impact reporting system.
• There appears to be strong momentum, which if capitalised on, can support implementation of an impact reporting system.