The State of Victoria invests around $39 million each year in the work of VAGO, providing assurance over the performance of the public sector, which is entrusted with over $60 billion to spend each year. The investment in VAGO results in a range of products and activities that drive improvement across the public sector, including reports on the results of performance audits and financial audits.
These reports are a resource not just for the specific agencies they examine, but all public sector agencies as well as citizens who are seeking assurance about the performance of this public sector. VAGO's reports offer insights into wide-ranging issues and challenges facing public sector agencies. Often they make suggestions for change aimed at helping the public sector maximise its effectiveness, efficiency and economy.
While an individual audit is focused on specific agencies, the findings and recommendations can be used by other agencies to improve their own performance. Our reports include both opportunities for improvement and examples of better practice. Agencies benefit from keeping a watching brief on all the reports coming out of VAGO, even those which examine different sectors or types of activities. I call this the 'ripple effect', as I hope to see a report having influence outside its specific scope.
To support the ripple effect, over the past five years VAGO has analysed recent reports to identify themes across the audit findings where several agencies have been found to have the same challenges or shortcomings in approach.
People in different roles throughout an agency can use these themes in different ways. Management can use them to guide their work, as a checklist of things to address when developing and implementing programs and projects. Boards and audit committees can use them as starting points for lines of inquiry of management, to seek assurance that these risks are being managed and that controls are in place to address them. Internal audit can use the themes to inform their own annual program of audits, and conduct audits on some or all of the themes.
Agencies seeking to address such issues can draw on extensive guidelines and better practice guidance produced by various organisations, including Victoria's central agencies.
This publication contains themes arising from the audits tabled since the start of my term as Auditor-General in July 2013 to October 2014. This covers 48 reports with over 400 recommendations.
Looking forward, I will be monitoring the themes arising from my reports more closely. There is value in tracking the recurring issues in my audits, and providing additional commentary. This work can reveal useful insights, such as emerging trends that the public sector needs to closely monitor, or areas where a recurring issue has been addressed across the sector and the corresponding lessons to be learned from it. It will also help Parliament know whether the public sector is being accountable and addressing findings.
I am therefore introducing a rolling, three-year report examining themes from our audits. This will extend our previous practice, adding the year's themes to previous years. Once matured, this report will reveal emerging trends while monitoring previous years' themes and whether the public sector agencies are addressing them. I expect to table the first report in early 2015–16.
This will tie in well with another new VAGO product, my follow-up of performance audit recommendations. This report will contain agency acquittal of performance audit recommendations made by VAGO, and our analysis and commentary on these acquittals. Categorising these recommendations by the themes will enable us to see whether themes are being addressed through specific agency actions.
Over the coming months, VAGO will be consulting key stakeholders in the public sector to help develop this new approach to the themes, and the first report. We value your input and are interested in your ideas. Get in contact if you want to be involved in this project—see contact details on the back page.
Today's government is complex and interconnected, and citizens expect high levels of accountability as well as coordinated service delivery across agencies. However, shortcomings in governance accounted for the highest number of findings in our recent reports.
Our audits sometimes found that governance structures had gaps, accountable bodies did not fulfil their roles, systems underpinning governance were inadequate, and there was often a lack of leadership and oversight. Decision-makers regularly did not receive the information required, and in some cases, there were no arrangements in place to brief government regularly or at key decision points including crises, such as cyber-threats.
A joined-up activity is where a range of agencies bring together their particular skills to address a common policy goal. Such governance designs are an appropriate approach to complex and interconnected issues. Our audits found instances where this worked well, and agencies had designed joined-up governance successfully.
However, these approaches are highly sensitive to governance weaknesses, of which our audits found many. Some activities are nominally joined up, but are not managed as such—with no plan or overarching strategy. This can result in significant additional risks for taxpayers.
A key recurring issue was lead agencies falling short of their leadership and oversight responsibilities—failing to provide clear guidance or any guidance at all, and in some cases failing to step in when required.
There was also a lack of clarity around roles and responsibilities—including clear points of accountability. There were several examples where an agency or position was named as the point of accountability and, therefore, responsible overall for an activity, but they did not have the corresponding legal or structural requirements to support this.
Operating Water Infrastructure Using Public Private
Partnerships (August 2013)
WoVG Information Security Management Framework (November 2013)
Implementation of the Government Risk Management Framework (November 2013)
Management and Oversight of the Caulfield Racecourse Reserve (September 2014)
Strategy and planning is about working out a way to achieve something you want to do, and then determining the detailed approach to do this. Agencies struggled, however, with various aspects of strategy and planning, which undermines all subsequent activity.
In some cases, agencies simply did not develop a strategy or plan for something that required an evidence-based, coherent approach. Agencies failed to develop plans for things like demand management, risk management, implementation and business continuity. Longer-term strategic plans were also absent or poorly coordinated.
Encouragingly, other audits found good examples of strategic and operational planning, which demonstrated management's grasp on their areas of responsibility.
Plans and strategies that did exist often missed key elements—such as objectives or targets—or when they did exist, these elements did not meet appropriate standards.
Clinical ICT Systems in the Victorian Public Health Sector
Accessibility of Mainstream Services for Aboriginal Victorians (May 2014)
Managing Consultants and Contractors (June 2014)
Using ICT to Improve Traffic Management (June 2014)
The Auditor-General and Deputy Auditor-General leaving Parliament.
Good performance measurement is a fundamental aspect of management. In the public sector, demonstrating performance is critical as it is used to account for the use of taxpayers' money, determine the outcomes achieved, drive improvement and inform internal and external stakeholders. However, audits found this measurement was an area of weakness.
Poor performance measurement across government means that we don't fully understand the effect of a wide range of services and activities. At a fundamental level, entire sectors had poor performance measurement frameworks.
The reasons behind this lack of awareness and understanding were diverse. Agencies:
There were some examples, nonetheless, of improvements in performance measurement.
Performance Reporting Systems in Education
Prevention and Management of Drug Use in Prisons (October 2013)
Tourism Strategies (December 2013)
Managing Victoria's Native Forest Timber Resources (December 2013)
Quality data that is used well is an important part of performance management. Performance measurement frameworks can be undermined by poor data. Data collection and management was an area of recurring weaknesses across audits.
Agencies were not always collecting information that was useful, sufficient or consistently gathered. Information was often poor quality, inaccurate or out of date, and sometimes agencies failed to test the reliability of the data.
There was often a lack of information transfer or sharing, especially in programs involving multiple agencies. This led to poor understanding of the data and its trends.
Agencies did not always use data well, and failed to generate intelligence and trend information. They did not always feed it back into the system to improve performance. A lack of baseline information made it impossible to measure changes.
Some agencies did use the data they collected well, to inform themselves and improve their own practices.
Prisoner Transportation (June 2014)
Effectiveness of Catchment Management Authorities (September 2014)
Managing Emergency Services Volunteers (February 2014)
Asset Management and Maintenance by Councils (February 2014)
Effective workforce management is vital to any organisation achieving its objectives. Having people with the right skills and experience is just as important as good governance, planning and performance measurement. However, issues with staffing and capabilities was a recurring theme in our audits.
Our audits sometimes found that staff lack necessary skills to fulfil their roles. Staff don't always receive the training and development required, meaning organisations lack the skills they need to manage significant projects and programs. Further, organisations don't always know what skills and capabilities they need their staff to have.
Unsuitable or poor quality staffing models in some areas of the public sector are undermining effectiveness in important areas, especially around service delivery. Having a sustainable workforce, and having the right people available at the right time, are crucial.
Access to Services for Migrants, Refugees and Asylum
Seekers (May 2014)
Managing Emergency Services Volunteers (February 2014)
Apprenticeship and Traineeship Completion (March 2014)
Recreational Maritime Safety (June 2014)
Financial management underpins planning, implementation and evaluation of activities. Good financial management shouldn't be taken for granted, and requires investment. Issues with financial management have been a trend in recent audits.
This year, for the first time ever, the Auditor-General qualified the state's financial statements, because he disagreed with the appropriateness and application of an accounting policy, which resulted in a significant write down of taxpayer investments in school buildings. The state was unable to provide sufficient appropriate audit evidence to fully support its approach.
More broadly, accounting practices can have real impacts on programs. Audits revealed poor reporting and record keeping in relation to entities' finances and budgets.
A frequent finding related to the financial sustainability of entities. Financial challenges, including liquidity, repaying debt, and asset maintenance, meant many entities were classified as high risk. Additional government funding or letters of comfort were often required.
Encouragingly, some agencies demonstrated good financial management, and improved their financial situation as a result.
Public Hospitals: Results of the 2012–13 Audits (November 2013)
Technical and Further Education Institutes: Results of the 2013 Audits (August 2014)
Oversight and Accountability of Committees of Management (February 2014)
Residential Care Services for Children (March 2014)
When management knows that there are problems in their areas of responsibility, they should do something. However, recent audits show that agencies are failing to act in response to known risks and recommendations. This imperils the achievement of desired outcomes and value for money of government services.
Management should establish procedures to identify, evaluate and address risks. However, agencies did not always adequately inform themselves of risks and often failed to manage them appropriately. Interagency and statewide risks were particularly poorly managed.
A key challenge facing many agencies is financial risks associated with increasing demand and budget pressure. VAGO, nonetheless, found examples of good practice.
Agencies have information about performance from their own intelligence, including performance measurement data and staff observations. This information highlights risks, problems and opportunities, and one of the reasons it is collected is to enable management to respond to any issues. However, audits found that agencies are not responding to these known issues, often without any clear reason why. The consequences of this can be significant.
The state invests millions of dollars each year into bodies including VAGO that provide recommendations for improvement. However, many of our recent audits found that agencies had done little in response. As such, VAGO is introducing a regular follow up of agency actions on recommendations. The first report is due in February 2015.
Asset Confiscation Scheme (September 2013)
Asset Management and Maintenance by Councils (February 2014)
Public Sector Performance Measurement and Reporting (October 2014)
Heatwave Management: Reducing the Risk to Public Health (October 2014)
VAGO's executive structure has changed to reflect the priorities of the new Auditor-General.
Peter Frost's role is now Chief Executive Officer and Deputy Auditor-General. This reflects increased responsibilities, including assumption of full responsibilities of the sworn Acting Auditor-General in the absence of the Auditor-General.
Two new Assistant Auditor-General positions were created, with new groups:
The Governance, Legal and Strategy group was renamed from Policy and Coordination Directorate, and its responsibilities expanded to include planning, strategy, media, and enhanced community engagement and outreach. Marco Bini's role was redefined as Executive Director, Governance Legal and Strategy.
We have reformed our decision-making processes, establishing three new internal committees to review, scrutinise and enhance the quality and rigour of our work:
The Auditor-General has established an Independent Advisory Group to hear more broadly the perspectives, concerns and ideas of those external to VAGO and for these to be reflected in the strategic plan currently in development and in the audit work plan going forward.
Members are drawn from across the Victorian public, not-for-profit and private sectors and have been invited to participate on the basis of their experience and knowledge in one or more areas.
Craig Burke has substantial financial expertise with over 30 years in public sector accounting, risk management and auditing.
Craig became the Assistant Auditor-General, Financial Audit, in November 2014, having been a Sector Director at VAGO across several portfolios.
Matthew joined the Auditor-General's Office in April 2014.
Prior to joining VAGO, Matthew was a director at PwC responsible for overseeing the implementation of assurance methodologies and technologies, including addressing the impact of changes to guidance and standards, designing and delivering technical and professional training and overseeing inspection and review activities.
Karen joined the Auditor-General's Office in April 2014.
Prior to joining VAGO, Karen was a director at PwC specialising in systems assurance, internal controls, internal audit and business continuity management.
From left: Marco Bini, Craig Burke, Natalia Southern, Peter Frost, Nancy Stefanovski, Karen Phillips, Matthew Zappulla.