Assuring VAGO's quality

The quality of our reports is assessed through internal and external quality assurance reviews and feedback from Parliament and audit clients.

EXTERNAL ASSESSMENT OF REPORTS

Each year VAGO has a selection of its Performance Audit reports assessed by three independent, professional reviewers. The process and criteria are coordinated through the Australasian Council of Auditors-General. The criteria that the reports are assessed against are:

  • scope and potential for significant impact
  • focus on effectiveness, efficiency, economy
  • persuasiveness of conclusions
  • communication – printed report
  • communication – online report
  • usefulness to Parliament.

An overall score is calculated based on the average score for each criterion. VAGO uses the average of the overall scores for the reports assessed as a performance measure with a target of 80 per cent. In 2010–11 the overall score was 80 per cent. This is on par with results in previous years of 81 per cent (2009–10) and 79 per cent (2008–09). 
Please click for more information.

PARLIAMENTARIAN AND AUDIT CLIENT SURVEYS

Parliamentarians are surveyed on the usefulness of VAGO reports and their level of satisfaction with VAGO services. VAGO’s audit client survey program provides the opportunity for feedback on the process, reporting and value of the audit they were involved in and its outcomes.

The information from these surveys is used by VAGO to:

  • identify and address issues arising out of individual audits
  • monitor trends and common themes
  • trigger improvement projects and strategies as well as monitor the effectiveness of current improvement projects.

To collect this feedback, Parliamentarians are surveyed annually while audit clients are surveyed shortly after the audit has been completed.

Who is surveyed?

Parliamentarians
All Victorian Parliamentarians are invited to complete a survey. The questionnaire is comprehensive and seeks feedback on Financial Audit reports, Performance Audit reports and the Parliamentarians' dealings with VAGO throughout the year.

Financial audit
Audit clients are surveyed as close as possible to the completion of their audit.

Performance audit
When a report is tabled, those involved in the audit are invited to participate in a survey. The survey contact is usually the most senior executive with direct line responsibility for the area audited.

The survey process

VAGO has engaged an accredited independent research company to conduct the surveys and to collate the results. This allows for impartial data collection and interviewing. Participants may elect to keep their feedback confidential, which means that VAGO does not see their completed questionnaire (or individual score) but the qualitative feedback is consolidated at the end of financial year.

2010–11 survey results

Parliamentarians
Overall, 98 per cent of Parliamentarian respondents are satisfied or very satisfied with the Auditor-General’s reports and services. This is an increase from 92 per cent in 2008–09 and 2009–10. Please click for more information.

Audit clients
Feedback is sought on three areas – audit process, audit reporting and the value of the audit. An overall score is calculated based on the average of the three areas.

Financial audit
In 2010–11 the average score for financial audit was 76.7 out of a possible 100. This is an increase on the result in 2009–10 of 75.5.

  Process   Reporting   Value  Overall
 2010–11  79.5 78.0  72.7  76.7
 2009–10  76.8 76.4   73.2   75.5
         


 

 

Please click for more information.

Performance audit
In 2010–11 the average score for performance audit was 66.6 out of 100. This is slightly lower than the result in 2009–10 of 68.5.

  Process   Reporting   Value  Overall
 2010–11 68.1 66.9 64.9 66.6
 2009–10 70.3   67.5 67.8 68.5
         


 

 

Please click for more information.

Please send any questions or feedback to surveys@audit.vic.gov.au.