Assuring VAGO's quality
The quality of our reports is assessed
through internal and external quality assurance reviews and
feedback from Parliament and audited agencies.
External assessment of reports
Each year VAGO has a selection of its Performance Audit reports
assessed by three independent, professional reviewers. In 2011–12
this was expanded to include a selection of Financial Audit
reports. The process and criteria are coordinated through the
Australasian Council of Auditors-General. The criteria that the
reports are assessed against are:
- scope and potential for significant
impact
- focus on effectiveness, efficiency,
economy (Performance Audit reports only)
- focus on key issues (Financial Audit reports only)
- persuasiveness of conclusions
- communication – printed report
- communication – online report
- usefulness to the customer.
An overall score is calculated based on
the average score for each criterion. In 2011–12 the overall score
for performance audit reports was 83 per cent. This is on par with
results in previous years of 80 per cent (2010–11), 81 per cent
(2009–10) and 79 per cent (2008–09). VAGO uses this average as a
performance measure with a target of 80 per cent.
Please click for
more information.
Client and Parliamentarian surveys
VAGO’s client survey program provides agencies with the
opportunity to give feedback on the process, reporting and value of
the audit they were involved in shortly after its completion.
Parliamentarians are surveyed annually on the usefulness of VAGO
reports and their level of satisfaction with our services.
We use the information from these surveys to:
- identify and address issues arising out of
individual audits
- monitor trends and common
themes
- trigger improvement projects and
strategies
- monitor the effectiveness of current
improvement projects.
Who is surveyed?
Parliamentarians
All Victorian
Parliamentarians are invited to complete a survey. The
questionnaire is comprehensive and seeks feedback on Financial
Audit reports, Performance Audit reports and the Parliamentarians’
dealings with VAGO throughout the year.
Financial audit
All agencies audited by VAGO are surveyed as soon as possible after
the completion of their audit (agencies in their final year or
agency subsidiaries that have the same audit contact and auditor as
their parent agency are not audited).
Performance audit
When a report is tabled, agencies that were involved in the audit
are invited to participate in a survey. The survey contact is
usually the most senior executive with direct line responsibility
for the area audited.
The survey process
VAGO has engaged an independent research company, ORIMA
Research, to conduct the surveys and collate the results. This
allows for impartial data collection and interviewing. Participants
may elect to keep their feedback confidential, which means that
VAGO does not see their completed questionnaire (or individual
score) but the qualitative feedback is consolidated together at the
end of financial year.
2011–12 survey results
Audited agencies
Feedback is sought on three areas – the audit process, audit
reporting and the value of the audit. An overall score is
calculated based on the average of the three areas.
Financial audit
In 2011–12 the average score for financial audit was 77.9 out of a
possible 100. This was an improvement on the result of 76.7 in
2010–11.
|
|
Process
|
Reporting
|
Value
|
Overall
|
|
2011–12
|
80.7
|
79.5
|
73.6
|
77.9
|
|
2010–11
|
79.5
|
78.0
|
72.7
|
76.7
|
|
2009–10
|
76.8
|
76.4
|
73.2
|
75.5
|
Please click here for more
information
Performance audit
In 2011–12 the average score for performance audit was 71.0 out of
100. This was an improvement on the result of 66.6 in 2010–11.
|
|
Process
|
Reporting
|
Value
|
Overall
|
|
2011–12
|
74.2
|
70.0
|
68.9
|
71.0
|
|
2010–11
|
68.1
|
66.9
|
64.9
|
66.6
|
|
2009–10
|
70.3
|
67.5
|
67.8
|
68.5
|
Please click for more
information.
Parliamentarians
Overall, 93 per cent of Parliamentarians are satisfied or
very satisfied with the Auditor-General’s reports and services.
This is a decrease on 98 per cent in 2010–11 but on par with 92 per
cent in 2008–09 and 2009–10. Please
click for more information.
Please send any questions or feedback to surveys@audit.vic.gov.au.