Audit
Overview
At PAT we take the assurance and trust of our
clients seriously. We seek to assure, as far as is practical, that
Project Managers are using the PM Scorecard™
tool as intended and are not abusing the integrity of the tool through
various forms of misuse of the process. Therefore auditing the PM
Scorecard results is an important part of our mission. Our audits are
not meant to ascertain the veracity of those being surveyed and will not
necessarily call into question the scores of the respondents. They are
meant to validate that those participants entered into the PAT system
and surveyed as part of creating a PM Scorecard, did indeed participate
in the surveys and were in fact, in the role for which they were
surveyed.
Audits
PAT practices 3 levels of audit.
Level 1 - an internal system of flagging
certain potentially suspicious behavior. In order to keep ideas for
“gaming the system” contained, we choose not to share the criteria for
flagged behavior. However, once flagged by our system, a review of the
project will be carried out, and a level 2 audit considered.
Level 2 – This audit is done on randomly
selected projects, both within organizational subscriptions and among
single user licenses and subscriptions. A level 2 audit consists of an
auditor from PAT contacting at least 5 people from those surveyed by the
project and asking them several brief questions about their role and
participation in the audit. We have designed our audit process to be
quick and easy for those asked to participate. Audit calls should take
no more than 5 minutes.
Level 3 – A level 3 audit will only be used in the
event that the information in the level 2 audit cannot be verified. A
level 3 audit will consist of validating each person named in the PM
Scorecard set up as well as requesting at written documentation from the
project in question.
What Prompts an audit?
§
Data
and behavior which causes a flag in our system may prompt an audit,
after an internal review.
§ Failure
on the part of an auditor to satisfactorily validate project
participants will prompt a level 3 audit.
§ Otherwise
projects are chosen for audit randomly.
How are audit reports returned ? – if
your project is audited we will send an email to the project contact and
the project administrator (if there is one) which shows the audit
status, with a brief explanation of the audit process. We classify
our audits as Validated, Generally Validated or Not Validated -
depending on the number of questionnaire answers that were validated
across the respondents.