AbaAiCheck
Get Started
Guide Clinical Advisors, BCBAs & Clinical Leaders

Clinical Advisory & AI Rule Calibration Guide

How clinical leaders shape the AI, report rule discrepancies, track team CPT compliance and verify human-in-the-loop governance.

Zero-PHI reportsHuman-in-the-loopTeam quality trackingAdvisor badge

Zero-PHI redaction protocol

No PHI in Calibration Reports

Reports carry only a de-identified note fragment and your expected behavior. Replace client names, dates of birth, IDs and other identifiers with placeholders such as [CLIENT] before you submit.

Automatic Redaction Backstop

As a second safeguard, common identifiers are redacted automatically when a report is saved, and the report shows how many were removed. It does not replace your own review.

Team metrics are shared with an advisor only by team members who opt in, and they never include note text.

Human-in-the-Loop AI Governance

AbaAiCheck combines AI with expert clinical oversight. Clinical Advisors (BCBAs and clinical leaders) review how the AI applies CPT and documentation rules, report discrepancies, and our AI team evaluates every report before any rule changes.

Advisors report

A clinician flags a finding the AI got wrong or missed.

AI team reviews

Each report is reviewed and accepted, implemented or declined.

Rules improve

Accepted reports change how the AI behaves for every user.

Status is visible

Advisors follow each report from New to Implemented in AI rules.

Impact Calibration Status

The advisor dashboard summarizes your contribution.

Acceptance Rate

Accepted or implemented reports out of those already resolved.

Reports Submitted

Total reports, with the number from the last 30 days.

Pending Review

Reports that are new or in review.

Accepted & Implemented

Reports confirmed by the AI team, and those that changed how the AI behaves.

Notes Validated

Notes you reviewed, with the last-30-day count.

Feedback by Category

False positives, missed issues, incorrect rewrites, CPT rules, terminology, hallucinations and medical necessity.

Step-by-Step: The Rule Calibration Engine

Submit a rule adjustment directly to the AI team.

  1. 1

    Step 1

    Categorize the discrepancy

    • Choose a Discrepancy Category: false positive, missed issue, incorrect rewrite, CPT rule misapplied (97151 / 97153 / 97155 / 97156), ABA terminology, invented data (hallucination), medical necessity logic or other.
    • Set the Clinical severity: Low, Medium or High.
  2. 2

    Step 2

    Describe the expected behavior

    • In Expected Clinical Behavior, explain what the AI should do (for example, the prompt-fading details a 97155 note must document).
    • Paste the relevant Note Fragment, already de-identified. You can also start a report from a row of your Clinical Validation Log, which links it to that review.
  3. 3

    Step 3

    Confirm the zero-PHI safeguard

    • Replace names, dates and IDs with placeholders such as [CLIENT] and [DATE]. Automatic redaction runs as a backstop when the report is saved.

    Never include client-identifying information in a calibration report.

  4. 4

    Step 4

    Submit and track

    • Click Submit calibration report and follow it in My reports: New → In review → Accepted → Implemented in AI rules (or Not accepted, with the AI team’s note).

Clinical Validation Log

Your review history in one table.

  • Each row shows the date, CPT code, client label, compliance score and the findings (errors and warnings) of a review.
  • Filter by result and use Report discrepancy on any row to open a calibration report linked to that review.

Measuring Team Quality Impact

Advisors who invite colleagues can follow how documentation quality evolves.

  • The quality trend chart shows the average note score of your team week by week, with the change from the first week to the latest.
  • Only team members who choose to share their audit metrics are included, and only scores and findings are shared, never note text.

Clinical Advisory Board Recognition

  • Advisors receive a Clinical Advisor (SME) digital badge with their name and credential.
  • Use Download Badge PNG or Share to LinkedIn (copy the suggested text and open LinkedIn) to showcase your contribution. Never include client information in posts.

Help shape clinical AI for ABA

The Advisory Workspace is available to members of the Clinical Advisory Board.

Explore Advisory Workspace →Apply for Clinical Advisory Board

Advisors contribute clinical expertise; final rule changes are decided and implemented by the AbaAiCheck team. Use fictional or de-identified notes when evaluating the platform.