Benchmark report
Download
1 / 55

BENCHMARK REPORT - PowerPoint PPT Presentation


  • 102 Views
  • Uploaded on

BENCHMARK REPORT. Agenda. Beginner Level Basics Introduction Generating reports Interpreting reports Beginner to Intermediate Level Details Other report options General tips Resources.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' BENCHMARK REPORT' - vandana-kartik


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

Agenda
Agenda

  • Beginner Level Basics

    • Introduction

    • Generating reports

    • Interpreting reports

  • Beginner to Intermediate Level Details

    • Other report options

    • General tips

  • Resources

REMINDER: the information generated by this report is only as accurate as the data entered into the NCIR!



Benchmark
Benchmark:

A benchmark is a standard of excellence or achievement that similar things are compared to or measured against (in order to evaluate performance or level of quality).


Ncir benchmark report
NCIR Benchmark Report:

The NCIR benchmark report assesses the immunization records of a particular group of your clients and tells you HOW MANY, WHAT PERCENT, and WHICH of these clients have met and not met a particular “benchmark” for immunizations.


Key concept
Key concept:

  • Select a group of clients to assess.

  • Select the criteria for meeting the benchmark (BM).

  • The report determines which of these clients have met the benchmark criteria and which have not.

  • within any age or birth date range

selected clients

Up-to-date with: specific vaccine(s)

By: specific age (for childhood vaccines)

(

(

(

(

clients who have not met benchmark

clients who have met benchmark


Key concept1
Key concept:

  • Select a group of clients to assess.

  • Select the criteria for meeting the benchmark.

  • Report determines which of these clients have met the benchmark criteria and which have not.

  • within any age or birth date range

select clients

select benchmark criteria


Why generate a report
Why generate a report?

number and percent

  • To learn the number and ercent of clients up-to-date (UTD) with a particular vaccine or group of vaccines:

    • by a specific age (for childhood immunizations)

    • by the date the report was run

  • For a list of clients that indicates (for each selected vaccine) whether the client was/had:

    • UTD by benchmark age; late UTD; due (and if so, number of doses received); refused

list of clients


Why generate a report1
Why generate a report?

number & percent Info

list of clients


Generating reports

Beginner Level

Generating Reports


To open
To open:

  • Click “benchmark report” (on the left side of the NCIR screen, under the “reports” section)

    Note: Benchmark reports must be generated from an “Administrator” account.


Beginner reports

These are the main sections of concern for beginner level reports.

Beginner Reports

select clients

3

5

Select Evaluation Date

6

select benchmark criteria


Select group of clients to assess use only one of the three options
Select: group of clients to assess reports.(use only one of the three options)

3

  • The 1st/default option generates results that can be confusing.* Until comfortable with report, use another option.

  • Birth date range: If you have a specific birth date range, enter dates or select using calendar icon.

  • Age range: If you don’t need a specific birth date range, the age range option is simpler. Be sure to specify “days,” “weeks,” or “years” in the dropdown menus.

*For more info on this option, see the benchmark report manual.


Select evaluation date
Select: evaluation date reports.

5

  • Type/select the current date (the date that you are running the report). You must enter an evaluation date or the report will not run.

    • A date that is different from the report generated date can impact the results (designed for advanced level use).*

*For more information on evaluation dates, see the benchmark report manual.


Select benchmark criteria
Select: benchmark criteria reports.

6

  • The report will review the immunization status of each client to see if it meets this BM criteria that you selected.

Column: Vaccine

Rows: Age/Age Group

In cell: Number of doses required to meet BM


Select benchmark criteria1
Select: benchmark criteria reports.

6

  • Childhood benchmarks (BM): when you want to know if a group of clients are UTD with vaccines routinely given in childhood.

    • As childhood vaccine recommendations are based on age, the BM report includes age and immunization criteria. (Aka: to meet a childhood benchmark, clients must be UTD by a particular age)

Childhood benchmarks


Select benchmark criteria2
Select: benchmark criteria reports.

6

  • Adolescent/Adult Benchmark: when you want to know if a group of clients (within any age or birth date range, but usually clients over age 6) are UTD with vaccines routinely given in adolescence or adulthood.

    • There is no age criteria for these vaccines. Clients meet the benchmark if they were UTD when the report was generated.

Adolescent/Adultbenchmarks

  • Note: Both males and females will be assessed for HPV.


Select benchmark criteria3
Select: benchmark criteria reports.

6

  • You can select a full row: Click on the first cell of the row that you want to select. The row will become highlighted.

In this example: all assessed clients who are UTD with 4DTaP, 3HepB, 3Hib, 1MMR, 3Polio, 4Pnuemo, & 1Var by 24 months of age will meet this benchmark.


Select benchmark criteria4
Select: benchmark criteria reports.

6

  • You can select a single cell: Just click on it.

In this example: the report will determine which of the assessed clients were UTD with Hep B at 16 months.

  • You can select multiple cells within the same row, but you cannot select cells in more than one row.

In this example: clients UTD with 1Mening and 3 doses of HPV will meet BM


Select benchmark criteria5
Select: reports.benchmark criteria

6

  • To deselect: Just click on the cell and it will no longer be highlighted.

In this example: clients must have completed the 4:3:3:1:3:1 series by 24 months of age in order to meet the benchmark


To process

Click generate (only one time, reports.please) and then wait…

To process:


To view report

Report will take a few minutes to reports.complete. Click “refresh” occasionally to determine report status.

To view report:

  • When status is “DONE,” click on blue benchmark link to view report.


Interpreting report results

For beginner level reports reports.

Interpreting Report Results


Beginner reports1

So, this is the example criteria that was selected, and now we will look at the report that would be generated from this criteria.

Beginner Reports

Clients: age 24-36 months

3

3

5

Report run date: 1/9/13

6

6

Benchmark: UTD with 4:3:3:1:3:4:1 series by 24 months


Key sections of report
Key sections of report we will look at the report that would be generated from this criteria.

  • List of selected criteria for report (“filter conditions”)

  • Number & percent Information

  • List of clients

report criteria

number and percent Info

list of clients


Selected criteria for report
Selected criteria for report we will look at the report that would be generated from this criteria.

  • Each selection you made for the report is listed here

  • Tells you exactly what the report means

“Report generated” and “Evaluation” dates are the same

Selected Clients: 24-36 months of age

Selected benchmark immunizations” 4:3:3:1:3:1 by 24 months


Understanding report criteria
Understanding Report Criteria we will look at the report that would be generated from this criteria.

Clients:

Benchmark:

Clients:

Benchmark:


Number percent info
Number & percent info we will look at the report that would be generated from this criteria.

  • The primary outcome of the report.

  • Found on the last two lines of the “filter conditions” section.

  • The first number is the number of total clients that were assessed.

number and percent info


Understanding number and percent info
Understanding number and percent info: we will look at the report that would be generated from this criteria.

4 of 10 clients (40%) UTD by 24 months

5 of 10 clients (50%) UTD by the report generated date (the 4 who met the benchmark and 1 late)

  • Line 1: UTD with BM vaccines by BM age

  • Line 2: UTD with BM vaccines as of date report generated (includes clients on the first line plus those who were late UTD)

Misleading. Pretend this says: “Including late UTD”


For adolescent adult bm
For Adolescent/Adult BM: we will look at the report that would be generated from this criteria.

  • Adolescent/Adult benchmarks have no age criteria

  • Clients cannot be late UTD

  • The two number and percent lines are identical

5 of 12 clients UTD/ met all BM criteria

Clients cannot be late UTD. So, including late UTD clients, the same 5 of 12 (42%) met all BM criteria


Client list
Client list we will look at the report that would be generated from this criteria.

  • Lists clients who did not meet all benchmark criteria (Note: you can choose which clients are listed- discussed on following slides).

report criteria

Number and percent Info

.

List of Clients


Understanding the client list
Understanding the client list we will look at the report that would be generated from this criteria.

Met benchmark

  • Y : met all benchmark criteria for that vaccine

Column: Selected BM Vaccine

Parenthesis: number of doses required to be UTD)

Did not meet benchmark

  • N C: UTD (“completed”) vaccines, but late UTD

  • N # : Not UTD (and the # of doses received)

  • N : Not UTD (did not receive any doses of vaccine)


To view a specific record
To view a specific record: we will look at the report that would be generated from this criteria.

  • This list is an easy way to quickly review client names, addresses, and phone numbers and see if any are obviously missing or wrong (e.g. out of state).

  • You can view a specific client record by clicking on the link on the client’s last name.


Reviewing client information
Reviewing client information we will look at the report that would be generated from this criteria.

  • You can view client info but you cannot make changes.

  • When you close out of the screen you’re still able to view report.

Gender is coded as “U” (unknown).

Missing address

Client comments


Updating client information
Updating client information we will look at the report that would be generated from this criteria.

  • Please correct or update any info that is incorrect or missing (Note: Changes will not show up on a report until the next day).

    • Steps: copy the Client ID and use it to search for the client through “manage clients.” Make edits.


Saving exporting report
Saving/exporting report we will look at the report that would be generated from this criteria.

  • Be sure to save the report! Once you run the next report, any previously run report will disappear!

  • In order to save the report you must first export it as text or a spreadsheet or display it as a PDF

    • Filter conditions can only be saved and viewed in PDF format.

    • You can use a spreadsheet if you want to sort or further filter the client information.

*See user manual for details on why you want to export information and what you can do with it.


To re open a report
To re-open a report: we will look at the report that would be generated from this criteria.

  • Once you leave the BM screen you can still return to the last report that was generated.

  • Click on “check benchmark.”


Other options when generating the benchmark

Beginner to Intermediate Level we will look at the report that would be generated from this criteria.

Other options when generating the benchmark


Screen used to build report

Again, here is the screen where you can build the report. we will look at the report that would be generated from this criteria.

Screen used to build report

1

2

3

4

5

6


Screen used to build report1

Sections that can be skipped but may at times be useful. we will look at the report that would be generated from this criteria.

Screen used to build report

1

2

4


Select client population
Select: client population we will look at the report that would be generated from this criteria.

1

Dropdown Menu

  • Only relevant if your practice is associated in the NCIR with multiple sites/clinics and you want to assess clients from only one of those sites.

    • If the above applies, select the 1st option and specify a site using the dropdown menu.

    • Otherwise, leave the 2nd/default option selected.


Select client population lhds only
Select: client population (LHDs only) we will look at the report that would be generated from this criteria.

1

  • Local Health Dept. accounts display two extra client population options:

  • 3rd option: Assesses only people who are listed in the NCIR as residents of your county (whether or not they are “active” clients).

  • 4th option: Assesses your “active” clients (regardless of their county of residence) AND people who are listed in the NCIR as residents of your county,


Select clients displayed on the client list
Select: clients displayed on the client list we will look at the report that would be generated from this criteria.

2

  • This section determines which clients are displayed in the client list. It has no other impact.

  • 1st/default option: Generates a list of clients who did NOT meet the benchmark.

  • 2nd option: Generates a list of clients who DID meet the benchmark.

  • 3rd option: Generates a list of all assessed clients (those who met benchmark and those who did not).


Select how to assess refusals
Select: how to assess refusals we will look at the report that would be generated from this criteria.

4

  • You can run the report so that clients who refused a vaccine are assessed as UTD with that vaccine.*

    • 1st/default option: only considers vaccinated clients as UTD.

    • 2nd option: considers both vaccinated clients and those who refused the vaccine as UTD.

*Based on “client comments” recorded in the NCIR. For more info, see user manual.


General report tips
General Report Tips we will look at the report that would be generated from this criteria.


Refusals
Refusals we will look at the report that would be generated from this criteria.

  • One refusal of a vaccine is counted on the benchmark report as one “dose” of that vaccine.

    • Example: If a client has 2 refusals for HepB, then the client would meet the benchmark for 1Hep but would not meet a benchmark that was run for 3Hep.

  • You can now record multiple client refusals for the same vaccine in “client comments,” as long as each entry has a different “applies-to” date.

  • You may want to review previous refusals and add “as-of” date.


Refusal example
Refusal example we will look at the report that would be generated from this criteria.

You want to know:

  • Clients: age 13-19

  • Benchmark: UTD with 3HPV


If refusals do not meet benchmark
If refusals do not meet benchmark we will look at the report that would be generated from this criteria.


If refusals meet benchmark
If refusals meet benchmark we will look at the report that would be generated from this criteria.


Refusals on client list
Refusals on client list we will look at the report that would be generated from this criteria.

An “R” in the client list indicates that the client is considered UTD for all doses of the vaccine as a result of refusals.

Note: “R”s only display on reports run for childhood BMs. For adolescent/adult BMs, UTD as a result of refusals is indicated the same as in UTD as a result of vaccination (“Y”).


Client age and bm age
Client age and BM age we will look at the report that would be generated from this criteria.

  • Childhood BMs: You can assess clients within any age or birth date range.

  • Adolescent/Adult BMs: Report will not run if all selected clients are age 6 and under. You canassess clients within any age or birth date range as long as part of the range includes clients who are over age 6 years.


Flu shots for clients age 6 and under
Flu shots for clients age 6 and under we will look at the report that would be generated from this criteria.

You want to know:

  • Clients: ages 24-36 months

  • Benchmark: UTD with flu vaccine

    Steps:

    • Select clients using an age or birth date range that includes people older than 6. For example: age 2 to 7 years.

    • You could export to Excel, arrange columns in order of date of birth, and quickly narrow the list down to only clients in your desired birth date range.


Flu shots for clients age six and under
Flu shots for clients age six and under we will look at the report that would be generated from this criteria.


Report size
Report size we will look at the report that would be generated from this criteria.

  • It can be more manageable and useful to run reports for a narrow birth date or age range (to reduce the number of clients included).

  • Similarly it can be more manageable and useful to run reports on a regular, frequent basis in order to follow-up with clients throughout the year.


Questions
QUESTIONS? we will look at the report that would be generated from this criteria.