Session 3 assessment evaluation l.jpg
This presentation is the property of its rightful owner.
Sponsored Links
1 / 27

Session 3: Assessment & Evaluation PowerPoint PPT Presentation

  • Uploaded on
  • Presentation posted in: General

Lisa Jacques-Carroll, MSW NCIRD, CDC. Session 3: Assessment & Evaluation. Learning Objectives. Describe key components of evaluation of a perinatal hepatitis B prevention program describe different methods for assessing and evaluating a perinatal hepatitis B prevention program

Download Presentation

Session 3: Assessment & Evaluation

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript

Session 3 assessment evaluation l.jpg

Lisa Jacques-Carroll, MSW


Session 3: Assessment & Evaluation

Learning objectives l.jpg

Learning Objectives

  • Describe key components of evaluation of a perinatal hepatitis B prevention program

    • describe different methods for assessing and evaluating a perinatal hepatitis B prevention program

    • identify several tools that are available

Assessment evaluation l.jpg

Assessment & Evaluation

  • Program evaluation vs. program monitoring or assessment

  • The focus of this session is on assessing performance measures, which is a component of program evaluation

  • For more information on program evaluation see:

Activities required by cdc l.jpg

Activities Required by CDC

  • Requirements for assessment of the perinatal hepatitis B include:

    • frequency of assessment

    • performance measures

    • target levels

  • For more information: ipom/downloads/chp-05-perinatal-hepb.pdf

Overview l.jpg


  • Laboratory reporting audits

  • Hospital record reviews

  • Hospital policy surveys

  • Expected births to HBsAg+ women

  • Assessing case management

  • Monitoring birth dose

Laboratory reporting audits l.jpg

Laboratory Reporting Audits

  • Use to assess:

    • completeness of reporting of HBsAg+ results

    • timeliness of reporting

  • Include delivery hospital labs

  • Collaborate with communicable disease and state laboratory staff to help plan and execute reviews

Prioritize labs to evaluate l.jpg

Prioritize Labs to Evaluate

  • Priority labs:

    • labs serving high-morbidity areas or populations

    • labs reporting large volume of hepatitis serology

    • labs serving prenatal clinics

    • delivery hospital labs

  • How often?

    • ideally, once/year for priority labs

    • every 2–3 years for others

    • minimally every 5 years

Laboratory audit tool l.jpg

Laboratory Audit Tool

  • A CDC tool available at:

Completeness of lab reporting l.jpg

Completeness of Lab Reporting

  • Pick a time period (at least 3 months)

  • Calculate:

Total # HBsAg+ test results reported

Total # specimens that were HBsAg+

Proportion of HBsAg+ tests reported, or

completeness of reporting


Timeliness of lab reporting l.jpg

Timeliness of Lab Reporting

Timeliness of lab reporting cont d l.jpg

Timeliness of Lab Reporting - cont’d

Sum of column “# days

between serology and report”

Total # of serologies evaluated

Mean reporting time for the laboratory,

or timeliness of reporting





6.25 days

e.g. from the

previous slide

Time period for reporting is typically set by state statute

Tips for working with laboratories l.jpg

Tips for Working with Laboratories

  • Contact other areas of health department to see if activity is already being done

  • See if an existing lab report can be used for the audit—ensure it is source data

  • When making contact with labs, include:

    • lab director

    • technician

    • IT staff

Hospital record reviews l.jpg

Hospital Record Reviews

  • Use to assess:

    • maternal HBsAg screening

    • birth dose administration

    • post-exposure prophylaxis (PEP) for infants born to HBsAg+ and unknown-status women

  • Audit paired maternal and infant records

  • Partner with health dept programs to collect other perinatal data

    • rubella antibody• HIV

    • group B strep• early hearing

    • syphilis

Determining sample size l.jpg

Determining Sample Size

  • Tool available in Guide to Life (Table 2.1)


  • hepatitis/resource/perinatalhepB.htm

Using the guide to life table l.jpg

Using the Guide to Life table

  • Determine hospital’s annual number of deliveries

  • Decide where it falls in the “Birth Cohort Size” category

  • Estimate HBsAg screening and hepatitis B birth dose coverage for the hospital

  • Use the lower coverage to determine the sample size

Sample size example l.jpg

Sample Size Example

Hospital X had 648 deliveries last year

The expected HBsAg screening rate is 95%

The state National Immunization Survey (NIS) birth dose rate is 65%

Using the 65% coverage level, the sample size for Hospital X would be 111 records

Hospital data to collect l.jpg

Hospital Data to Collect

  • Delivery date/time

  • Mother’s HBsAg test date/result/type in:

    • maternal record

    • infant record

  • Infant hepatitis B vaccination (yes/no)

  • Date/time of vaccination

  • Infant HBIG administration (yes/no)

Hospital data to collect cont d l.jpg

Hospital Data to Collect- cont’d

  • Date/time of HBIG

  • Other variables as appropriate

Hospital policy surveys l.jpg

Hospital Policy Surveys

  • Use to assess whether hospitals have written policies/standing orders in place:

    • universal birth dose of hep B

    • HBsAg screening of pregnant women

    • PEP to infants born to HBsAg+ and unknown-status women

    • documentation of maternal HBsAg status, birth dose, and HBIG (if appropriate) in medical records

Conducting policy surveys l.jpg

Conducting Policy Surveys

  • Mail survey

  • Telephone survey

  • In-person survey

    during hospital

    medical record


Keep in mind, policies do not always match practice,

so medical record reviews are essential

Expected births to hbsag women l.jpg

Expected Births to HBsAg+ Women

  • CDC expected birth estimates are a benchmark for programs

  • CDC provides estimates for states and some cities

  • Estimates are calculated using:

    • birth data

    • prevalence of chronic

      HBV infection by


Expected births cont d l.jpg

Expected Births- cont’d

  • Nationally, about 24,000 births expected annually, only 50% identified in 2005

  • CDC encourages programs to improve estimates of births to HBsAg+ women

  • More information in presentation at:

Assessing case management l.jpg

Assessing Case Management

  • Number of infants born to HBsAg+ women

  • Proportion of infants receiving

    • hep B vaccine & HBIG within 12 hours of birth

    • on-time completion of hep B vaccine series

    • post-vaccination testing

  • Reasons for cases lost to follow-up

  • Proportion of screened and vaccinated household and sexual contacts

Assessing case mgmt cont d l.jpg

Assessing Case Mgmt - cont’d

  • Monitor case management outcomes:

    • compare program-wide rates (entire state or city) to national rates (CDC peritable)

    • regionally

    • locally (county level)

    • by case worker

    • quarterly or monthly

    • over time (trends)

Monitoring birth dose l.jpg

Monitoring Birth Dose

  • National Immunization Survey (NIS) data

    • measures hepatitis B birth dose rates

  • Hospital medical record reviews

  • Immunization Information Systems (IIS)

    • hep B vaccine birth certificate data automatically uploaded into IIS

    • calculate birth dose coverage for cities, regions, and individual hospitals

Continuous monitoring l.jpg

Continuous Monitoring

  • Some aspects of the program require continuous monitoring

    • case management outcomes

    • laboratory reporting

  • Plan ahead for assessments your program will conduct over the next year/s

Using your results l.jpg

Using Your Results

  • Determine future direction and focus of program efforts

  • Provide feedback to:

    • hospitals

    • laboratories

    • providers

    • health departments

    • case workers

  • Login