1 / 10

Selective Editing Strategies for the U.S. Census Bureau Trade Statistics Programs

This paper discusses selective editing strategies used by the U.S. Census Bureau for trade statistics programs. It explores different methods considered and the application of these methods on export transactions, including data adjustments, unit price analysis, and flagging records. The future work and challenges in evaluating the effectiveness of different score functions are also addressed.

josephwatkins
Download Presentation

Selective Editing Strategies for the U.S. Census Bureau Trade Statistics Programs

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Selective Editing Strategies for the U.S. Census Bureau Trade Statistics Programs María García, Alison Gajcowski, and Andrew Jennings U.S. Census Bureau UNECE Work Session on Statistical Data Editing, Bonn, Germany

  2. Trade Statistics Programs: Background • Official source for the U. S. merchandise trade statistics • Monthly publications - Import/Export statistics - U.S. balance of trade • Collected by Customs and Border protection

  3. Current Data Processing • Approximately 3.4 million import and 1.8 million export records per month • Edit master • Majority of edit failures are automatically imputed • Fewer than 0.5 percent of monthly records are “rejects”

  4. Selective Editing • Prioritize manual review of edit failing records • Mandate: All rejected records are to be reviewed

  5. Methods Considered • Flagging records • Effect of changes on totals • Adapted from Latouche, Berthelot (1992)

  6. Methods Considered • Hidiroglou-Berthelot method (1986) - Applied to unit price ratios - Series of transformation on data - Use simple statistics • Hidiroglou-Berthelot & effect of changes on totals (Jäder and Norberg, 2005)

  7. Application • Archived raw and “clean” data from 2004 export transactions • Data adjustments • Unit price • Totals, medians, quartiles, computed using the whole data set • Two types of weights • Data groups

  8. Application • Flagging records – selected records that must be examined at the commodity level – 20% review level • Effect on totals, Hidiroglou-Berthelot – applied to data groups by commodities

  9. Summary • Future work - Production testing, adjustment of weights, adding new weights - Review all rejected records? • Issue - How do we evaluate/compare the effectiveness of the different score functions?

  10. Thank You! Maria M. Garcia U.S. Census Bureau Maria.M.Garcia@census.gov

More Related