html5-img
1 / 19

Overview

Automating Frame Analysis Antonio Sanfilippo , Lyndsey Franklin, Stephen Tratz, Gary Danielson, Nick Mileson, Rick Riensche, Liam McGrath Pacific Northwest National Laboratory. Overview. Review of Frame Analysis Automating frame annotation An application of automated Frame Analysis

hans
Download Presentation

Overview

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Automating Frame AnalysisAntonio Sanfilippo, Lyndsey Franklin, Stephen Tratz, Gary Danielson, Nick Mileson, Rick Riensche, Liam McGrath Pacific Northwest National Laboratory

  2. Overview • Review of Frame Analysis • Automating frame annotation • An application of automated Frame Analysis • Ongoing and future developments

  3. Frame Analysis: What is it? What is it for? • Frame Analysis focuses on how people understand situations through the analysis of communicative and mental processes to explain • How communication sources construct issues to influence target audiences, e.g. framing suicide bombing as “martyrdom” • How the target audiences respond to framing, e.g. degree of resonance • Recognizing framing intent leads to an understanding of the goals of the communication source

  4. A brief history of Frame Analysis • Approach pioneered by Goffman in 1974 has become an important analytical components across the social sciences • Strongest impact on the study of social movements • Renewed interest in the social psychology of collective action in the early 1980s led to further work which strengthened Goffman’s initial insights • Frame Analysis is now a main component in theories of social movement

  5. Our objectives in automating Frame Analysis • Despite great recent theoretical advances, there still is no systematic method to identify and marshal frame evidence in a time/cost effective manner • Address current limitations in the representation, acquisition and analysis of frame evidence • Leverage complementary approaches to Frame Analysis • Combine theoretical insights from Frame Analysis and Linguistics with Information Extraction capabilities and Content Analysis methods

  6. Frame Analysis components • Collective action frames • Social movement entrepreneurs offer a strategic interpretation of issues, e.g. “Islam is the solution” proclaimed Akef • Create inter-subjective meaning to recruit and mobilize people for the promotion of movement goals, e.g. establish Shar’iah law • Frame resonance (not the focus of this talk) • Describes the relationship between a collective action frame, the target audience, and the broader cultural context • E.g. credibility of the frame and its promoter, relevance of the frame to the target audience, frame consistency

  7. Theories of collective action frames

  8. PROMOTER used by Snow and Benford corresponds to the result of Gamson’s identity frame function overlaps with Entman’s notion of actors COMMUNICATIVE INTENT implicit in the frame classification of Gamson (injustice, identity, agency) and Snow and Benford (diagnostic, prognostic, motivational) TARGET corresponds to the result of Gamson’s injustice frame function ISSUES as in Entman Frame representation: “intelligent union” approach

  9. A methodology that promotes objectivity and automation • INTENT is further broken down into 15 speech act classes • ASSERT, BELIEVE, CRITICIZE, EXPLAIN, REQUEST, … • Each INTENT class has various lexical realizations (from WordNet) • We distinguish 9 types of ISSUES • SECURITY, RELIGION, POLITICS, SOCIAL, LAW, MILITARY, … • Each ISSUE has a list of lexical realizations (from WordNet Domains)

  10. A methodology which can be effectively evaluated • Four human subjects edited frame annotations automatically assigned to 30 documents • The annotation judgments of the four annotators were compared and assessed for agreement using the kappa test

  11. Frame extraction • Designed and implemented fully automatic extraction algorithm to find frames in naturally occurring text • See Sanfilippo et al. (2007) for details

  12. Evaluating automatic frame extraction • Used kappa and precision/recall tests to evaluate of manually and automatically assigned annotations to 30 documents (frame detection)

  13. Analyzing frame evidence • Developed a semantically-driven and visually interactive search environment to query and quantify frame evidence

  14. Using Frame Analysis to support predictive intelligence • At the year X elections Group-X (a radical religious group) tripled the number of seats previously occupied to become the largest opposition bloc in the parliament • Assess whether • Group-X will adopt more secular views, or • the recent electoral success will lead to increased radicalization

  15. Process • Harvested 619 documents from Group Y official website for years X and X+1 • Processed documents with frame extraction pipeline • Loaded the results into the frame search environment • Issued semantic queries to identify • Negotiation frames: accept, explain, support, etc. • Contentious frames: accuse, criticize, correct, reject, etc.

  16. Frame query results

  17. Conclusions and further work • Our approach enables the analysis of messaging strategies from document collections in a time and cost effective fashion • Current and future work • Frame Analysis with direct unreported speech (ongoing) • Frame Resonance (planned)

  18. Thanks! Antonio Sanfilippo Pacific Northwest National Laboratory Tel.: 509-375-2677 antonio.sanfilippo@pnl.gov

More Related