Using a Generative Lexicon Resource to Compute Bridging Anaphora in Italian:

1. Using a Generative Lexicon Resource to Compute Bridging Anaphora in Italian: preliminary observations and data Tommaso Caselli Istituto di Linguistica Computazionale – ILC-CNR Pisa Dip. Di Linguistica “T. Bolelli”, Università degli Studi di Pisa {tommaso (dot) caselli (at) ilc (dot) cnr (dot) it} CBA 2008, Barcelona, 14 November 2008

2. Outline • Motivations • Bridging in Italian: corpus-study • Introducing a Different Resource: PAROLE/SIMPLE/CLIPS • Preliminary Experiments and Evaluation • Conclusion & Future Work

3. Motivations: • Bridging anaphora is a very challenging phenomenon and their resolution is essential to improve the performance of many NLP applications (Q.A.; I.R. & I.E. and Summarizers); • So far, the use of (lexical) resources has concentrated on the exploitation of semantic relations (meronymy, synonymy, hyponymy ...) but the results present limitations: the relation between the bridging anaphor and the anchor is not always a semantic relation in classical terms • Relations between words are not randomly created by speakers. This calls for resources based on strong theoretical frameworks which may provide accounts on the way words combine and are related Generative Lexicon (G.L.) & G.L.-based resources

4. Bridging anaphora: theoretical assumptions • it is“a type of indirect textual reference whereby a new referent is introduced as an anaphoric not of but via the referent of an antecedent expression” [Kleiber 1999: 339]; • it is a class of inferences required to maintain the coherence of the discourse (Clark 1977); Yesterday we went for a pic-nic, but I forgot to put the beers in the fridge. • they give rise to three kinds of presupposition: • the Uniqueness Presupposition; • the Familiarity/Identifiability Presupposition and • the Inferential Presupposition i.e.“the [N1] R [N2]” e.g.: • N1 [the beers], N2 [a pic-nic] R= is_a_member_of).

5. Bridging anaphora: theoretical assumptions (2) • they are a matter of the local focus of the discourse for the identification of their antecedents (Sidner 1979, Poesio 2003); • 3 pragma-cognitive dimensions can be identified for their interpretation (Korzen 2003): • Lexical Semantics Dimension; • Co-textual Dimension (discourse structure); • Con-textual Dimension (scripts, frames, world knowledge).

6. Bridging anaphora: corpus-study • METHODOLOGICAL NOTE • corpus of seventeen randomly chosen articles from the Italian financial newspaper “il Sole-24 Ore”, a workpackage of the SI-TAL project • use of processing requirements for the classification both of the FDNPs in general and for bridging anaphors; • Minimal vs Maximal NP (MUC-7); • all instances of NPs (pronouns – including zero anaphora, lexical expressions), VPs and frames have been considered as probable anchors; • pre- and post-nominal modifiers (adjectives, non-finite verb forms, relative clauses and prepositional phrases) have been considered as disambiguating clues. Two-folded corpus study: • General corpus-study on Full Definite Noun Phrases (FDNPs) in Italian; • 2) A study on those cases of FDNPs which are instances of bridging anaphora in Italian.

7. Bridging anaphora: corpus-study (1) Full Definite Noun Phrases in Italian:

8. Bridging anaphora: corpus-study (2) Bridging Anaphora in Italian: • 221 anchors are nominal entities & ~70% have lookback ranging 0-2 • 53.84% (119/221) of the anchors are previous Cbs/Cps (Centering Theory) • 25.33% are proper names • 34.03% are NPs of postmodifying PPs, i.e. the explicit argument of the head noun of Lőbner’s FC2 e.g.: 4) i due Paesi - i due partner commerciali: I negoziatori dei due Paesi hanno annunciato che i colloqui “informali” in corso da giovedì scorso nella capitale Usa hanno portato all' alba di martedì al compromesso[...]. Doppiato questo scoglio [...] i due partnercommerciali hanno promesso di procedere a passo spedito.

9. A Different Resource: PAROLE/SIMPLE /CLIPS • As the corpus-study has shown more than 45% of the relations between anchor – bridging anaphor are based on relations which are not strictly lexical. WHY USING (AGAIN) A LEXICAL RESOURCE? • SIMPLE is based on Generative Lexicon (Pustejovsky, 1995): • formal framework which explains how senses are generated in the lexicon; • the basic qualia (telic, constitutive, agentive and formal) enable the description of the meaning of the word & captures orthogonal relations between semantic units; • the span of semantic relations in the G.L. framework is much wider and it reduces the need of world/pragmatic knowledge to explain semantic relations between words http://www.ilc.cnr.it/clips/

10. A Different Resource: PAROLE/SIMPLE /CLIPS (2) PAROLE/SIMPLE/CLIPS is the largest computational lexical knowledge base of Italian language: 

11. A Different Resource: PAROLE/SIMPLE /CLIPS (3) F E A T U R E S R E L A T I O N S Ontological Type Extended Qualia Domain Synonymy SEMANTIC UNIT Event Type Derivation Semantic Properties Regular Polysemy

12. A Different Resource: PAROLE/SIMPLE /CLIPS (4)

13. A Different Resource: PAROLE/SIMPLE /CLIPS (5) • Qualia structure: • the classical 4 qualia have been extended, up to 64 relations • finer-grained specification of meaning dimensions • from a single keyword it is possible to retrieve and extract a set of semantic units, regardeless of their semantic type, which creates a rich semantic network in the text FORMAL CONSTITUTIVE AGENTIVE TELIC 5 semantic relations 35 semantic relations 10 semantic relations 14 semantic relations PISTOLA (gun) – ARMA (weapon) SemRel= is_a MORTE (dead) – SUICIDIO (suicide) SemRel= resulting_state BENZINA (petrol) – PETROLIO (oil) SemRel= derived_from PROIETTILE (bullet) – COLPIRE (shoot) SemRel= used_for THESE SEMANTIC RELATIONS ARE TAKEN TO EXPRESS THE R ELEMENT OF THE INFERENTIAL PRESUPPOSITION TO RESOLVE BRIDGING ANAPHORS

14. A Different Resource: PAROLE/SIMPLE /CLIPS (6) i prezzi – al consumatore [the prices – the customer]; INFERENTIAL  indirect_telic + agent_verb il processo – gli imputati [the trial – the convicted]; INFERENTIAL  member_of essersi sparato – il suicidio [to shoot oneself – the suicide]; EVENT  resulting_state fatto esplodere – the debris [exploded – the debris]; EVENT  result_of condannare – il pubblico ministero [to condemn – the attorney] EVENT  relates il voto – l’elezione [the vote – the election] RHET. RELATION  purpose

15. Experiments and evaluation • Experiment: 129 couple of bridging anaphor – anchor has been selected from the corpus-study, corresponding to the following classes: • Lexical • Event • Rhetorical Relations • Inferential Anaphoric relations involving N.E. have been excluded

16. Experiments and evaluation (2) Bridging anaphor Anchor  WSD of the bridging anaphor  selection of the anchor - automatic retrieval of the semantic relation - maximum 2 semantic arcs allowed - direct connection between the 2 SemU or between the 2 SemType. SIMPLE

17. Experiments and evaluation: results Unsatisfactory results BUT still better than using IWN Reason: lots of the extended qualia relations have not been introduced into the resource The classes of Inferential and Rhetorical Relations are mostly resolved by 2 type of qualia: CONSTITUTIVE & TELIC

18. Conclusion & Future Work • the use of a GL based resource can be seen as a way of reducing the need of extralinguistic knowledge; • the problem of bridging anaphora resolution becomes part of a more general problem of identification of semantic relations between linguistic elements. • a resource with GL qualia relations encoded in it should not be compared with a world-knowledge databases. GL-based relations are dynamic: they allow to discover new relations between lexical items and can provide an account for the creative use of language;

19. Conclusion & Future Work (2) • qualia relations can represent new features for machine learning approaches; • GL pattern induction from a corpus-based study can improve the resource by adding missing relation; • extensive exploitation of the SemTypes can overcome the need of introducing single SemUs. ESPLODERE (explode) - MACERIE (debris) ESPLODERE Resulting_state SemU maceria SemType Cause_change_of_state MACERIA result_of SemU esplodere SemType Cause_change_of_state SemType Cause_change_of_state SemUDETRITO SemU …………

20. Thanks

21. The Model : Main DRS Bill (Cb), book (Cp), Maria(Cf), 2) Bill gave a book to Maria. The author is very famous. Bill(x1) book(x2) Maria(x3) give(x1,x3,x2) ……………. author (Cb) author(y1) famous(y1) DRS 2

22. Lexical Bridging • la pistola (the gun) - l' arma (the weapon)): E poi stupisce che nel tamburo della pistola mancasse un proiettile[…]. Alcune tracce di ruggine, infatti, farebbero pensare che l' armafu collocata nella cintura dei pantaloni almeno 4 o 5 giorni prima del ritrovamento del corpo . • l’esplosivo (the explosive) – la bomba (the bomb): Gli agenti sono risaliti al furgone utilizzato per trasportare l' esplosivo nel garage e alla persona che l' aveva affittato , Salameh. Il suo arresto , anche per aver collaborato alla preparazione della bomba , fu seguito dalla cattura di Ayyad , un chimico

23. Event essersi sparato (to shoot oneself) - ilsuicidio (the suicide): dopo essersi sparato una prima volta con la sua “Smith e Wesson” calibro 38, carica a proiettili “rafforzati” […]. Ciò non esclude automaticamente l' ipotesi del suicidio , ma avvalora quella di successive manomissioni, effettuate subito dopo la morte. rispose (to answer) - le domande (the questions): Nel 1993 , invece , rispose positivamente alle domande degli inquirenti perché ritenne che il clima politico consentisse di parlare liberamente .

24. Rhetorical Relations il voto (the vote) - l' elezione (the election): il voto di lista maggioritario per l' elezione in assemblea dei componenti del cda (che per altro verranno retribuiti anche in relazione ai risultati ottenuti dalla società) due elementi (two elements) - il voto... (the vote) / i limiti (the limits).. [i tre ministri] che hanno voluto introdurre nello statutodue elementi finora sconosciuti nell' universo italiano delle privatizzazioni: il votodi lista maggioritario per l' elezione in assemblea dei componenti del cda (che per altro verranno retribuiti anche in relazione ai risultati ottenuti dalla società) e, soprattutto, i limitiimposti al tetto azionario che vanno ben oltre il vincolo del 5 per cento.

25. Inferential quattro uomini (four men) - i quattro immigrati (the four immigrants): “Non potrò veder crescere mio figlio perché quattro uomini hanno deciso di far saltare simboli americani” [...]. Neppure la chiusura del processo ai quattro immigrati di origine araba promette però di scrivere la parola fine • il tribunale (the court) - il giudice (the judge): La decisione del tribunale era parsa scontata e non ha sorpreso neppure Mohammed Salameh, Ahmad Ajaj, Mahmud Abouhalima e Nidal Ayyad, il gruppo di fondamentalisti islamici sotto processo. “Mi aspetto il massimo della pena” aveva detto Ajaj poco prima di ascoltare il responso del giudice [...]. la Cina(China) –Pechino (Bejing): gli Stati Uniti sono parsi più vicini a trovare una soluzione di compromesso anche sulla controversia con la Cina sui diritti umani. Il segretario di Stato Warren Christopher avrebbe infatti stabilito che Pechino ha soddisfatto richieste specifiche alle quali gli Usa.

26. I terroristi hanno fatto esplodere una potentissima carica di esplosivo nel garage dei piu' alti grattacieli di New York : tra le macerie persero la vita sei persone e altre mille rimasero ferite ,