SyNTHEMA Semantic Intelligence, Speech & Language Technologies

1. SyNTHEMA Semantic Intelligence, Speech & Language Technologies Carlo Aliprandi – Mario Spoto Synthema srl Carlo Aliprandi

2. Company Profile Based in Pisa (Italy), SyNTHEMA is a high-technology SME that was established in 1993 by computer scientists from the IBM Research Center. Since then, the company has rapidly evolved, becoming nowadays a leading provider of Language and Semantic solutions, with state-of-the-art technologies for applications like Enterprise Search, Audio&Text Mining, Technology Watch, Competitive Intelligence, Speech Recognition, Respeaking and Speech Analytics. Grounding its leadership into a strong IT Research and Development, SyNTHEMA has pioneered a number of innovative applications and solutions, adopted on a daily basis by a vast amount of users to perform productivity tasks in different markets and industries, including Homeland Security, Intelligence and Law Enforcement, Public Administration and Government, Healthcare and Media. Carlo Aliprandi

3. Structure and activities Semantic Technology Translation Technology Speech Technology • 30 People (20 IT, 10 Localisation Services) Carlo Aliprandi

4. Tecnologie del Linguaggio – COSA SONO? • Language technology is often called Human Language Technology (HLT) or Natural Language Processing (NLP) and consists of computational linguistics and speech technology as its core but includes also many application oriented aspects of them. Language technology is closely connected to computer science and general linguistics • Bill Clinton: “Soon researchers will bring us devices that can translate foreign languages as fast as as you can talk ….” Carlo Aliprandi

5. Tecnologie del linguaggio, alcuni esempi LINGUAGGIO SCRITTO • Traduzione Automatica • Analisi Semantica • Ricerca in linguaggio naturale • Information Retrieval • QuestionAnswering LINGUAGGIO PARLATO • SpeechRecognition – Speechto Text • Trascrizione Automatica • Sottotitolazione Assistita • IntelligentSpeechInterfaces • Comprensione del Parlato • Gestione del dialogo (Avatar,..) Carlo Aliprandi

6. Il linguaggio naturale Source Ethnologue Source Netz-Tipp.De 2002 Source http://www.netz-tipp.de/languages.html Carlo Aliprandi

7. Semantica • La semantica è una parte della linguistica che studia il significato delle parole, delle frasi e dei testi. • Computazionalmente, si tratta di analizzare automaticamente il testo, cercando di capire il testo e di rappresentarne il significato profondo, (Natural Language Understanding) che risulta sempre dipendente dal contesto. Carlo Aliprandi

8. VERBO NOME interessare POS tagging interesse lemmatizzazione DATE LOC. WSD NER ORG. PERS. Semantica: stato dell’arte Tecnologie fondanti, esempi: interessi “Questo prodotto è rivolto ai clienti cui interessi la qualità” “Contattateci per il calcolo interessi addebitati nei conti correnti e nei mutui” borsa “La borsa di Milano oggi ha chiuso in rialzo” “La Treasure è una borsa in pelle di lusso“ “Dal 2010 diventa obbligatoria la borsa della spesa biodegradabile” “Il presidente ha le borse sotto agli occhi” “per ottenere la borsa di studio della Camera dei Deputati…” Carlo Aliprandi

9. Semantic Technology The Italian market offers State of the art for deep NLU: • Lemmatisation • POS Tagging • MultiWord Detection (MWD) • Named Entity Recogniiton (NER) • Parsing (dependency – constituency) • Word Sense Disambiguation (WSD) • Sentiment Analysis (SA) • Semantic Role Labeling (SLR) Languages: Carlo Aliprandi

10. Semantica • è un cool topic? • Bing Microsoft – Powerset (linguistic processor) • Google – Applied Semantics (ontology, or knowledge base of concepts and their relationships, coupled with linguistic processing engine) • Google Squared (structures the unstructured data on web pages) • Hakia (meaning-based search engine, ontology and semantic lexicon, ontological parser) • WolphramAlpha + computational knowledge engine, distilled and revised knowledge, NL query, rich visualisation • Knowledge engineering, language dependent • IBM Watson (Jeopardy!) • aspettando la killer app, c’è una domanda latente di “Semantic Search” Carlo Aliprandi

11. Speech Technology The Italian market offers State of the art speech technology for: • Automatic Speech Recognition • Automatic Transcription • Dialogue Systems • Speech Analytics Languages: Carlo Aliprandi

12. Speech Recognition • Dictation • Dictation is the interactive composition of text • Medical Report, court – parliamentary proceedings • Transcription • Transcription is transforming speech into text (Batch – Online) • Dialogue • CRM, device control, navigation, call routing • Speech Retrieval • Search audio and video using keywords Carlo Aliprandi

13. Thank you • Q&A Carlo Aliprandi Language and Speech Solutions Manager Synthema srl www.synthema.it Carlo Aliprandi

14. from Core NLP&ASR Technologies to products • Dal 1997, portiamo tecnologia R&D nel mercato SR (consumer - professional) • 1997: primo sistema di Riconoscimento del Parlato Continuo per l’Italiano (IBM Viavoice – Rad, Pat) • 2000: Camera dei Deputati: CameraVox, primo sistema di Speech Reporting basato sul respeaking • 2001: SpeechTitle (VoiceSubTitle), primo sistema per la sottotitolazione con Live Respeaking (broadcasting) • 2002: Voice Suite, primo sistema professionale per il distributed Speech Reporting • 2005: Voice Suite (and Fabrizio G. Verruso) World Champion in Speech Reporting - (still current) WR of 174 wpm • 2009: Applicazione al mondo Giudiziario: Voice Suite Legal edition • 2007: SpeechAligner, sistema di allineamento automatico tra video/audio e testo • 2008: DictaSpeech, sistema ALL-IN-ONE per la gestione del workflow dell’Audio Digitale e della Resocontazione Vocale • 2009: Applicazione al mondo Giudiziario: Voice Suite Legal edition • 2010: SpeechJive, Riconoscimento del Parlato su nuovi motori Nuance Dragon NaturallySpeaking • 2012: SpeechScribe.Server, Speaker Independent ASR. Trascrizione automatica batch di audio e video del parlato spontaneo • 2012: SpeechScribe.Live!, primo sistema di Online Speaker Independent ASR. Trascrizione automatica Live di audio e video del parlato spontaneo per la lingua italiana • 2013: SpeechScribe, new languages: Carlo Aliprandi

15. Main Clients - Italy • Italian Chamber of Deputies • RAI • Università di Pisa • Regione Emilia-Romagna • Tribunale di Milano • 200+ Hospitals, 10.000+ physicians: • Ospedale di Merano (German & Italian) • Azienda Ospedaliera Pisana • Ospedale di Viareggio • Ospedale Savigliano • Area vasta Toscana Sud-Est Carlo Aliprandi

16. Market • HealthCare (Public and Private) • Media • Local and central Government • Customer care Carlo Aliprandi

17. R&D - current projects • Mosaic (Multi-Modal Situation Assessment & Analytics Platform) Automated detection, recognition, geo-location and mapping, to enhance situation awareness, surveillance targeting and camera handover • Caper (Collaborative information, Acquisition, Processing, Exploitation and Reporting for the prevention of organised crime) A common platform for the prevention of organised crime through information sharing, exploitation and analysis of open and closed information sources • Savas (Sharing AudioVisual language resources for Automatic Subtitling) Audiovisual resources collection and sharing, to develop a new Speech Recognition (ASR) technology for Multilingual Live Subtitling, specifically tuned to the needs of the Broadcasting and New Media Industries. • OpenNER (Open Named Entity recognition) Provide enterprise and society with base technologies for Crosslingual Named Entity Recognition and Classification and Sentiment Analysis through the reuse of existing resources Carlo Aliprandi