Azure Mobile App & Cognitive Services

1. Azure Mobile App & Cognitive Services Erick Kurniawan erick@actual-training.com

2. Azure Mobile Application Solution Mobile Apps in Azure App Service offer a highly scalable, globally available mobile application development platform for Enterprise Developers and System Integrators Key Benefits: With Azure App Service, build engaging cross-platform and native apps for iOS, Android, Windows, or Mac; store app data in the cloud or on-premises Scalable mobile-push notification engine capable of sending millions of push notifications to any devices within seconds Configure built-in autoscale for both Mobile Apps and Notification Hubs to match your app needs. Spin up/down resources based on actual usage and pay only for what you need

3. What to look for Target this solution approach to enterprise developers needing an application platform for building, deploying and managing mobile apps of all kinds Developers don’t have to build mobile back ends themselves, take advantage of features like offline data sync, push notifications and user authentication to quickly make apps fully featured. Xamarin allows for cross-platform design, leveraging existing .NET skills to multiple operating systems and mobile platforms. Visual Studio App Center brings together all the cloud and lifecycle services that help developers deliver high quality apps faster. Build, test, distribute, and monitor enterprise apps and add backend cloud services to scale the app to millions of users on-demand

4. Solution Architecture Enterprise Developer Enterprise developers use this solution to build, deploy and manage mobile apps of all kinds Solution goal Azure provides a comprehensive development platform and tools for B2C or B2B apps, allowing enterprises to share code across all target platforms and helping to lower total cost of ownership Solution components This solution is built on the following Azure managed services: Azure Application Service, Notification Hub, Active Directory, Visual Studio Mobile Center, DocumentDB, Xamarin Test Cloud, Application Insights. These services run in a high availability environment, patched and supported, allowing you to focus on your solution vs. the environment to run them in.

5. Reference Architecture Notification Hubs App Service Plan App Service Plan Web App Mobile App API App PaaS Database Services

6. Reference Architecture App Service Services for building both web and mobile clients from a single app back end—it consists of Web Apps, Mobile Apps, Logic Apps, and API Apps Notification Hub Ability for broadcasting personalized push notifications (APNS for iOS, GCM for Android, MPNS for Windows Phone, and WNS for Windows Store) Active Directory Identity and access management as well as authorization to social networks Visual Studio Mobile Center A set of cloud services for building and managing mobile apps, including HockeyApp and Xamarin Test Cloud and Application Insights PaaS Database Services A database management system running in a virtual machine and includes SQL, DocumentDB, Tables, and/or HDInsights Mobile Center Cloud and lifecycle services for building, testing, distributing, monitoring and scaling apps

7. dd

8. Vision From faces to feelings, allow your apps to understand images and video Speech Hear and speak to your users by filtering noise, identifying speakers, and understanding intent Microsoft Cognitive Services Give your apps a human side Language Process text and learn how to recognize what users want Knowledge Tap into rich knowledge amassed from the web, academia, or your own data Search Access billions of web pages, images, videos, and news with the power of Bing APIs

9. Why Microsoft Cognitive Services? Easy Flexible Tested Integrate into the language and platform of your choice Breadth of offerings helps you find the right API for your app Roll your own with REST APIs Simple to add: just a few lines of code required Built by experts in their field from Microsoft Research, Bing, and Azure Machine Learning Quality documentation, sample code, and community support GET A KEY BUILD

10. Scenarios

11. How do I use them? using Microsoft.ProjectOxford.Vision; using Microsoft.ProjectOxford.Vision.Contract; AnalysisResultanalysisResult; var features = new VisualFeature[] { VisualFeature.Tags, VisualFeature.Description }; using (var fs = new FileStream(@"C:\Vision\Sample.jpg", FileMode.Open)) { analysisResult = await visionClient.AnalyzeImageAsync(fs, features); } { "tags": [ { "name": "outdoor", "score": 0.976 }, { "name": "bird", "score": 0.95 } ], "description": { "tags": [ "outdoor", "bird" ], "captions": [ { "text”: “partridge in a pear tree”, “confidence”: 0.96 } ] } } POST https://api.projectoxford.ai/vision/v1.0/analyze?visualFeatures=Description,Tags &subscription-key=<Your subscription key>

12. Vision Computer Vision API Face API Emotion API Video API Distill actionable information from images Detect, identify, analyze, organize, and tag faces in photos Personalize experiences with emotion recognition Analyze, edit, and process videos within your app

13. Computer Vision: 86 Categories

14. Speech Custom Recognition Intelligent Service Bing Speech API Speaker Recognition API Convert speech to text and back again, and understand its intent Give your app the ability to know who's talking Fine-tune speech recognition for anyone, anywhere

15. Language Speech Text Analytics API Language Understanding Intelligent Service Bing Spell Check API Web Language Model API Linguistic Analysis API Detect sentiment, key phrases, topics, and language from your text Detect and correct spelling mistakes within your app Leverage the power of language models trained on web-scale data Easily parse complex text with language analysis Teach your apps to understand commands from your users

16. Knowledge Language Academic Knowledge API Knowledge Exploration Service Entity Linking Service Recommendations API Explore relationships among academic papers, journals, and authors Add interactive search over structured data to your project Contextually extend knowledge of people, locations, and events Provide personalized product recommendations for your customers

17. Search Knowledge Bing News Search API Bing Video Search API Bing Web Search API Bing Autosuggest API Bing Image Search API Link your users to robust and timely news searches Connect powerful search to your apps Give your app intelligent autosuggest options for searches Bring advanced image and metadata search to your app Trending videos, detailed metadata, and rich results

18. Easy Flexible Why Microsoft Cognitive Services?  Quality

19. Get started for free at microsoft.com/cognitive