What Is Microsoft Marketplace DataMarket ?

1. What Is Microsoft Marketplace DataMarket? Michael Stiefel www.reliablesoftware.comdevelopment@reliablesoftware.com www.reliablesoftware.com/dasblog/default.aspx Level: Intermediate

2. A marketplace of data sets with a standard API.

3. DataMarket is about the possibilities…

4. Application: Should I Move There? • Is it safe? • Crime Data from the U. S. Government • What are my neighbors like? • Consumer Expenditure Data • Key US Demographics by Zip Code, Place and County • What is the weather like? • Weather Data • Can I buy a house there? • Home Valuation • Mortgage Information

5. Trusted Data Providers • Authoritative • Commercial • Government • Structured and Unstructured Data

6. Uses OData Protocol • REST based OData feed use HTTP/HTTPS URIs.Open Data Protocol • Astoria / ADO.NET Data Services / WCF Data Services • Builds on ATOM, JSON, XML • Clients can be Java, .NET, PHP, Silverlight, iPhone, Windows Phone 7, etc.

7. OData Data Model • OData Feed is a collection of typed Entries • http://services.odata.org/OData/OData.svc/Products • Entry has simple or complex properties • Service Operations can be exposed • http://services.odata.org/OData/OData.svc/ • Metadata available • http://services.odata.org/OData/OData.svc/$metadata • Allows for automated discovery of different feeds

8. Types of Queries • Flexible Query • Dynamically Build Queries • Use Visual Studio Add Service Reference • Fixed Query • Predetermined provider query • May or may not have optional parameters • Use provider created proxy class

9. Making a Query • Formulate Query String • Add parameters for filters, pagination • Server based filtering • Get back XML payload • Authenticate with Account Key

10. DataMarket Portal…..

11. Demos

12. Business Model • Some Free Data Sets for Developers • Transaction (query) or Subscription Pricing • Broad Spectrum of data • "Easy to understand licensing“ • Microsoft takes a brokerage commission

13. Content Developer Opportunities • One place to look for data • One format for getting data • Understand data set through Explorer • Clear licensing • Clear Subscription Model

14. Subscription Models • Options • Unlimited • Limited to a fixed number of transactions • Billed monthly • Optional throttling by content provider • Auto renew • Free public data sets available

15. Content Provider Opportunity • Marketplace • Control data, terms, price • Single point of billing • Periodically receive payments and reports • Data transformation to common formats • Long Tail for Data providers • Built on Windows Azure

16. Advantages • Developer has one billing relationship through the marketplace • Access data sets that were previously difficult to obtain • Standard API allows DataMarket to be used from Java, PHP, or on an IPhone.

17. DataMarket Front End Architecture • Azure Web role for portal and requests • Frequent requests cached • In memory cache for VM • Azure tables for distributed cache • Data sources help define cache lifetimes

18. DataMarket Bank End Architecture • Queues and Worker roles for returning data • SQL Azure for account information • Data sets with CSDL mapping • SQL Azure • Provider Web services • Health Monitoring with sample queries • Transferred to Azure tables with reporting • Alerts based on results • Certificates for 3rd party connection info

19. Summary • Dallas is an application built on Azure • Uses OData API for simplicity • Can integrate with Access Control Service • Business Model drives "sense" of the application