SharePoint Search - PowerPoint PPT Presentation

Sharepoint search l.jpg
Download
1 / 80

SharePoint Search. Mirjam van Olst Information Worker Solutions Macaw. Agenda. Enterprise Search Challenges Microsoft Search Vision SharePoint End-user improvements Knowledge Network Administration Improvements Performance and Capacity Planning Customizing the Search UI

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.

Download Presentation

SharePoint Search

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Sharepoint search l.jpg

SharePoint Search

Mirjam van Olst

Information Worker Solutions

Macaw

Making Serious Sites


Agenda l.jpg

Agenda

  • Enterprise Search Challenges

  • Microsoft Search Vision

  • SharePoint End-user improvements

  • Knowledge Network

  • Administration Improvements

  • Performance and Capacity Planning

  • Customizing the Search UI

  • Develop Search Solutions


Enterprise search challenges l.jpg

Enterprise Search Challenges

Making Serious Sites


Enterprise search challenges4 l.jpg

Enterprise Search Challenges

People often know more than systems

Information access is controlled

Information is stored in many places and in many formats

Finance Manager

Reviewing a Budget

Business Analyst

Preparing a Briefing

Sales Executive

Responding to an RFP


Microsoft search vision l.jpg

Microsoft Search Vision

Making Serious Sites


Microsoft search solutions l.jpg

Microsoft Search Solutions

Find

Use

Share

Enable professionals to find, use, and share relevant business data quickly, easily and securely

  • Find information across the desktop, intranet and Internet

  • Use information via intuitive, familiar interfaces

  • Share information among teams and connect people in real-time


Search as an infrastructure service l.jpg

Search As an Infrastructure Service

Scenario spectrum

Within-site search– WSS or MOSS

Search-driven business applications - MOSS

Intranet Search – MOSS

Internet point of presence search - MOSS


Enterprise search architecture l.jpg

Enterprise Search Architecture


Sharepoint server 2007 skus l.jpg

SharePoint Server 2007 SKUs

for Internet Sites

Enterprise Edition

Standard Edition

for Internet Sites


Search feature comparison l.jpg

Search Feature Comparison


Search feature comparison11 l.jpg

Search Feature Comparison


Secure manage your search deployment l.jpg

Secure & Manage Your Search Deployment

Control access to information with permissions

Perform standard query time security trimming

Implement custom security trimming

Manage your search solutions

Analyze usage patterns using powerful out-of-the-box reporting

Tune relevance parameters for better results

Control deployment of desktop search with group policies

Scale your deployment

Cluster web front ends, query servers, and index databases

Improve indexing performance with a dedicated index server

Index up to 50 million items per index


Unlock unstructured structured data l.jpg

Unlock Unstructured & Structured Data

Find information in unstructured repositories

Find content in web sites, file shares, SharePoint sites, public folders & Notes DBs

Use Protocol Handlers to index content in proprietary repositories

Support any file type with iFilters (over 200 supported formats out-of-the-box)

Use search as an interface for line-of-business systems

Index structured data sources using the Business Data Catalog (BDC)

Customize search results using out-of-the-box Business Data Web Parts

Make results actionable with Business Data Actions

Refine results and save important queries

Refine results using the keyword query syntax

Filter and sort result lists using relevant attributes

Save important queries and subscribe to RSS feeds or email alerts


Ifilters l.jpg

IFilters

iFilters available for lots of different file types

http://www.citeknet.com/ for:

CAB

CHM

EXE

HLP

RAR

ZIP

https://support.cadcompany.nl/ifilter/default.aspx for:

DWG (Looking for Beta users)

http://www.adobe.com/support/downloads/detail.jsp?ftpID=2611

PDF


Sharepoint end user improvements l.jpg

SharePoint End-user Improvements

Making Serious Sites


Relevance improvements l.jpg

Relevance Improvements

  • Best results on first page, every time

  • Enterprise Search is different from Internet Search

    • Far less cross-linking of content

    • Lots of non-Web content: Office docs, line-of-business data, etc.

    • Security is paramount

  • Revamped relevance & ranking engine

    • Extensive collaboration with Microsoft Research, MSN, Windows

    • Algorithms tuned for web and enterprise content

    • New search ingredients


Relevance improvements17 l.jpg

Relevance Improvements

  • New ingredients added, including

    • Click Distance

    • Anchor Text

    • URL Depth

    • Missing Metadata Creation

    • Automatic Language Detection

  • Result is noticeably more relevant search

    • 100% better on all queries

    • 500% better on common queries


Influencing ranking l.jpg

Influencing Ranking

  • Best Bets

  • Additional Metadata

  • Authoritative Sites


Enhanced user experience l.jpg

Enhanced User Experience

  • Simple yet powerful user interface

    • Query correction – “Did you mean?”

    • Hit highlighting

    • Duplicate Collapsing

    • Alerts

    • RSS Feeds

    • Security-trimmed search results

    • Actionable results through integration with Microsoft Office applications, Windows Desktop Search, Live Communication Server


Enhanced search center l.jpg

Enhanced Search Center

  • Search Center

    • Web part-based query and results pages

    • Many options for customization

  • Search tabs

  • OOB Search Web Parts

    • Search Box

    • Search Core Results

    • Search Best Bets

    • Search High Confidence Results

    • Search Statistics

    • Search Paging

    • Search Action Links


Anatomy of results page ui l.jpg

Anatomy Of Results Page UI

SEARCH BOX

HIDDEN SHARED OBJECT

ACTION LINKS

MATCHING KEYWORDS AND BEST BETS

STATISTICS

PAGINATION

HIGH CONFIDENCE MATCH

CORE SEARCH RESULTS


Use of search functionality in moss l.jpg

Use of Search functionality in MOSS

  • Content Query Web Part

  • Login Name and Display Name

  • My Team Sites Web Part

  • My Links

  • Colleague Tracker Web Part

  • Alerts


Search center l.jpg

Search Center

The Search Center,

the home for Enterprise Search


Business data search search data not just documents l.jpg

Business Data SearchSearch data, not just documents

  • Information in LOB systems is often hard to access

  • MOSS 2007 can bring that data to your users

    • Data is accessed through the Business Data Catalog

    • Exposed to many features in SharePoint

  • Search can easily index the data

    • No need to write code

    • Highly customizable results

    • Integrated with scopes and search center


Lob search l.jpg

LOB Search


Find people and expertise l.jpg

Find People and Expertise

Getting your job done means working withthe right people

Build rich personal profiles

Customize personal profile attributes

Manually update profile information

Automatically populate profiles using AD, LDAP directories, or LoB systems

Publish personal profiles using SharePoint My Sites

Create personal portals

Share files, links, and other useful information with others

Control access to information using security and privacy controls

Identify people who can help => Knowledge Network

Find people based on keyword matches with SharePoint personal profiles

Find “in-common” connections—managers, memberships, and colleagues

Group results by social distance and filter by common attributes


Vragen l.jpg

Vragen?

Making Serious Sites


Knowledge network l.jpg

Knowledge Network

Making Serious Sites


Knowledge network29 l.jpg

Knowledge Network

  • Knowledge Network Overview

  • Client Profile Creation

  • SharePoint Server Integration

  • Privacy and Anonymous Brokering

  • Deployment and Administration

  • Extensibility


Slide30 l.jpg

Knowledge Network is software for enterprise social networkingthat helps users collaborate more effectively by automating the discovery and sharing of undocumented knowledge and relationships

Who knows whom?

Who knows what?

Better Decisions

More Quickly

What is Knowledge Network?

Expertise Location

Connectors


Why is microsoft creating kn l.jpg

Why Is Microsoft Creating KN?

  • Three Core Beliefs

    • Most information is undocumented

    • It’s difficult to connect to the right person

    • “Weak ties” deliver significant value


Core belief 1 l.jpg

Documented Knowledge

20%

80%

Individual

Knowledge

Core Belief #1

Most knowledge is undocumented

  • Employees are more likely to turn to colleagues for information*

  • Not stored in documents

  • Notstored in databases

  • It’s Stored in peoples’ heads

Source: Delphi Consulting Group


Core belief 2 l.jpg

Core Belief #2

It’s difficult to connect to the right person

  • Finding the right person often involves a referral by an intermediary


Core belief 3 l.jpg

You

1 Degree

Your Inner

Circle

2 Degrees

Their Extended

Circle

3+ Degrees

Their Extended

Circle

Core Belief #3

“Weak ties” deliver significant value

  • People in our inner circle know basically the same people and the same things that we know

  • People that they know have connections that we don’t have

  • By leveraging “weak ties” we can learn about new opportunities, share new ideas or meet a new person or group of people


The kn solution l.jpg

The KN Solution

  • People ResultsRanked by

    • Social distance to seeker

    • Expertise and relationship relevance

  • SeekerSearches for people

    • Who knows what

    • Who knows whom

Publish ProfileIncremental updates

Publish ProfileIncremental updates

  • KN ClientAnalyzes email to create profile of

    • Keywords

    • Colleagues

    • External Contacts

  • KN ClientAnalyzes email to create profile of

    • Keywords

    • Colleagues

    • External Contacts

  • KN ServerAggregate profiles

    • Expertise information

    • Social network


Privacy concerns l.jpg

Privacy Concerns

Striking the Right Balance

  • The goal is to strike the right balance between Utility, Simplicityand Privacy

    • Utility is how useful will this software be to me?

    • Simplicity is how easy will this software be to install, upload, maintain and use?

    • Privacy is how much personal information will this software reveal and how much control do I have?


The simple privacy model l.jpg

The Simple Privacy Model

  • Notification

    • Communicate steps of the profile creation and publishing process

    • Customers can expose privacy policy in the client profile wizard

  • Control

    • User can choose which items to include/exclude

    • User can choose from 5 levels of privacy to apply to each profile item to control who is allowed to view that information on the server

    • Administrators can configure the default operation of the client, including opt-in/opt-out and the default privacy visibilities for profile items

    • Administrators can determine which aspects of the product functionality to leverage including external contacts, anonymous results, and DL keywords

  • Consent

    • KN sends no data to the server before the user has approved it

      • Caveat is keywords associated with “public” Distribution Lists – aggregated into DL profiles on the server


Top customer questions l.jpg

Top Customer Questions…

  • Why client-side mining?

    • Privacy – Nothing leaves user’s machine until they “publish”

    • Access to information – PSTs, future data sources

    • Distribute the processing

  • Why not mine sources other than email?

    • E-mail is by far the richest and most pervasive source today

    • Calculating strength across different data sources adds complexity

  • How long does analysis take?

    • Depends on a number of factors

      • On the amount of email and unique contacts

      • On disk performance, RAM, and CPU

      • User activity – since analysis process runs at low priority


Client profile creation l.jpg

Set Data Sources

Outlook folders to analyze

Import Outlook contacts

Import Instant Messaging contacts

Select Information

Run Analysis

Review Profile

Publish Profile

Client Profile Creation

1. Sync

Read each email

Capture key “interaction data” in MDB

Read in contacts from Outlook and IM clients

Sync Colleagues from SPS profile

2. Contact Resolution

Lookup contacts against GAL (MAPI)

Internal or external?

Is it a DL? Discard

Capture key properties

3. Update

Aggregate counts

Check thresholds

Calculate strength

4. Recommendation

“Exclusion lists”

Special rules

Limits applied

Organization name mapping for External Contacts

KNClient.log file and MDB files

C:\Documents and Settings\<user>\Local Settings\Application Data\Microsoft\Knowledge Network


Sharepoint integration overview l.jpg

SharePoint Integration – Overview

Extract and Publish

People Profiles

Index and Search

AD propertiesDL memberships

Active Directory

Index

KN Client MDB

KeywordsColleaguesExternal Contacts

Search Center

- Find People -

Manually enter Interests,Skills, Responsibilities, etc


Sharepoint integration data l.jpg

SharePoint Integration – Data

KN Client Data

Keywords

Colleagues

External Contacts

Client

Client

Server

Server

Publish KN Data to Server

KN ProfileManagementWeb Service

KN Data

KN Data

Keywords (public)

Colleagues

Keywords (non-public)

External Contacts

SPS User Profiles

KN Store

Crawl from SPS

AD property changes

SPS property changes


Sharepoint integration my site l.jpg

SharePoint Integration – My Site

Colleagues

External Contacts

Keywords

Profile Detail Tabs

KN MemberIndicator

Keywords Property

  • Summary of public keywords

Keywords In Common


Desktop search integration l.jpg

Desktop Search Integration


Anonymous brokering l.jpg

  • Reply to Help or Decline

  • Request Deleted

  • Brokered E-mail

Anonymous Brokering

  • Seeker Initiates Search

  • Anonymous Results


Knowledge network45 l.jpg

Knowledge Network


Client deployment l.jpg

Client Deployment

System Requirements

  • Windows XP SP2 or Vista

  • Office 2007 or 2003

    • Strongly recommend “Cached Exchange Mode”

  • Exchange 2007 or 2003

    • With Active Directory

  • .NET Framework 2.0

Configuration Options

  • Client policies (GPO)

    • Update interval

    • Recommendation limits

    • Default “Show To” privacy

    • Opt-in/out first experience

    • Anonymous brokering

    • Retention “clean up”

  • Custom privacy policy

  • KN Server settings

    • Organization mapping

    • Exclusion lists


Server deployment and admin l.jpg

Server Deployment And Admin

Deployment

  • Leverages Office Server 2007 administration, provisioning, and deployment infrastructure

Administration Options

  • View and manage jobs

  • User management

    • Manage KN “members”

    • Manage External Contacts

  • Client configuration

    • Organization mapping

    • Exclusion lists

  • Server statistics

  • E-mail templates


Kn extensibility l.jpg

KN Extensibility

  • Client-side

    • Managed API exposing data in KN DB

    • Retrieve user Keywords, Colleagues, and External Contacts

  • Server-side

    • Web service exposing a full-fledged query language for expertise/social network people search

      • Can go beyond UI scenarios – e.g., multi-target queries

    • Web service to retrieve (read) and augment (write) profile data

      • Bootstrap the profile or add custom keywords and contacts


Vragen49 l.jpg

Vragen?

Making Serious Sites


Search administration improvements l.jpg

Search Administration Improvements

Making Serious Sites


Search administration l.jpg

Search Administration

  • Design goals

    • Address SPS 2003 admin UI pain points

    • Unify WSS and MOSS search

    • Enable full programmability via the OM

    • Even better scalability and performance


Improved admin management l.jpg

Improved Admin & Management

  • Consistent search system across WSS and SPS

  • Revamped indexing management

    • Simpler UI

    • Better indexing logs

  • Flexible scoping

    • Scopes decoupled from content sources

    • Simple and compound scopes

  • Schema

    • Map foreign schema into search system

    • Streamlined UI

  • Query and Result Reporting

    • Get visibility into user search behavior

    • Logging for more detailed custom reports

  • Best Bets

    • Editorial results for specific queries

    • Streamlined UI

  • Continuous propagation

    • Indexed content is immediately searchable

  • Updated object model and APIs

    • Custom tools and services


Indexing management l.jpg

Indexing Management

  • Streamlined experience and more control

  • One index per shared service  no needto worry about managing discrete indexes

  • Multiple start addresses per content source

  • MOSS indexes can drive the WSS search experience

    • Allow upgrade from WSS to MOSS


Security l.jpg

Security

  • Query-time security trimming in SPS 2003

    • File shares, WSS/SPS 2003, Exchange, Lotus Notes(via mapping)

  • Now support pluggable authenticationfor content in WSS/MOSS sites

    • Based on ASP.NET 2.0 model

  • Minimum required crawler permission is nowjust Full Read, not administrator

    • Still provides the same security trimming functionality

  • Ability to remove Single Items


Search administration55 l.jpg

Search Administration


Customization l.jpg

Customization

  • Search in your company is different

    • Different metadata might matter

      • Documents: Title, Author, File location, size

      • Records: Patient, Doctor, Healthcare provider, SSN…

    • How users meaningfully scope searches differs

      • “All finance documents”

      • “All patient records”

      • “All published documents”

  • Customize results to “pop” metadata that matters

  • Customization offered at many levels

    • Webparts, XSLT/CSS, full object model…

    • SDK available


Search administration57 l.jpg

Search Administration

Adding a tab

Customizing the Search results


Query reporting l.jpg

Query Reporting

  • Best way to improve searchis to understand current usage

  • New out of the box usage reporting

    • Query volume trends, top queries, click through rates, queries with zero results, etc.

    • At both site and service provider levels

    • Export data for extended reporting in Excel

    • Respond to feedback with configuration changes or editorial results


Query reporting59 l.jpg

Query Reporting


Query reporting60 l.jpg

Query Reporting


Performance and capacity planning l.jpg

Performance and Capacity Planning

Making Serious Sites


Performance improvements l.jpg

Performance Improvements

  • Key new features make the crawls faster so the content is fresher

    • More efficient SharePoint Crawling(Change Log Crawl)

    • Continuous Propagation

    • Unified WSS and MOSS search

    • Security Change Only Crawl

  • Maximum scale is 10s of Millions of documents per indexer


Search performance planning l.jpg

Search Performance Planning

  • Key learnings

    • Think about freshness goals, change rate

    • Evaluate remote server responsiveness

    • Upgrade WSS 2003 sites to WSS 2007 sites to index them faster

    • Balance results freshness with load on servers

    • In most cases, your search index is on one server

  • Scale strategies might include

    • Dedicated WFE for crawling

    • Separate indexer machine

    • Separate SQL DB for Search

    • Fast disk for SQL, fast CPU for Indexer, more memory


Vragen64 l.jpg

Vragen?

Making Serious Sites


Customizing the search ui l.jpg

Customizing the Search UI

Making Serious Sites


Search ui programmability l.jpg

Search UI Programmability

  • Easy and powerful:

    • Customize using web part properties

    • Customize using XSLT, XML, and script

      • Manipulate URL parameters

    • Build web parts and apps using the query OM

      • keyword and SQL syntax

    • Remote apps using the query web service


Customize ui with xslt l.jpg

Customize UI With XSLT

  • Web part property specifies query columns

  • Search web parts get results XML

  • Web parts apply transform to XML nodes

  • Search page URL parameters enablequery manipulations

  • Appropriate for scenarios requiring

    • Change results layout, look and feel

    • Keyword syntax queries


Specify properties to select l.jpg

Properties must have been added as Managed Properties

XSLT uses them for display or logic

Use the core search results web part 'Columns' property in the tool pane:

Specify Properties To SELECT

<root>

<SelectColumns>

<Column Name=“ShirtSize”/>

<Column Name=“ShirtColor"/>

<Column Name=ShirtImage"/>

<...>

</SelectColumns>

</root>


Displaying custom properties l.jpg

Displaying Custom Properties

<xsl:call-template name="DisplayString">

<xsl:with-param name="propval" select=“ShirtSize">

<xsl:with-param name="proplabel“>Shirt Size:

</xsl:with-param>

<xsl:call-template>

.

.

(Later…)

.

.

<xsl:if test='string-length($propval) &gt; 0'>

<xsl:value-of select="$proplabel" />

<xsl:text> </xsl:text>

<xsl:value-of select:"$propval"/>

</xsl:if>


Property filtering l.jpg

Pivot or drill-down on a property to offer different queries

Construct URL, re-post to page withnew query

Property Filtering

<xsl:template name="DisplayPivot">

  <xsl:param name="value" />

  <xsl:param name="fieldname" />

  <xsl:param name="label" />

  - <a href="http://co-113/Search/Pages/results.aspx?k={$fieldname}%3a{$value}">

<xsl:value-of select="$value"/>

<xsl:text> <xsl:text>

<xsl:value-of select="$label"/></a>

</xsl:template>


Property filtering71 l.jpg

Property Filtering

<xsl:call-template name="DisplayPivot">

  <xsl:with-param name="value" select="fileextension"/>

<xsl:with-param name="fieldname">

FileExtension

</xsl:with-param>

<xsl:with-param name="label">

File

</xsl:with-param>

</xsl:call-template>     


Keyword syntax l.jpg

Established search UI element

Properties

monty -actor:"John Cleese"

monty -actor:John

same-property clauses are ORed

Equality only, prefix or exact phrase match

And / Or / Not / Phrase

"chocolate covered" -frog

No elaborate groupings

Scopes:

scope:movies

Keyword Syntax


Url request parameters l.jpg

URL Request Parameters

  • Content

    • results.aspx?k=fish

  • Scopes

    • results.aspx?k=fish&s=BBC

  • Sort

    • results.aspx?v=date

    • results.aspx?v=relevance

  • Page

    • results.aspx?start=21


Develop search solutions l.jpg

Develop Search Solutions

Making Serious Sites


Using the query om l.jpg

Use query OM:

To build custom search UI web parts

To have direct access to query and results properties

When you need to manipulate results on the server

Same flow, keyword or SQL syntax

Set up query text and options

Execute()

Retrieve a set of IDataReader objects

Using The Query OM


Process results l.jpg

'ResultsTableCollection': IDataReaders

Custom properties provide information on query and query execution

One table for each requested result type

RelevantResults

SpecialTermResults

HighConfidenceResults

DefinitionResults

Process Results


Using the query web service l.jpg

http://<server>/_vti_bin/search.asmx

Two query methods:

Query

Research and Reference Service-compatible XML

Use in the Office Research pane

QueryEx

Returns .NET DataSet

Full set of result types, features

Using The Query Web Service


Customizing with xslt l.jpg

Customizing With XSLT

Putting it all together


Vragen79 l.jpg

Vragen?

Making Serious Sites


  • Login