generating remote control interfaces for complex appliances l.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Generating Remote Control Interfaces for Complex Appliances PowerPoint Presentation
Download Presentation
Generating Remote Control Interfaces for Complex Appliances

Loading in 2 Seconds...

play fullscreen
1 / 31

Generating Remote Control Interfaces for Complex Appliances - PowerPoint PPT Presentation


  • 400 Views
  • Uploaded on

Generating Remote Control Interfaces for Complex Appliances Jeffrey Nichols Carnegie Mellon University August 22, 2002 The Problem Everyday appliances are becoming more complicated and thus more difficult to use Cheap to add computation and features

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Generating Remote Control Interfaces for Complex Appliances' - LionelDale


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
generating remote control interfaces for complex appliances

Generating Remote Control Interfaces for Complex Appliances

Jeffrey Nichols

Carnegie Mellon University

August 22, 2002

the problem
The Problem

Everyday appliances are becoming more complicated and thus more difficult to use

  • Cheap to add computation and features
  • Expensive to design and build high-quality interfaces
the solution
The Solution

Observation:People are increasingly carrying handheld devices, like mobile phones and PDAs

  • These devices will soon be able to communicate with devices around them (Bluetooth, 802.11b)
  • Better built-in UI hardware (color touch screens, etc.)

Solution:Use handhelds as remote controls!

personal universal controller

Feedback

Specifications

Control

Personal Universal Controller

An intermediary remote control interface

Benefits

  • Graphical and speech interfaces
  • Adaptable interfaces (to PUC device and to user)
overview
Overview

Architecture

Specification Language

Interface Generators

  • Algorithms using dependency information

Demonstration

language design
Language Design

Approach

  • Create reference interfaces
    • AIWA Shelf Stereo
    • AT&T Telephone/Answering Machine
  • Test interfaces with subjects
    • Users twice as fast and made half errors as compared with manufacturer’s interfaces
  • Analyze interfaces for functional information
language elements
Language Elements

State Variables and Commands

  • Represent functions of stereo
  • Variables sufficient for most functions but not all
    • “seek” button on a Radio

Type Information

  • State variables have types
    • Boolean, Enumeration, Integer, String, etc.
  • Interface generators can use type to infer control
language elements cont
Language Elements, cont.

Label Information

  • Good labels are an important of any interface
  • One label does not fit all
    • The optimal label size changes with screen size
    • Speech interfaces made need pronunciation and text-to-speech information
  • Solution: Label Dictionary
    • Collection of similar labels
      • As many as necessary
      • Different modality information
language elements cont14
Language Elements, cont.

Group Tree

  • Organization is very important to user interfaces
  • Tree is a good structure as most interfaces can be described as a tree
  • We use n-ary tree with variables/commands at leaves
language elements cont15
Language Elements, cont.

Dependency Information

  • Formulas that specify when a variable or command is active in terms of other state variables
    • Equals, Greater Than, Less Than
    • Linked with logical operators (AND, OR)
  • For example,

<and> <equals state=“PowerState”>true</equals> <equals state=“RadioBand”>AM</equals></and>

overview16
Overview

Architecture

Specification Language

Interface Generators

  • Algorithms using dependency information

Demonstration

graphical interface generator
Graphical Interface Generator

Focuses on panel structure of user interface

  • Small groups of controls have simple layouts
  • Complexity comes from relative layouts of groups

Structure can be inferred from dependency info

  • Groups are often defined by sets of controls that are all active at the same time (mutual exclusion)
  • May overlap other controls that not active
determining panel structure
Determining Panel Structure
  • Find mutual exclusion within group tree
    • Find group that containsdepended-upon state
    • Look for mutual exclusionsamong group children
  • Assign branches of group tree to sets of panels
    • Choose a panel based upontype information and properties of group tree.
choosing panel types
Choosing Panel Types

Rules for Choosing Panels

  • If state has enumerated type and there are mutually exclusive groups of controls for each value, create a tabbed panel.
  • If state has boolean type and all other controls are active for only one value, create two full-screen overlapping panels.
  • Create overlapping panels for each mutually exclusive group and ensure there is a control elsewhere for setting the state.
making the interface concrete
Making the Interface Concrete

Choose a control for each object

Use a decision tree with questions such as:

  • Is this a command or state variable?
  • What is the type of the state variable?
  • Is the state variable read-only?
  • Was a panel structure rule applied from this variable?
making concrete cont
Making Concrete, cont.

Rules for choosing row layouts within panels

  • A labeled group with only two unlabeled controls is given a two-column layout with group label
  • Controls that prefer a lot of horizontal room are given a full width layout
  • If a group contains just two labeled controls are given a two-column layout without group label
making concrete cont22
Making Concrete, cont.

Conceptual layout has been chosen

  • Panels, Controls, Rows

Allocate space

  • Examine panel contents and choose sizes

Instantiate and place controls

overview23
Overview

Architecture

Specification Language

Interface Generators

  • Algorithms using dependency information

Demonstration

future work
Future Work
  • Improve quality of generated user interfaces
    • Back-tracking, etc.
  • Specification and generation of list interfaces
    • Necessary for many appliances
  • Adaptive interface generation
    • New interfaces modeled on past interfaces
  • General purpose appliance adaptor for HAVi and UPnP protocols
acknowledgements
PUC Project Members

Brad A. Myers

Michael Higgins

Joseph Hughes

Thomas K. Harris

Roni Rosenfeld

Stefanie Shriver

Peter Lucas

Mathilde Pignol

Kevin Litwack

Funding

National Science Foundation

Pittsburgh Digital Greenhouse

Microsoft

Equipment Grants

Mitsubishi (MERL)

VividLogic

Symbol Technologies

Hewlett-Packard

Lucent

Acknowledgements
thanks

Thanks!

Generating Remote Control Interfaces for Complex Appliances

August 22, 2002

http://www.cs.cmu.edu/~pebbles/puc/

http://www.cs.cmu.edu/~jeffreyn/

control of ieee 1394 dv camera
Control of IEEE 1394 DV Camera

Sony Camcorder with AV/C protocol

control of audiophase stereo
Control of Audiophase Stereo

Custom Hardware and Software Adaptor

Continue to Future Work

interface generation process
Interface Generation Process

Three Phases

  • Determine panel structure from dependency info
  • Assign controls to variables/commands
  • Allocate space and lay out controls