520 likes | 1.14k Views
COMIT. CRITICAL Design Review. Contents. Motivations Mission Overview Stakeholders Sponsors Team Organization Electrical System Overview Functional Decomposition Environmental Circuit Overview Image Sensing Overview Data Processing Overview Application Framework
E N D
COMIT CRITICAL Design Review
Contents • Motivations • Mission • Overview • Stakeholders • Sponsors • Team Organization • Electrical System Overview • Functional Decomposition • Environmental Circuit Overview • Image Sensing Overview • Data Processing Overview • Application Framework • Structural System Overview • Drawings • Budget • Risks & Impacts • Economic Impacts • Risk Mitigation and Safety • Environmental Impacts • Societal Impact • Schedule • Gantt Chart • Milestones Presenter: Nate Turley Capstone Senior Design 2012 COMIT TouchSystems
mission “The mediocre teacher tells. The good teacher explains. The superior teacher demonstrates. The great teacher inspires.” ― William Arthur Ward Our mission is to inspire students in a way that defies conventions of the classroom, engaging them in the sights, sounds, and kinesthetic of a new experience. Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems
OVERVIEW • This project will provide a table-sized multi-touch interface on which to run educational applications. • Primary Foci: • Exciting, dynamic, non-conventional learning • Appeals to childlike curiosity • Engages multiple users • User-Centered Design • Educates on math, science, and music Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems
stakeholders "Consumer preference and motivation is far less influenced by the tangible attributes of product and service than the sub-conscious sensory and emotional elements derived by the total experience." Dr. Gerald Zaltman, Harvard Business School Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems
sponsors • “A leader in sustainable, energy-efficient LED lighting” • “Designers, fabricators, architects, engineers and end-users have come to rely on ACRYLITE® sheet products to meet their unique challenges in a broad range of market.” Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems
Team Organization Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems
Electrical System Overview JUSTIN BARTH Presenter: Justin Barth Capstone Senior Design 2012 COMIT TouchSystems
Level 0 Functional Decomposition Touch Audio Touch Table Display Power 120 V AC
Level 1 Functional Decomposition Touch Touch Data Touch Sensing Touch Utilization Audio Display 12 V 12 V Power Supply Environmental Sensors Power 120 V AC
Level 2Functional Decomposition Touch Touch Sensing Touch Utilization Image Processing System Acrylic Surface Imaging System Audio Application Framework IR LEDS Display Projector 120V AC 12 V 12 V Power Supply Environmental Sensors Power 120 V AC
Environmental sensorsSystem Overview Jared Yenzer Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems
Environmental Sensors CAT32 LED DRIVER CAT5114 Potentiometer R in I/O Temperature Sensor Imaging System LED STRIPS Analog Output Proximity Sensor 3.3 V 5V Analog Output Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems
Proximity Sensor GP2Y0A21YK SPECIFICATIONS Infrared Analog Sensor 25 Hz Sampling Rate 5V Supply Detecting Distance 10 to 80 cm Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems
TEMPERATURE Sensor TMP36 SPECIFICATIONS Analog Sensor 5V Supply ± 2º Celsius Accuracy -40º C to +125º C Range Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems
Imaging System Overview Jared Yenzer Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems
Imaging System Proximity Sensor & Temp Data 20 MHz CLK ATXMEGA16D4 μController I2C BUS TCM8230 Camera Environmental Sensors System Data Processing System I/Os to Potentiometer 8 Lines Parallel CameraData 3.3 V 2.8 V 1.5 V Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems
microcontroller ATXMEGA16D4 INPUTS/OUTPUTS I2C BUS Program Camera Reg. Image Size Color Options Shutter Speed I/O Pin for LED Circuit Control Potentiometer 12-Bit ADC Proximity Sensor Temperature Sensor Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems
Camera TCM8230 Inputs/Outputs Parallel Data Out D0 – D7 I2C Bus Control Registers 30 FPS YUV Format (3 Bytes) Luminance (Y) Chrominance (UV) Sub-QCIF (128px x 96px) Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems
Programmer AVRISP MKII SPECIFICATIONS Program AVR PDI 6 pin Interface Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems
TESTING RESULTS TEST BOARD SOFTWARE Test Major Components Microcontroller √ Camera Voltage Regulators √ Proximity Sensors Drivers for MCU √ Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems
Image Processing System Overview Justin Barth Presenter: Justin Barth Capstone Senior Design 2012 COMIT TouchSystems
FPGA Image processing system 8 Line Parallel Camera Data GPIO Camera Clock Touch Coordinates in TUIO Format Imaging System Altera DE0 Raspberry Pi RS-232 Horizontal End Available Input Frame End 20MHz Clock 5v USB Presenter: Justin Barth Capstone Senior Design 2012 COMIT TouchSystems
FPGA Altera DE0 INPUTS/OUTPUTS • 72 GPIO pins • RS-232 Serial Out • 115,200 baud • 50MHz Presenter: Justin Barth Capstone Senior Design 2012 COMIT TouchSystems
Rs-232 to usb adapter RS-232 to USB Adapter INPUTS/OUTPUTS • RS-232 on FPGA • USB on Raspberry Pi Presenter: Justin Barth Capstone Senior Design 2012 COMIT TouchSystems
fpga data sent over rs-232 Presenter: Justin Barth Capstone Senior Design 2012 COMIT TouchSystems
Blob detection algorithm For each luminance pixel in frame if pixel ≥ brightness threshold for neighbor in pixel neighbors if neighbor is part of a blob pixel is incorporated into that blob if pixel not assigned a blob pixel assigned to new blob compare location of new pixel with blob parameters determine left, right, top, bottom most points of blob Draw boxes around each blob Use center point of boxes to determine touch coordinates to send out Presenter: Justin Barth Capstone Senior Design 2012 COMIT TouchSystems
Blob detection Algorithm in matlab Image after processed through Matlab algorithm Basic image of IR touch blobs Presenter: Justin Barth Capstone Senior Design 2012 COMIT TouchSystems
Application FrameworkOverview NatEturley Presenter: Nate Turley Capstone Senior Design 2012 COMIT TouchSystems
Functional decomposition TUIO Spec via COM port Raspberry Pi Image Processing System HDMI Projector 5 V
RASBERRY PI Board Broadcom BCM2835 SoC SPECIFICATIONS 700 MHz ARM11 Overclocking Broadcom VideoCore IV OpenGL ES 2.0 USBx2 via integrated Hub HDMI Video Output 5v, 700mA, 3.5 W OS: Raspbian Presenter: Nate Turley Capstone Senior Design 2012 COMIT TouchSystems
SOFTWARE OpenFrameworks Open source c++ toolkit Game engine architecture Setup() Update() Draw() Built in event listener Custom Event Args Callbacks OpenGL ES 2.0 Standard for embedded accelerated graphics Hardware floating point support Presenter: Nate Turley Capstone Senior Design 2012 COMIT TouchSystems
UML class diagramCritical software components Presenter: Nate Turley Capstone Senior Design 2012 COMIT TouchSystems
Application flow chart Presenter: Nate Turley Capstone Senior Design 2012 COMIT TouchSystems
Projector ViewSonic PDJ5351 SPECIFICATIONS • 23’’ Throw Distance • 2500 Lumens • 3000:1 Contrast Ratio • $420 Presenter: Nate Turley Capstone Senior Design 2012 COMIT TouchSystems
StructuralSystem Overview Nathan glab Presenter: Nate Glab Capstone Senior Design 2012 COMIT TouchSystems
Table Structure Presenter: Nate Glab Capstone Senior Design 2012 COMIT TouchSystems
Table Structure Presenter: Nate Glab Capstone Senior Design 2012 COMIT TouchSystems
INSIDE TABLE Structure Presenter: Nate Glab Capstone Senior Design 2012 COMIT TouchSystems
Budget Overview JENNIFER COFER Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems
budget Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems
Budget Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems
budget Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems
Economic aspects • Marketability of system: • Could decrease teachers needed (esp. special education) • Could supplement homeschooling • Could extend past an educational environment • Cost expected to decrease in mass production Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems
RISKs & IMPACTSOverview Jennifer Cofer Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems
Environmental impacts • Acrylite is Green and LEEDs certified • “We are committed to minimizing our environmental impact. Operating under the Guiding Principles of Responsible Care®, we strive to continuously improve our health, safety, and environmental performances. Our goal is to improve the environment by supplying sustainable and long-living acrylic products to the green building sector and to all other markets we serve.” • Environmental Lights has A New Angle on Green • “At EnvironmentalLights.com we believe in sustainable lighting solutions that are energy-efficient and long-lasting, which lowers energy use and minimizes the environmental impacts from manufacturing and waste.” Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems
Risk mitigation & Safety • Temperature • Fans • Ventilation • Overall heat sensor (in LED circuit) • Temperature sensor on camera board / projector unit • Dust • Fans • Devices accessible for cleaning • Followed Component Specifications (linked below) • Acrylic here • IR LEDs here • Followed UL Guidelines (linked here) Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems
Societal Impact • Defying educational conventions • “Spoon feeding in the long run teaches us nothing but the shape of the spoon” ~ E. M. Forster • Providing the alternative • “It is the supreme art of the teacher to awaken joy in creative expression and knowledge.~ Albert Einstein Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems
Schedule Overview NATHAN GLAB Presenter: Nate Glab Capstone Senior Design 2012 COMIT TouchSystems