780 likes | 902 Views
The RIT Senior Design Project features a groundbreaking engineering camera platform designed for real-time data capture and processing. Scheduled for review on November 6, 2009, the project team, comprising electrical and mechanical engineers, will present an innovative ruggedized unit capable of integrating multiple cameras, including a 10MP visual band and a 1.3MP infrared camera. Key functionalities include data transmission, simultaneous processing of INS data, and the capability to record full-resolution images during flight. The project aims to meet specific customer needs while addressing environmental concerns and design feasibility.
E N D
RIT Senior Design Project 10662D3 Engineering Camera Platform Friday November 6, 2009 9:00am to 11:00am
Team Members • Gregory Hintz (EE) • Project Manager • Samuel Skalicky (CE) • Lead Engineer, FPGA Board • Jeremy Greene (EE) • Connector Board • Jared Burdick (EE) • Power • Michelle Bard (ME) • Environmental • Tony Perrone (ME) • Physical Design
Advisors • Scott Reardon (D3 Engineering) • Kevin Kearney (D3 Engineering) • Dr. Robert Kremens (RIT-Imaging Science) • Philip Bryan (RIT – Industry Guide)
Project Status • Risks • BOM • Analysis • Feasibility • Designs • Test Plans
Schedule for the Design Review • Overview • Gregory Hintz • Electrical Discussion • Processor Board and FPGA • Samuel Skalicky • Connector Board, INS System • Jeremy Greene • Mechanical Discussion • System Design • Tony Perrone • Environmental Concerns • Michelle Bard
What is the Customer Looking for? Integrate supplied components Ruggedized Unit Flight-capable package Can record and transmit Capable of processing
Supplied Components Customer Needs Met External INS units Data processing (overlay) Real time viewing Store full-res. Data during flight Support NovAtel GNSS board • Integrate supplied components • 10MP Visual Band Camera • 1.3MP IR Camera • Spatial Sensors • NovAtel OEM Board OEMV3 • NovAtel OEM Board OEMV2 • Camera Processing Board • Capture data from two cameras • Capture 10MP @ 1fps • Capture 1.3MP @ 30fps • Capture INS data @ 30/sec (simultaneously)
Camera Components Customer Needs Met External INS units Data processing (overlay) Real time viewing Store full-res. Data during flight Support NovAtel GNSS board • Integrate supplied components • 10MP Visual Band Camera • 1.3MP IR Camera • Spatial Sensors • NovAtel OEM Board OEMV3 • NovAtel OEM Board OEMV2 • Camera Processing Board • Capture data from two cameras • Capture 10MP @ 1fps • Capture 1.3MP @ 30fps • Capture INS data @ 30/sec (simultaneously)
Camera Components Customer Needs Met External INS units Data processing (overlay) Real time viewing Store full-res. Data during flight Support NovAtel GNSS board • Integrate supplied components • 10MP Visual Band Camera • 1.3MP IR Camera • Spatial Sensors • NovAtel OEM Board OEMV3 • NovAtel OEM Board OEMV2 • Camera Processing Board • Capture data from two cameras • Capture 10MP @ 1fps • Capture 1.3MP @ 30fps • Capture INS data @ 30/sec (simultaneously)
Spatial Sensing Customer Needs Met External INS units Data processing (overlay) Real time viewing Store full-res. Data during flight Support NovAtel GNSS board • Integrate supplied components • 10MP Visual Band Camera • 1.3MP IR Camera • Spatial Sensors • NovAtel OEM Board OEMV3 • NovAtel OEM Board OEMV2 • Camera Processing Board • Capture data from two cameras • Capture 10MP @ 1fps • Capture 1.3MP @ 30fps • Capture INS data @ 30/sec (simultaneously)
Output INS data format # of shot, (FLIGHT INFORMATION, Pitch, ect….) 675,495060.000000,39.377116,-82.774721,1442.237213,177.966706,-6.573488,87.156026 676,495063.000000,39.375698,-82.773364,1437.212509,178.655193,-2.978762,89.591399 677,495066.000000,39.374288,-82.771967,1432.054779,177.896426,-3.434334,92.544970 678,495069.000000,39.372892,-82.770509,1428.557648,177.391126,-12.302477,92.517868 679,495072.000000,39.371514,-82.768882,1425.166306,178.138512,-9.035039,88.154010 680,495075.000000,39.370128,-82.767133,1425.035141,176.875920,-1.502685,89.783104 681,495078.000000,39.368761,-82.765407,1424.326828,176.056416,-6.737449,90.066296 682,495081.000000,39.367471,-82.763622,1421.768311,175.569431,-7.973052,88.809422 683,495084.000000,39.366537,-82.761748,1427.402252,176.045872,-7.985133,86.404080
Processing elements Customer Needs Met External INS units Data processing (overlay) Real time viewing Store full-res. Data during flight Support NovAtel GNSS board • Integrate supplied components • 10MP Visual Band Camera • 1.3MP IR Camera • Spatial Sensors • NovAtel OEM Board OEMV3 • NovAtel OEM Board OEMV2 • Camera Processing Board • Capture data from two cameras • Capture 10MP @ 1fps • Capture 1.3MP @ 30fps • Capture INS data @ 30/sec (simultaneously)
OEM Digital Signal Processing Board Signal Processing already done on Customer Supplied Interface. Image overlay Compression Resolution of Images Outputs 10/100 Ethernet S-Video Software interface available
Processing elements Customer Needs Met External INS units Data processing (overlay) Real time viewing Store full-res. Data during flight Support NovAtel GNSS board • Integrate supplied components • 10MP Visual Band Camera • 1.3MP IR Camera • Spatial Sensors • Camera Processing Board • Capture data from two cameras • Capture 10MP @ 1fps • Capture 1.3MP @ 30fps • Capture INS data @ 30/sec (simultaneously)
Processing Elements DSP • Energy Efficient • Single Pipeline • Easy Implementation • Math based ISA FPGA • Inputs/Outputs • Flexible Architecture • Faster Speed • Parallel Processing
DSP • Customer programmable • Encoding/Decoding media • Peripherals • Role in this design • Image compression • Real time streaming of data • INS interface • Required skills • Implementable Knowledge of C • DSP/BIOS
FPGA • FPGA Selection • Quicker time to fabrication • Supreme configurability/Field reprogrammable • Has the I/O needed • Parallel processing
FPGA • Xilinx Selection • Resources available to the team • Larger range of choices than other companies • Customer preference • Model XC6SLX75T Selection • Package size (23mm x 23mm) • High speed transceiver count • I/O pin count • Cost effectiveness
Data Flow – Initial Design • Pictures • Camera FPGA OEM • INS Data • INS OEM
Data Flow – Final Design • Pictures • Camera FPGA OEM • Camera FPGA HD • INS Data • INS OEM FPGA HD
Data Speeds • Image • IR: 30 images / second • VGA=640x480 • 9.2 MHz • Visible :1 image / second • 10.7MP=3664x2748 • 10.07 MHz • INS • 30 captures / second • 1kB=8kb • 8000 baud **Note: baud = bits per second (RS-232)
FPGA Pin Speeds • Minimum values • 13ns -> 76 MHz • 5ns -> 200 MHz
External Interfaces andthe Connector Board 2x GigE 2x Camera Link 10/100 Ethernet Power Supply External INS Connector Board D3 OEM Board
External Interfaces andthe Connector Board Power Supply External INS 2x Camera Link 2x GigE RCA output 10/100 Ethernet USB port Connector Panel
External Interfaces andthe Connector Board • Goal: • All interfaces routed through and mounted on the Connector Board • Reality: • Various different mountings and routings necessary
Interface Routing andConnector Mounting 2x Camera Link External INS Power Supply • 2x Camera Link = nearly full width of Connector Board Connector Panel
Interface Routing andConnector Mounting • GigE mounted on FPGA Board 2x GigE FPGA Board (bottom view) Connector Panel
Interface Routing andConnector Mounting RCA 10/100 Ethernet • RCA and 10/100 Ethernet routed directly to D3 OEM Board 10/100 Ethernet RCA output D3 OEM Board (top view) Connector Panel
Interface Routing andConnector Mounting USB port • USB routed directly to internal GNSS receiver Connector Panel
The Connector Board • Having determined what it needs to do, design could commence Customer Provided Block Diagram