1 / 39

SOC Design for Digital Surveillance System

SOC Design for Digital Surveillance System. 2007/6/6 王逸竹. Outline. Digital video recording (DVR) system Surveillance application Features SOC design and challenge Architecture HW/SW partition issue Verification issue Summary. What is Digital Video Recorder (DVR). 取代傳統類比式閉路電視系統

Download Presentation

SOC Design for Digital Surveillance System

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. SOC Design for Digital Surveillance System 2007/6/6 王逸竹

  2. Outline • Digital video recording (DVR) system • Surveillance application • Features • SOC design and challenge • Architecture • HW/SW partition issue • Verification issue • Summary

  3. What is Digital Video Recorder (DVR) • 取代傳統類比式閉路電視系統 • 及時監看, 錄影 • 回播 • 數位化 • 壓縮, 保存, 傳輸

  4. Market trend • Demand • 國際恐怖事件頻傳 • 安全意識抬頭 • 對生活品質要求的提升 • 應用 • 交通要道 (車站, 機場) • 金融機構 • 工廠 • 社區住家

  5. 安控市場成長趨勢

  6. DVR市場成長趨勢

  7. Application examples • Surveillance • 尋找車禍肇事者 紀錄事實 • 319槍擊案, 鎖定嫌疑犯  尋找特定事件 • 草山行館火災, 燒毀主機  異地備份 • Intelligent processing • 辨識 (車牌, 人臉, 特殊行為,遺留物品) • 計數 (車流量, 人潮) • 自動追蹤

  8. DVR system Picture from: http://safeland.en.ec21.com/

  9. High-end (group A) Stability High recording speed Low-end (group C) Reasonable prices Reasonable recording quality Market segment Picture from: http://www.asmag.com/

  10. PC-based v.s. standalone DVR

  11. Our DVR SOC • Target • single chip for low-end DVR • 可擴充(串接, 或外加host CPU)以實現middle-end, high-end DVR • Our strength • Multimedia processing engines • First hardware MPEG-4 full-D1 encoder in Taiwan • Analog/digital video processing • System know-how • Customer’s requirement

  12. Target product: 4-ch DVR preview Monitor 4-ch DVR SOC playback Sensor Camera record HDD Key Pad Alarm

  13. Extend product: 8/16-ch DVR

  14. Extend product: Network DVR

  15. Extent product: other types • Mobile DVR • Compact size • Shock-proof • POS DVR • Overlap text (sale items or transaction data) and video

  16. Design for DVR SOC

  17. Target specification (1) • 4 cameras and microphone input • MPEG-4 video codec • Resolution: half-D1 or CIF • Audio codec (ADPCM) • Triplex: preview + record + playback • Display on TV / VGA • Full screen / quad display • Recording mode • Manual / Scheduled / Alarm / Motion • Adjustable recording quality and frame rate • Adjustable motion detection parameters

  18. Target specification (2) • Playback mode • Search by recording list / time / motion • Normal / pause / fast forward / fast rewind / A-B repeat • Support up to 2 HDD • 1 HDD endless recording • “HOT Swap” with 2 HDD • CF backup (AVI format) • Built-in OSD • Built-in 8-bit Turbo 8051 MCU • Host interface

  19. Block diagram

  20. Video in/out • Capture • CCIR-656 format • Transform • YCbCr422 interleave to YCbCr 420 planer transform • Decimation • ½ horizontal sub-sample • Cropping • De-interlace • Edge detection

  21. MPEG-4 encoder (1)

  22. MPEG-4 encoder (2) • Support MPEG-4 Simple Profile • Encode 4-ch source as 4 independent streams • Variable picture resolution • From 64*64 to 720*480 (16-pixel steps) • Computation power • Real time encoding Full-D1 @ 30fps when operate at 54 MHz • Flexible bit rate and frame rate control • Platform-based architecture • Embedded HyRISC for global control, mode decision and encoding algorithms • Hardware accelerators for computation-extensive tasks

  23. MPEG-4 decoder (1)

  24. MPEG-4 decoder (2) • Support MPEG-4 Simple Profile without error resilience • Maximum output resolution • Full-D1 (720x480 progressive), 30fps at 27MHz • Variable picture resolution • 16x16 to 720x480 • Support JPEG decode as well • Auto recovery when decoding error

  25. File system (1) • Simple file system • HDD allocation • Global table: disk information • Table1: recording information • Table 2: time index table • Video data • Backup area: Duplicate tables

  26. File system (2) • Special case • Endless record • HDD exception • 當錄影時遇到壞軌 • 當放影時遇到壞軌 • Index table 遇到壞軌

  27. High-speed bus 166 MHz Video data Multi-channel DMA Low-speed bus 27 MHz Bitstream, command HDD, CF System bus

  28. HW/SW partition • Software • decision, system control, user command • Hardware • computation-intensive task (ex: codec) • regular operation (ex: DMA) • Example (放影): • file-level以上由SW處理,file-level以下由HW處理 • SW: 依播放時間搜尋檔案,計算播放起始位置,啟動相關硬體模組 • HW: 從硬碟中取出資料, 解碼, 播放

  29. Design Challenge (1) • SOC integration • audio/video pre-processing/post-processing • audio/video compression • SDRAM controller • OSD • embedded RISC • IDE IF • flash memory controller

  30. Design Challenge (2) • Complexity • real-time compression • audio & video synchronization • full-duplex recording & playback • high speed SDRAM controller • video in + MPEG-4 codec + VGA display: 166M DW/s • file system

  31. Design challenge (3) • Simulation is time-consuming • Video pattern • Take 3 day for 1-sec behavior!! • Many design cases • Create behavior models to speed up simulation • We have developed about 30 models, but... • Create model also takes some efforts • And, what if the model is not qualified?

  32. Design challenge (4) • Hardware/Software co-design • 不同的思維方式 • Partition trade-off (large solution space) • Physical design • Timing (ex: SDRAM) • Testing

  33. Design challenge (5) • 系統相容性 • Camera • HDD • 嚴苛的環境 • 系統穩定性 • Keep it simple and stupid…

  34. Verification challenges • Corner case • 思考的盲點 • Corner case maybe not easy to create • Corner case maybe very very deep, need long time to simulated it • Ex: buffer overflow • 球員兼裁判

  35. Software Dev. Specification & Architecture Hardware Dev. Physical Design Design phase review • Overlap in specification/architecture phase and RTL-design phase; • multiple design changes • SW development starting late in the project Tape-Out RTL Closure

  36. New design methodology/concept • Design document • Confirm spec. as early as possible • System modelling • ESL (Electronics System Level) • Verify architecture as early as possible • Property check • Assertion • Coverage • functional coverage • Assertion coverage

  37. Create Executable Specifications Software Dev. Time Savings Quality Specification & Architecture Hardware Dev. Architecture Closure New SOC design phase • Architecture closure • Achieve a reduction # of RTL iterations • Can perform concurrent HW and SW design • Shorten the time it takes to get to golden RTL • Run SW on the architecture model Physical Design RTL Closure Tape-Out

  38. Summary • Introduce digital video recorder system • Present our DVR SOC design • What I have learned in this project • From IP to SOC • From design to verification • From one to team

  39. Thank you

More Related