Bosch IVA 3.5 Introduction

1. Bosch IVA 3.5 Introduction Embedded analysis at the edge! in BOSCH IP Encoders: VIP X1600 VideoJet X10/X20/X40 In BOSCH IP Cameras: Dinion IP FlexiDome IP Autodome IP 100 Series

2. Introduction of BOSCH IVA 3.5 • BOSCH IVA 3.5 is an Embedded Analysis – means a standalone solution with no PCs, OS or software to maintain • This embedded Analysis enables the so called „Intelligence at the Edge“ • Our Latest BOSCH IP Network Video products have enough processor power to even allow to run functionalities like IVA additionally to the encoding • This helps in larger CCTV surveillance systems to provide more automation by for excample what we at BOSCH call „Guard Assistance Systems“ • Goal of using „Guard Assistance Systems“ is to move Video from pure Data to Information and by that looking forward to be more proactive or even preventive.

3. Introduction of BOSCH IVA 3.5 • These Guard Assistance Systems are resulting in Benefits like • less bandwidth usage and less storage capacity needed • less human interference and errors • less time invest thanks direct immediate access to scenes of interest in even huge Databases scanned by BOSCH Forensic Search within seconds • lower running expenses, maintainance, HW costs, timeinvest for search: • signific improvement in search by „Google Search Functionality“ • With additionally providing more reliability in alarm handling Improved Security

4. VCA capabilities of encoders and IP cameras • MOTION+ Motion detection • Standard feature, no additional license • Built-in to all encoders and IP cameras • Robust motion detection • Object size discrimination • Tamper detection: • video loss • image too bright (detect blinding) • image too dark (hooding, spray painting) • image too noisy (camera defocused) • gross scene change (camera repositioned) • reference frame comparison

5. VCA capabilities of encoders and IP cameras • IVMD 1.0 Intelligent Video Motion Detection • Add-on VCA feature for all VIP X and VJ X encoders and IP cameras • Licensable advanced Video Content Analysis option • only license, no hardware or firmware change Features: • Background learning algorithm from Bosch’s own research group • up to 16 independent detector fields for alarm generation • Size, speed and direction discrimination • Camera calibration for metric and imperial measurements

6. IVA capabilities of encoders and IP cameras • IVA 3.5 Intelligent Video Analysis • Add-on VCA features for VIP X1600, VJ X10 family and IP Cameras • Licensable, more advanced Video Content Analysis option • only license, no hardware change • Self-explaining wizard-based GUI and “Click Object in Scene” for easy Setup and Configuration

7. IVA capabilities of encoders and IP cameras Features: • basic feature set from IVMD 1.0 • improved object detection algorithm • Additional filter for aspect ratio • Additional filter for Color Histograms • image stabilization for vibrating camera • FIR Camera support • Trajectories (follow route) • Line Crossing (single/multiple) • intrinsic application coverage: • idle object • removed object • loitering • Condition change

8. Target markets • Outdoor and indoor use at • Industrial estates, airports • Public surveillance • Traffic and Transportation • Military areas • Facility surveillance, Perimeterprotection • Correctional facilities • Museums, warehouses • Mainly: • Higher security market in the whole world

9. IVA 3.5 – in a nutshell (1) • Simple configuration via wizard based GUI and “In scene click on object” selection • Flexible selection of active area and tasks • sensitive area • single or multiple tasks per camera • Perspective correction using improved 3D grid • In Scene Camera calibration for metric/imperial measures

10. IVA 3.5 – in a nutshell (2) • All tasks with filters to define: Colorhistogramm; Object size, speed, 2-way motion direction, aspect ratio • Statistics for Feedback and Overview about Alarms • Detection of idle objects, removed objects, loitering, line-crossing and trajectory, global change • Camera image stabilization • Enhanced Separation Algorithm • Dynamic adaptation to • global lighting changes • weather conditions like rain, • snow, leaves, slow wind

11. Key Features • “Idle object” • Object left in scene • Vehicles stopped or parked • Object (person) stopped moving • “Removed object” • High value objects from displays in Retail or Museums • “Loitering” • Banks, ATM, schools, Parking • „Image stabilisation“ • pre-processing if camera is exposed to vibration or pole mounting • „Condition change“ • Object changes Aspect Ratio/Size/Speed within a configurable time • „Line Crossing“ • Single or multiple lines even with logical combination • „Trajectory“ • Object following a certain route – mainly used in Forensic searches

12. Analysis of pixel changes Textural analysis 1 2 Motion Analysis Image sequence 3 4 Adaptation of reference data Object detection 5 IVA Technology (1) • Based on digital image processing • Uses experience in vision-based automatic driving concept for cars by Bosch • Multi-level image analysis of • pixel changes • texture analysis • motion analysis

13. IVA Technology (2) IVA adapts automatically to the surveillance area by statistical analysis of measured image data. IVA suppresses unwanted notification from trees, branches, leaves, clouds, rain, shadows and snow Providing reliable detection as shown here:

14. IP Network Camera with IVA Encoder with IVA Network-attached iSCSI Review Station Management Station IVA – a System Feature • Cameras and encoders • use IVA results as alarm triggers • stream live metadata through the network • iSCSI or other Recording systems store both video and metadata • Management systems • display metadata as video overlays • use alarm triggers from edge devices • Replay gains fully free configurable • Forensic search capabilitieson stored metadata not dependend on preconfigured tasks.

15. Camera with IVA Encoder with IVA IP Network Network-attached iSCSI Review Station Management Station Metadata – the „vehicle“ of IVA • Short and compact information given by the VCA algorithm interpreting the image • Any related data can be added to metadata • Hierarchical structure for fast search on differently detailed levels • Distributed storage allows parallel search • Quickly available „forensic search“ results without watching for hours hundreds of unrelevant video („Google Search Functionality“)

16. IVA General Operation • Motion in all sensitive area is detected • size, speed, Color; direction, aspect ratio and perspective dependent • Object not triggering an alarm is outlined in Yellow • All detected objects are continuously compared against filter settings • When fitting, moving object is tracked in active area • object is outlined in RED • Alarm is raised with definable actions • Trajectory lines are displayed in green • MPEG-ActiveX component allows toswitch on/off outline display • change of colour on alarm is already working during configuration, • Several Statistics allow operational proof • And continuous fine tuning

17. IVA 3.5 Key Features • Improved object detection algorithm Objects are tracked even under difficult conditions with low contrast

18. IVA 3.5 Key Features • Intrinsic applications (Please view Demo CD for explaining Clips!) Idle object • An idle object will be discovered after a defined time, its idle state displayed, and then being learned into background. • The object’s idle state is displayed by red (alarm) or yellow blinking edge markers signed with an “I”.

19. IVA 3.5 Key Features • Intrinsic applications (Please view Demo CD for explaining Clips!) Removed object • A removed object will be discovered as soon as a change in the formerly learned background has been identified. • Even if the moment of removing, happens during the object itself is covered by another (bigger, overlapping) object • The missing object is displayed by red (alarm) or yellow blinking edge markers signed with an “X”.

20. IVA 3.5 Key Features • Intrinsic applications (Please view Demo CD for explaining Clips!) Loitering • Loitering is discovered when an object has been identified to stay within a configured area for a configured time. • The loitering object is displayed by red outlines and an alarm is generated.

21. IVA 3.5 Key Features • Intrinsic applications (Please view Demo CD for explaining Clips!) Image stabilization • Image stabilization is of advantage if the camera is mounted on a lantern or fence pole which would move in strong wind or if shaken (tampered), or exposed to vibration, e.g. in a vehicle. • Pre-processing to make IVA work more reliable without Image Stabilization with Image Stabilization

22. IVA 3.5 Key Features • Intrinsic applications (Please view Demo CD for explaining Clips!) Trajectory • Trajectory – Object following a certain route • is mainly used feature with forensic search in Databases

23. IVA 3.5 Key Features • Intrinsic applications (Please view Demo CD for explaining Clips!) Line Crossing • Single or multiple linecrossings can be detected. • even logical combination within the linecrossings are possible

24. IVA 3.5 Key Features • Intrinsic applications (Please view Demo CD for explaining Clips!) FIR Camera Support • Far infrared Camera is supported with the IVA 3.5 with a functionality to adopt the algorithm exactly to the specific needs in respect to.

25. VMS handling IVA alarms • Alarms from IVA are combined into general motion alarm for quick detection • Video management systems can evaluate all 8 tasks separately,allowing Alarm differentiation to • prioritize alarm conditions • combine specific alarm conditions • create complex rules to work out alarm scenarios • VIDOS, e.g., shows the first two VCA alarms separately, the remaining 6 tasks are combined into a collective third alarm • BVMS shows 8 VCA alarms separately,

26. Configuration (1) • Configuration Manager is used to configure IVA 3.5 • click tab „VCA“ • set motion detection to „ON“ • select analysis type „ IVA 3.5 “ • Preview showsdetected objectswith outlines, trajectoriesand alarm states • Click „Select ...“ to enter configuration

27. Configuration (2) • Objects within the sensitive area are marked with outlines or bounding boxes • An object, detected but not generating an alarm, is outlined in yellow • An object, detected and generating an alarm, is outlined in red • Trajectories are marked as green lines

28. Configuration (3) • Right-click outside of a detector field to get the global settings menu • Size constraint • defined by minimum and maximum area size of detected objects in image • Extended functions • idle object detection with global delay before creating an alarm • removed object detection • image stabilization to remove jitter from camera image, e.g. when mounted on a pole or in a vehicle • FIR Camera connected to the Encoder • Enhanced Separation for improved Anti merge.(Dynamic Occlusion)

29. Configuration (4) • The sensitive area can be set to the interesting zone to reduce the required calculation power • A set of drawing tools is offered via the menu

30. Configuration (5) • By default, the window shows one single detector field, covering the whole sensitive area • Up to 16 detection items (fields, routes, lines) can be defined and freely positioned • Up to 8 alarm tasks can be configured utilizing the configured detection items • Right-clicking the mouse in the related detector field opens the context menu to set all related parameters

31. Configuration (6) • A detector fieldwithoutan object generating an alarm isgreen • A detectorfieldwithan object generating an alarm isred • The detector field can be selected for modification by simply clicking it • Click and drag a border line or right-click to add a node (vertex) • Click and drag a vertex to modify the shape • Modify the polygone with up to 16 vertices to match the area to be searched

32. Configuration (7) • Filters can be individually defined for each task • Each filter can be ranked by defining its Precesion with a slider • Filters can be defined by hand each or simply by using „clicked object data“ • FILTERS: • Object size in square meters * • Object Aspect Ratio (relation length/broad) • Object speed in km/h * • Object motion direction one- or two-way with independent angle settings • Colorhistogramm of Object * Measurements can be switched to imperial measures

33. Colorhistogram: Click on the related color that shall be detected (up to 5 colors can be selected per task) The importance of the configured colors is from left to right: 25%; 20%; 15%;10%; 5% of the monitored object With the “Saturation” slider the intensity of the monitored colors can be set up. With the Slider “Precision” the accuracy of the monitored color, can be defined. Configuration (8) Configuration (8) 25% 20% 15% 10% 5%

34. Configuration (9) Task wizard: • Loitering • defined by spatial tolerance and delay • Idle object • idle time defined globally for all objects • Removed object • immediately detected on „background change“ • Aspect ratio • defined by minimal and maximal vertical to horizontal ratio of objects • Condition change Aspect Ratio/Size/Speed within certain time • Trajectory Object following a certain route • Object Enters/leaves/is inside area/field • …others…

35. Configuration (10) • Metric measurements can be done when the camera is calibrated for viewing angle, perspective and sizes to represent the real view • 3D grid placed into the camera scene allows to set viewing angle and perspective graphically • Two cubes representing a given size ease adaptation to objects *

36. Configuration (11) Statistics • once the detector field has been configured statistics can be used to check the results of the settings and tweak them until the result equals the expectations • black zones indicate the active parameter range for creating alarms *

37. Configuration (12) Object properties • The moment you click an object in the scene, you will get a corridor of 30sec. shown with even all the specific information regarding this specific object. • You are welcome to take this information to configure a certain Task, by symply activating „ Use tracked object data“ In the task wizard *

38. Application Examples • exclude unwanted areas (like glass building, sky, water, public areas) • simple areas • watch a door • watch a fence • watch a place • multiple areas • watch different areas, e.g. a few doors • watch areas differently in same scene • direction detection • one-way (wrong way) • two-way (crossing, turning) • speed discrimination • special cases in areas (entering/leaving/inside) • special object behaviour (loitering, idle object, removed object, global change)

39. License Activation (1) • Attention: IVA 3.5 is just an Upgrade of the main product IVA 3.0 In SAP and Licencing only IVA 3.0 is available and up- grades automatically with using the FW 3.5 to the IVA 3.5 • You require: • your „Authorization Number“ attached to the IVA 3.0 License Package • an IP Network Video product with firmware release 3.5 • Web browser access to the product • Internet access to use the Bosch Software License Management System SLMS at http://activation.boschsecurity.com/ • Then execute the following steps:

40. License Activation (2) • Open the product‘s license menu • via the Configuration Manager using the „License“ tab or • via the Web browser at „SETTINGS->Service settings->Licenses“ • Mark and copy the product‘s „Installation Code“ • Visit the SLMS site and enter your „Authorization Number“(don‘t drop the blanks)

41. License Activation (3) • Paste the product‘s „Installation Code“ into the respective field • Fill in additional locationparameters and comments on your convenience • Click „Submit“ to get the „Activation Key“ displayed

42. License Activation (4) • Mark and copy the „Activation Key“ • You may like to print this page or send the Activation Key via email

43. License Activation (5) • Paste the „Activation Key“ into the product‘s appropriate menu field and click „Set“ • A confirmation message will be displayed below Now you can start configuring your IVA 3.5 By upgrading from an elder version IVMD 2.0 or IVA 3.0, the settings keep still available

44. Packaging – what you get • An IVA 3.x license has content of delivery: • a printed manual in English with • a license Authorization Number label on the back of the manual • additionally, a product CD with software tools and documentation in other languages is included with the manual • all packed into an envelope with a product label in the lower left corner