BroBot The Study Companion group 25

1. BroBotThe Study Companiongroup 25 Richard Landau Sarah Patten Jacob Stewart

2. Project Overview • BroBot assists in easing the minds of students longing for a worry-free break. • Watches study materials while the user is away from the table. • Sends updated images and alerts to userthrough an Android app on user’s phone. • Will provide real-time updates and will notify user if something is stolen.

3. Goals and Objectives • Detect theft of an object. • Alert user when a theft occurs. • Be reliable and simple to use. • Rechargeable or easily replaceable battery • Be lightweight, portable, and affordable.

4. Design Specifications

5. Overall Block Diagram

6. Processor considerations • All of the computations are on the microcontroller side • A good amount of serial communication protocols (SPI, I2C, UART) • Low power modes including sleep mode • Special features with digital cameras (?) • Good community backing • Cheap development board with all the pin outs on the microcontroller

7. ARM Microcontrollers

8. STM32F407VG • 3.3V Voltage • Low power modes • Digital Camera Interface(DCMI) • Can take 8 bit parallel data from a camera • Good amount of SRAM • Fast operation speed • A lot of serial communication lines • Good community backing it with pre-written libraries for most features

9. Cameras

10. MT9D111 • Cheap and small • Adjustable output • Adjustable resolution • Adjustable quality on the JPEGs • Parallel data • Control on shutter speed, and auto focus • Sleep modes • Has own serial protocol • Interfacing parallel data might be tricky

11. LinkSprite JPEG Color Camera • Local shipping • Higher voltage needed • Data is serial making it easier to interface but slower overall • Smaller resolution • Will be used mostly for testing, or used if we have troubles with the MT9D111 • Bought since we are under budget

12. Bluetooth vs WiFi-Direct • Wi-Fi direct and Bluetooth are comparable • Wi-Fi direct has longer range than Bluetooth • However, Bluetooth has more support and is easier to implement • Bluetooth is also more common in everyday life so we wanted experience with it

13. Bluetooth Module Comparison • Chose RN41 due to low cost, high range, and black box functionality • WT41 strong contender but expensive and drains battery quickly

14. Power System Overview • All components need 3.3V • Around 500mA when everything is going • Power source needs to be small and lightweight • Rechargeable or easily replicable power source • One switching regulator • 3 AA Batteries held in a battery holder

15. BroBot’s Platform • Exact platform hasn’t been determined • Bluetooth antenna needs to be protruding • Small and lightweight • Expandable/ Contractible casing for easy traveling

16. Item watching overview • Use computer vision techniques. • Compare 2 images from different points in time • Determine if there has been a significant amount of change ≠

17. Algorithm explanation • Store an “original” image • Every ½ a second, take a new picture • Compare new picture with “original” • If the images differ by too much, sound alarm • Every 15 seconds replace “original” with the newest picture taken

18. Pseudocode

19. App Summary • Android application’s main focus is to alert the user if something has been stolen • Picture of BroBot’s current view will be refreshed for the user to view at any time • App will vibrate to alert the user if something is taken

20. Android vs iOS • Android represents a bigger market share • Does not require a Mac to code • Good APIs to interface with Bluetooth VS

21. App Design • Initial screen shown upon startup • If connection fails, user will see an error • If it succeeds…

22. User will be taken to screen showing BroBot’s field of vision • When his sight is aligned properly, press the button to start the item watching software • This button will be replaced with a “Stop Watching” button, or a “Silence Alarm” button if it is tripped falsely.

23. Bluetooth connection Once Bluetooth connection is established, app opens an input thread and output thread Output thread stays idle and waits for signals to be sent to BroBot Input thread constantly looks for new pictures or information from BroBot Bluetooth’s input stream buffer reads in an array of bytes Combine these bytes and restore the original picture

24. Successes! • Bluetooth module to terminal communication • Items are bought • Item watching algorithm done • App GUI is done

25. Difficulties • Camera shipping • App Bluetooth Connection • Converting byte array into viewable JPEG • Enough time for testing for Item Watching • Finalize power

26. Original Budget

27. Current Spending Still $106.76 in our budget Need: Platform Battery PCB

28. Plans for success • App communicating with module by first week of February • Bluetooth Module communicating with ARM processor by mid February • Camera communications finished by end of February • Item watching program tested and working on a desktop by end of February • PCB designed and finished by early March • Full app development finished by mid March • Item watching program testing during March, finished by end of March • Full prototype testing during mid March and finished by early April

29. Progress Chart

30. Other Considerations • Siren implementation • Video stream

31. QUESTIONS?