Open-Source Distributed Deterministic Device Control

1. Open-Source Distributed Deterministic Device Control Larry Doolittle Alex Ratti Bob Dalesio

2. Outline • Goals • 2 tier architecture • Cell by Cell distribution for the Storage Ring • Device Control • Conclusion

3. Create an Open-Source Platform for Integrated Device Control • Support fast orbit feedback at 10 KHz • Support event system with 1 nsec trigger resolution • Support event system with < 1 psec jitter • Support high performance platforms for FOFB ($1K) • Support low cost device controllers (<$200) • Support Machine Protection < 20 usec response time • Work with industry and other labs to produce solutions that work in this network.

4. Two Tier Device Control VME I/OC EPICS VME I/OC EPICS VME Interface VME Interface 100 MB ENet 100 MB ENet 100 MB ENet 100 MB ENet IN 100 MB ENet IN 2 GB ENet 2 GB ENet Timing System Timing System Timing System 100 MB ENet 100 MB ENet 100 MB ENet 100 MB ENet IN 100 MB ENet IN 2 GB ENet 2 GB ENet Device Controller Device Controller Device Controller 100 MB ENet Out 100 MB ENet Out 100 MB ENet Out 100 MB ENet Out Timing System Timing System Cell Controller Cell Controller RF Clock Distribution 45 MHz Fiducial Distribution 1 Hz … ….

5. 30 Cells each with 10 BPMs / 6 PSs BPM Controller BPM Controller BPM Controller BPM Controller BPM Controller BPM Controller VME I/OC EPICS VME Interface Prev Sector Cell Controller PS Controller PS Controller PS Controller PS Controller VME I/OC EPICS VME Interface Next Sector Cell Controller RF Clock Distribution 45 MHz +T0 + - Settling time on BPMs? +0.0 usecs - BPM to Compute Controller 384 bits = 64 bits * 6 BPMs 4.9 usecs = 384 bits over 100 MBit enet +4.9 usecs - Compute Controllers to each other 10,290 bits = 30 nodes * 384 bits 10.5 usecs = 10,290 bits over 2 GB enet +15.4 usecs – Compute local matrix 0 usecs + 15.4 usecs - Communcate t Power Supply Controllers 24 = 4 PS * 4 bytes each 3.5 usecs +18.9 usecs – loop complete settling time for magnets communicate diagnostic waveforms etc… 181.1 usecs +200 usecs – start again Fiducial Distribution 1 Hz VME I/OC EPICS VME Interface Cell Controller 100 MB ENET 2 GBit ENET

6. Device Controllers needed BPM Controller BPM Controller BPM Controller BPM Controller BPM Controller BPM Controller VME I/OC EPICS VME Interface Event Generator PS Controller PS Controller PS Controller PS Controller VME I/OC EPICS VME Interface Machine Protection RF Clock Distribution 45 MHz Fiducial Distribution 1 Hz Need to integrate LIbera and RF controllers Passes device inputs throughout network Need to include event data in this data stream Need to include Fast Orbit Feedback into Cell controllers Need to create/integrate power supply controllers Need to create/integrate Machine Protection VME I/OC EPICS VME Interface Fast Orbit Feedback 100 MB ENET 2 GBit ENET

7. Conclusion • A rough design is in place • The prototype cell controller is to be developed this year by Larry Doolittle along with NSLS II help • 2008 should demonstrate timing, communication throughput, and interface through PMC or PCI • 2009 should demonstrate device controllers and work with others to develop specific device controllers • We are looking for others interested in this platform to work with us.