1 / 10

New Features and Future Directions of LDM 6.4: Enhancing Power and Flexibility

LDM 6.4 introduces significant advancements in data flow management, including port independence for greater flexibility, and improved data request handling by signature to mitigate data loss during reconnections. Upstream filtering has been enhanced to allow user-defined data flows using product identifiers. The innovative receive-mode auto-shifting feature optimizes bandwidth usage by dynamically adjusting between PRIMARY and ALTERNATE feeds based on success rates. Future directions include potential protocol changes aimed at improving communication efficiencies, alongside immediate bug fixes and further development on the UDUNITS package.

oihane
Download Presentation

New Features and Future Directions of LDM 6.4: Enhancing Power and Flexibility

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Steven Emmerson New Features Future Directions LDM 6.4: Combining Power and Flexibility

  2. New Features in 6.4 • Port independence • Requests for data by signature • Upstream filtering • Receive-mode auto-shifting

  3. Port Independence • Before 6.4 • Must use 388 • Requires superuser privileges to install • Requires education of network administrators • 6.4 • May set default port at build-time • May override port at run-time • May specify upstream port REQUEST ANY .* idd.domain:388

  4. Requests for Data by Signature • Problem: Reconnection often causes data-loss in aggregated feeds because product creation-time determines request “from”-time • Solution: When reconnecting, use signature of last successfully-received data-product LDM-6 Desired product-class: 20050623154153.405 TS_ENDT {{ANY, “.*”},{NONE, SIG=”11719082928ccf26c433a556c0c8d8c8”}}

  5. Upstream Filtering • Pre-6.4 • No way to prevent downstream LDM from obtaining all data-products in a feedtype • Lack of user-definable feedtypes makes it difficult to restrict data flows • 6.4 • ALLOW-entry enhanced with OK-pattern and NOT-pattern: ALLOW IDS|DDPLUS \.com$ ^SAUS ^SAUS4 • Allows user-definable data-flows to be managed by product-identifier

  6. Pre-6.4 Receive-Modes • Static PRIMARY and ALTERNATE feeds means trading reliability for bandwidth • 2 PRIMARY feeds is reliable but doubles the bandwidth usage • PRIMARY + ALTERNATE feeds reduces bandwidth but is unreliable

  7. Receive-Mode Auto-Shifting in 6.4 • First feedtype/pattern REQUEST-entry is initially PRIMARY feed • All other REQUEST-s with same feedtype and pattern are initially ALTERNATE feeds • Downstream LDM automatically shifts between PRIMARY and ALTERNATE modes depending on insertion success-rate

  8. Future Directions • 6.4 is about as far as the LDM can go without changing the protocol (i.e., LDM 7) • Given a protocol change, how far should one go? • Eliminate RPC in favor of true peer-to-peer communication? • Use overlay networks? • Rewrite in C++? • For the short-term: • Deploy • Fix bugs • Work on UDUNITS package

More Related