end to end performance tuning
Download
Skip this Video
Download Presentation
End-to-End performance tuning

Loading in 2 Seconds...

play fullscreen
1 / 14

End-to-End performance tuning - PowerPoint PPT Presentation


  • 84 Views
  • Uploaded on

End-to-End performance tuning. Brian Davies Gridpp28 Manchester 2012. Areas of Improvements. FTS # Streams # Files Tx Timeout Preparing File Ratio Copy Mechanism G-U-C vs srmcp Asynchronous Ptp Access Method Synchronous vs Asynchronous calls Scheduled vs unscheduled connections.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' End-to-End performance tuning' - tavia


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
end to end performance tuning

End-to-End performance tuning

Brian Davies

Gridpp28

Manchester 2012

areas of improvements
Areas of Improvements

End-End performance tuning

  • FTS
    • # Streams
    • # Files
    • Tx Timeout
    • Preparing File Ratio
    • Copy Mechanism
      • G-U-C vs srmcp
      • Asynchronous Ptp
  • Access Method
    • Synchronous vs Asynchronous calls
    • Scheduled vs unscheduled connections.
    • Srm-less
    • Federated xrootd
      • Costs as well as benefits
  • TCP/ Window Tuning
  • Jumbo Frames
    • Some changes only see benefit in end site also make changes.
  • WN-WAN tuning
    • Tcp Window size
    • ‘Nat’ing
    • Xrootd configuration/optimisation.
other areas of optimisation
Other areas of optimisation??
  • Homogenous network
    • Mixing WN and Disk Servers can easily reduce network bandwidth
  • VM components
    • Splitting services
  • Databases
    • Type
    • Separate node
    • Internal operation
      • Cleansing
        • EG DPM requests DB
  • DNS Aliasing of multiple machines
  • Knowledge transfer

End-End performance tuning

who does optimisation and when is the benefit seen
Who does optimisation and when is the benefit seen.
  • Some optimisations can be unilateral.
      • FTS tuning, database improvements etc.
    • Others have to be co-ordinated
      • Jumbo Frames
  • Some optimisation benefits seen straight away.
    • Others require end host to make changes before benefit is seen.
  • An “improvement” at one site may degrade another site.
    • TCP tuning at QMUL/RHUL

End-End performance tuning

differences between t1 and t2s
Differences between T1 and T2s?

End-End performance tuning

(Some) Current T1 issues will/are problems that a “large” T2 will face in X* years time.

Problems a T2 are facing now may have been solved by (a) T1 Y* years ago.

A site should/does not need try to re-solve a problem(s) that another site(s)/tier has solved in the past.

*(Where X and Y are to be determined).

manchester network improvements
Manchester Network improvements
  • Transfers from Manc’ to T1s

End-End performance tuning

manchester network improvements1
Manchester network improvements
  • Reverse direction

End-End performance tuning

manchester network improvements2
Manchester Network improvements
  • Transfers from Manc’ to UK T2s

End-End performance tuning

manchester network improvements3
Manchester Network improvements
  • Transfers from Manc’ to Non UK T2s

End-End performance tuning

manchester network improvements4
Manchester Network improvements

End-End performance tuning

effect of streams on ralppd t1s
Effect of streams on RALPPD-T1s
  • Failing transfers required number of threads per transfer to have to be reduced to 1 per file transfer.`
    • Deemed more important to receive data from CERN than getting good rate for other sites
  • Mitigated overall throughput by increasing number of concurrent transfers.
    • Individual file transfer speed reduced and latency increased.
  • Once underlining issue re-solved returned to previous settings.

End-End performance tuning

effect of streams on t1s ralppd
Effect of streams on T1s-RALPPD

#Streams reduced/Increased

Effects transfers TO the site.

Effects Some T1s more than others

End-End performance tuning

effect of streams on ralppd t1s1
Effect of streams on RALPPD-T1s

No (known) changes in streams in reverse direction

End-End performance tuning

other areas of optimisation1
Other areas of optimisation??
  • “In the wiki”
    • But where?
      • Which wiki?
  • ????

End-End performance tuning

ad