Translate

Tuesday 15 October 2013

HPC Using Vitual

Originally HPC was on supercomputers
Now on commodity
Premise is that virtual is the next step

HPC preconceptions
- lowers performance
- slow and unwieldy
- etc

VSphere for HPC
- DRS and Storage DRS to balance workload
- direct IO
- in v5.5 flash cache
- center tops for insights into performance and health

VCD
- disperate workloads
- resources
- security

Bitbrains - NL Hosting Company
- using VCD to provide HPC cloud service - Microsoft HPC
- Dell servers
- IB connectivity
- IB connectivity for storage too
- fast storage
- CD gives customer flexibility pay as you go and bursting
- virtual private clouds in a public cloud
Subaru case study
- video rendering using hpc grids on virtual private cloud within 40 secomds
- nodes deployed as per job requirements, then closed down when they have been idle for a period of time agreed with customer
Insurance Case Study
- risk data
- dedicated lines to 3 data centres
- terminal servers
- distributed file servers
- vms for compute
- performance so good that the customer re-ran theasr 12 months of risk calcs in 2 weeks
Optimization
- perf bios settings
- disable interrupt coalescing on esx
- optimizing job scheduling and app

Benefits claimed
- no hw to buy
- don't need hpc infra skills
- pay as you go
- immediately available, much faster set up
- easy to scale down

You need
- collaboration with customer
- optimized apps
- fastest storage and connectivity available
- good capacity management

Debate
- still skepticism as based on Microsoft HPC - audience seem to think Linux is a more 'serious' HPC environment
- audience would liked to have seen evidence of direct comparison between physical and virtual performance

Thoughts: interesting in the use of cloud for the agility of delivering short term HPC to multiple customers.  Session was billed as proving HPC peforms better on virtual but this was not really addressed except to claim that cheaper cloud based HPC means you can add more nodes to add performance at low cost.

No comments:

Post a Comment