Scientists, engineers and researchers are producing massive amounts of data in their quest to solve complex and interdisciplinary problems. But their efforts are hindered by poor data management. Data management issues include the number and size of data files and the time and difficulty of transferring large files between computers for storage and post processing. These issues often result in limited access, limited utility, and slow transfer of data.
Data Intensive Computing Environment (DICE)The DICE Program is actively addressing real-world data management challenges. DICE is a geographically distributed test bed connecting high performance computing centers through high-speed, real world networks. It provides a realistic working environment and platform to test and evaluate new and emerging data management technologies and solutions.
As Avetec’s HPC Research Division, the DICE team provides an independent, representative test environment comprised of geographically distributed sites located in HPC centers. DICE provides the platform to identify, test, evaluate and validate new and emerging technologies designed to enhance the use and management of HPC data. Each DICE site is comprised of representative technologies found in production HPC centers isolated in a self-contained development environment.
Click here for more information on DICE and DICE services.
The development of interconnect-based storage solutions, technology allowing distributed clusters and storage over a common wide area network infrastructure, is becoming an emerging solution for data archiving and storage needs that has been doubling every 14 to 16 months since 1997.
Avetec is focused on the evaluation of and the development of metrics for data storage and archiving over wide area networks. The number of interconnect technology products and the large number of combinations of implementations make it critical to have a systematic approach. This would include research and development of an improved software stack, re-examination of the protocols and the development of a set of best practices.
Avetec is currently evaluating wide area network solutions, including InfiniBand and 10 Gigabit using real world architectures at existing sites. By leveraging the existing Data Intensive Computing Environment (DICE) test-bed infrastructure, vendors and researchers are working together to develop solutions that will greatly advance performance and utilization of high-end computing resources.