Community Research and Development Information Service - CORDIS

H2020

Bright Beyond HPC Report Summary

Project ID: 711315

Periodic Reporting for period 1 - Bright Beyond HPC (Cluster Managementbeyond High Performance Computing)

Reporting period: 2016-02-01 to 2016-10-31

Summary of the context and overall objectives of the project

The overall objective of the “Bright Beyond HPC” project is to solve the Cluster Management problem in the High Performance Computing (HPC), Big Data and Private Cloud Computing markets by developing and bringing to market readiness Bright OpenStack & Bright Cluster Manager for Big Data.

The Bright beyond HPC project concerns the further development and scaling up of Bright Cluster Manager beyond High Performance Computing (HPC). Bright Computing is developing in the project advanced functionalities in the areas of Big Data and Cloud computing. These enhancements enable Bright Computing to expand its market position significantly and the technology enables the market to benefit, in an ease-of-use manner, from Cluster Management.

The overall specific objectives of the “Bright Beyond HPC” project are:

Great Technology:
- Extension to Big Data and OpenStack
- ease-of-use application
Great Scaling Up Potential:
- Disproportionate growth for Bright, Computing (Market Replication)
- Meets future Market Demands
Great Market Potential:
- Seamless introduction into the existing HPC market of Bright Computing
Enables disruption of new markets
-Great Enabler
- More efficient and widespread use of cluster computing
- HPC, Big Data and Cloud working together to solve societal challenges

Work performed from the beginning of the project to the end of the period covered by the report and main results achieved so far

The main body of the work went into the Deliverable D4.1. Next gen Bright Cluster Manager HPC 7.3. that is publically available.The new software produced and described in this deliverable is available for download for customers from the Bright Computing portal. It is also possible to get an evaluation version. The new features for Bright Cluster Manager HPC 7.3 developed are briefly described in the deliverable document. They cover different technical areas developed by different technical work packages.

The Milestone that relates to this deliverable is “M1 Bright Beyond HPC 7.3”. This milestone was reached with the announcement of “Bright Computing Releases Version 7.3 of Bright Cluster Manager™ and Bright OpenStack™” on August 3, 2016.

The main new features developed include support for Amazon Web Services (AWS) integration; several extensions related to Apache Hadoop and Hadoop tools; security and support for containers. AWS integration and security improvements are an important step towards full Cloud computing support including OpenStack. Apache Hadoop and related tool improvements are important for the Big Data market.

New hardware that came on the market, most notably Intel Omni-Path, is now also supported. Intel Omni-Path is a new fast cluster interconnect technology.

Container support was originally planned for the next release. However the popularity of container technology is rising fast, so we decided to include already some features in this release.

The new D4.1. Next gen Bright Cluster Manager HPC 7.3. software release is supported by a wide range of communication activities to inform both potential users in new markets and existing Bright customers.

The project has also worked on new features that will be part of upcoming releases of Bright Cluster Manager.

Progress beyond the state of the art and expected potential impact (including the socio-economic impact and the wider societal implications of the project so far)

The project has made great progress towards reaching the project objectives, more specifically:

Great Technology
Work on ”Extension to Big Data and OpenStack” has been done and reported in deliverable D4.1. As a result Bright Cluster Manager now has been extended with complete Hadoop management capabilities. Also several support for several additional Hadoop components has been included. Hadoop is an important Big Data middleware and supporting with complete Hadoop management capabilities is an important step towards the objective.

The OpenStack work includes restructuring of the Cloud Manager Daemon, implementing AWS (Amazon Web Services) cloud bursting facilities, and simplified configuration and image management. This are all important steps towards full OpenStack support of Bright Cluster Manager.

Great Scaling Up Potential
The new release of Bright Cluster Manager 7.3 enables a step forward to reaching “Disproportionate growth for Bright, Computing (Market Replication)”. This has been reinforced by work by specific work in WP3 on marketing, communication and new collaborations with large system integrators. The new release also helps on “Meeting future Market demands.”

Great Market Potential
The extensions for Big Data and Cloud computing in Bright Cluster Manager introduced in 7.3 can immediately be used by both existing and potential customers in Bright’s existing market, the HPC market. Hence the work done in the project this far is a step towards reaching “Seamless introduction into the existing HPC market of Bright Computing”.
The integration work combining HPC, Cloud, and Big Data technology enables disruption of new markets for Bright Computing: the Big Data and Cloud computing markets.

Great Enabler
More efficient cluster computing: Already over 60 customers have installed Bright Cluster Manager 7.3 and another 40 have it under evaluation showing. Especially existing customers moving to 7.3. do so because it brings them a more efficient way of managing their clusters. The large number of evaluation versions show Bright Cluster Manager 7.3 helps to spread cluster computing to new markets.

Thanks to Bright Cluster Manager 7.3, HPC, Big Data and Cloud are now working together to solve societal challenges. Several large societal challenges, such as improvements in the medical area that need advanced bioinformatics, or climate related research, require Big Data captured and collected by many instruments and sensors, stored locally and in the Cloud. Complex analysis often involves Cloud based analysis and HPC modelling. Bright Cluster Manager has provided an integrated environment where these three things work together. The list of Bright customers show there are many academic organisations that are tackling these societal challenges.

Related information

Record Number: 195026 / Last updated on: 2017-02-20
Follow us on: RSS Facebook Twitter YouTube Managed by the EU Publications Office Top