![HIRO image](/files/live/sites/vicor/files/images/resources-library/podcasts/Vicor-podcast-HIRO-medium.jpg?t=767)
HIRO pushes Europe to the edge with high-performance microdata centers
From supporting brain surgery to driving smart factories while saving power—HIRO is driving Europe to the edge with innovative computing concepts
The promise of edge computing is being delivered by HIRO-MicroDataCenters. Not only are they impacting healthcare, education and smart-city applications, they are offering a solution that is a viable alternative to traditional cloud computing. HIRO uses 48VDC power distribution and high-density, high-efficiency power modules from Vicor.
Edge computing refers to the production and consumption of data at the edge of the internet. There, engineers are busy connecting groups of things, and even complete network environments, and equipping them with sensing, data and AI-processing capabilities. Data flows across the entire network landscape and Edge computing allows this data to be monetized, increasingly through AI-based services that are creating a new data economy.
AI-based edge data center services can best be situated at locations where the majority of data is being processed and/or consumed. As a result, the predicted growth of edge computing was twice that of cloud computing through 2023, with a projected compound annual growth rate (CAGR) of 37.9%. Here are examples of the estimated divide between local edge device/edge-data center processing and distant cloud processing:
Edge data centers are built in different localities, each with its own requirements in terms of latency, security and types of service (Figure 1). We are developing innovative Edge Micro Data Centers (EMDC’s) that can be installed at the on-premise edge and network edge, and are optimized for the growing range of edge applications mentioned earlier and complement larger scale off-premise edge data centers. We call this infrastructure Powerful Edge as a Service (PEaaS) and is based on four technology pillars:
Figure 1: The edge data center landscape (HIRO 2023).
Let’s compare hyperscale and distant cloud providers with innovative edge cloud providers such as HIRO-MicroDataCenters. Distant cloud providers offer low threshold, low cost experimentation to customers, going through digital transformation and adopting microservices on virtualized IT equipment.
However, once a customer starts scaling up their applications and data volumes and implements increasingly more complex applications – or defines criteria such as availability, latency and security – costs tend to rise very quickly. At that point the customer has invested substantially in understanding and optimizing the proprietary service structure of this cloud provider, that migrating to another cloud provider has become less attractive. More recently, in order to capture the edge computing market and strengthen the customer lock-in, the large cloud service providers started offering on-premise solutions.
Hardware innovation and the omnipresence of the open-source software community enabled us to offer PEaaS as a cost efficient option for enterprises that require a fast turn-around time with large data volumes. PEaaS allows the customer to adopt an ‘edge first strategy’ meaning, cost-efficiently processes the majority of all the data and AI on-premise, and on top of that, where needed, freely migrate applications and data across off-premise cloud providers.
Similar to hyperscale cloud services, PEaaS also has a low financial entry threshold. The difference is that, as customers begin scaling their applications and data volume, the costs are transparent and can easily be extrapolated from the point of entry-level set-up. This means that early cloud adopters that scaled their cloud workloads, only to experience fast rising costs and the pain of vendor lock-in, are now able to better reassess their cloud strategies. Given the benefits, many have concluded that they want an edge-first alternative that will give them more predictability and control over their cloud costs, which can save millions on an annual basis.
The most challenging EMDC applications will have big data and AI feeding into decision support systems that are directly affecting human life. At HIRO, we currently are working on two healthcare demonstration projects. The first uses genomic and health data analytics to feed AI models used in decision support systems for cardiovascular healthcare, including an AI model that can be used to predict when a patient might experience a stroke. The second project uses MRI data and real-time ultrasound data to create augmented imaging for surgeons while they perform brain surgery. Both projects promise higher and faster accuracy in professional decision making in order to save human lives and reduce suffering.
Let’s zoom out a bit to address data center power efficiency. The data center industry has pledged to become carbon neutral by 2030. This is necessary because global data center energy consumption of 460TWh accounted for two percent of all global electricity usage in 2022. By 2026, that is expected to rise to somewhere between 650TWh and 1,050TWh – an increase equivalent to the entire power consumption of Sweden at the lowest end of the scale, and Germany at the highest.
Figure 2: Data center energy consumption.
The data center industry invests in improving their Power Utilization Efficiency (PUE) through (Figure 2): -Raising utilization levels and efficiency of IT equipment, -More efficient cooling technologies, -Improved power conditioning. While this brings down the PUE of hyperscale data centers to PUE 1.2, the reality is that the efficiency improvements of the average data center over the past four to eight years have flattened out to PUE 1.58. Even worse today’s smaller edge data centers are very energy inefficient, with a PUE rating of 2.0 or more. Since in many cases, the energy footprint of a small on-premise data center is relatively small compared to the overall energy consumption of the enterprise, there is no incentive to improve edge data center PUE ratings.
With edge computing CAGR forecasted to grow twice as fast as cloud computing, HIRO has invested heavily to close the power differential between cloud and edge data centers by developing their EMDCs. To name a few of our innovations, we are using; - Small form factor industry standard PCB’s and state of the art energy conversion modules to minimize the power losses , -AI algorithms to optimize our services and hardware utilization levels, -Cooling technology with a 1.03 PUE rating that even far exceeds hyperscale data centers.
To achieve this milestone, HIRO partnered with leading researchers and technology providers to overcome the many limitations of current PEaaS-based hardware and software technologies.
HIRO EMDCs, for example, deliver highly compact and efficient power conversion using hardware that runs from 48VDC power distribution, instead of 12VDC. Using high-density, high-efficiency power modules from Vicor Corporation, this higher voltage reduces I2R losses across the power delivery network and enables solid-state, thermally adept, compact, energy-efficient EMDC designs. With their flexible cooling options, Vicor power modules also offer excellent volumetric power density, which lends itself to renewable energy opportunities.
The edge computing market is predicted to be bigger than the cloud computing market because it delivers a faster (middle layer) relay for data that enables mission-critical, real-time responses in devices and systems. By harnessing AI without incurring a significant power penalty, edge computing is supporting AI natively where intelligent decisions are facilitated, instead of relying on the cloud.
This article was originally published by Power systems Design.
HIRO pushes Europe to the edge with high-performance microdata centers
From supporting brain surgery to driving smart factories while saving power—HIRO is driving Europe to the edge with innovative computing concepts
Defining the future of edge computing using micro data centers
The promise of edge computing is being delivered by HIRO. Using Vicor power modules healthcare, education and AI applications are having impact in Europe
Tackling power challenges of genAI data centers
AI training requirements demand a new approach to power distribution to enable peak performance. Vicor Vertical Power Delivery is the optimal approach
Vicor presented at high-efficiency power supply and WBG technology application seminar
High-efficiency power supply and WBG technology application seminar