HPCC Systems grew out of the need for LexisNexis to manage, sort, link, join and analyze billions of records within seconds. Designed by data scientists, HPCC Systems is an open source, data intensive supercomputer that has evolved for more than a decade, with enterprise customers who need to process large volumes of data in mission-critical 24/7 environments. The HPCC Systems technology has allowed the LexisNexis Risk Solutions business unit to grow to a $1.4 billion business in Big Data processing and analytics.
HPCC Systems will leverage the diverse customer base of Canonical, Comrise Consulting, Supermicro and L&T Infotech to serve the Asia-Pacific market and establish HPCC Systems as a premier resource for Big Data solutions. Comrise Consulting, the Asia-based subsidiary of Comrise Technology Inc, and L&T Infotech have established teams of HPCC Systems consultants with strong track-records in solving big data problems as well as possessing the ability to develop customer-focused solutions in ECL, the programming language designed for "Big Data" applications. Supermicro is a global leader in high-performance, high-efficiency, green server technology and Canonical is the commercial sponsor of the Ubuntu project and the leading provider of support services for Ubuntu deployments in the enterprise.
"We are pleased to expand our offerings to Asia as countries take action to address the needs of increasing demand for Big Data processing power from industries such as telecom, e-commerce, banking and e-government," said Flavio Villanustre, Vice President of Products and Infrastructure for HPCC Systems. "We are aware of the investments being made in data centers in Asia. Launching HPCC Systems and its ecosystem into Asia will help customers navigate options for addressing large data sets, reduce overall infrastructure costs, and improve business agility and data insight."
HPCC Systems can process, analyze, and find links and associations in high volumes of complex data significantly faster and more accurately than current technology systems. The platform scales linearly from tens to thousands of nodes handling petabytes of data and supporting millions of transactions per minute.
HPCC Systems is comprised of a single architecture, a consistent data-centric programming language, management tools and two processing platforms: the Thor Data Refinery Cluster and the Roxie Rapid Data Delivery Cluster. The Thor Data Refinery Cluster is responsible for ingesting vast amounts of data, transforming, linking and indexing that data, with parallel processing power spread across the nodes. The Roxie Rapid Data Delivery Cluster provides highly scalable, high-performance online query processing and data warehouse capabilities.
The core of the technology platform is the Enterprise Control Language (ECL), which is a declarative, data-centric programming language optimized for large-scale data management and query processing.