Multinational chipmaker giant Intel Corporation recently announced its partnership with Databricks and the University of California Berkeley's AMPLab to advance the Apache Spark technology for the chipmaker's systems.

Databricks, a company established in 2013, developed the Apache Spark; a technology that helps clients with cloud based big data processing using Spark.

Like Us on Facebook

Spark is a popular open source big data processing engine with the ability to access data in a variety of sources such as HBase, HDFS, and Cassandra.

Databricks said it will be working with Intel to optimize Spark's real-time analytic capabilities for the chipmaker's architecture platform.

"Open source is undoubtedly the future of technological innovation and big data tools and processing are at the forefront of that wave," said Ion Stoica, CEO of Databricks.

"Our collaboration with Intel will bring the unified Spark ecosystem to businesses of all sizes with new levels of analytic capabilities, real-time benefits and simplicity."

Big data is term for large and complex collections of data which are too difficult to process using traditional methods.

"As more and more connected devices, including sensors, are introduced to the market, big data sets are growing exponentially every year, making processing and analyzing this data a more complex task," said Michael Greene, Intel's vice president of software and services group and general manager of system technologies and optimization.

"To find new trends and strong patterns from large, complex data sets, a strong analytics foundation is needed." Greene continued.

"Our work with Databricks to advance these analytics capabilities on Intel architecture by utilizing the rich capabilities of Spark will help our customers dive deeper into their data and derive real-time insights and benefits in the cloud."

TagsIntel, Databricks, Univeristy of California Berkeley, AMPLab, Apache Spark, Spark, Big Data, Big Data Processing Engine