Running Analytics on OpenShift with Daikon

For over a decade, Red Hat has been a strong contributor to the high performance computing and big data analytics evolution.  Whether it was the innovations in messaging from AMQP, the orchestration and scheduling in HTCondor, the realtime interrupts in MRG, cloud storage integrations in Hadoop, or the provisioning intelligence in OpenStack Sahara, Red Hat has been investing in solving the challenges that large enterprises face in our global economy.  

Red Hat has been a trusted partner to industries with real big data needs such as Oil and Gas, Aeronautics, Finance, Healthcare, Retail, Media, and Government longer than many companies have been in business.

It is from that past and those learned experiences that we forged a new initiative codenamed Daikon.  A project that will bring the benefits of big data analytics to more people by lowering cost of ownership and accelerating ease of use.  As we solve these problems, the resulting solution will continue to focus on offering the performance, elasticity, and intelligence that are the hallmark of cloud analytics.  

Daikon moves business analytics from siloed business intelligence applications to embedded analytics within the context of applications you use everyday so you can work smarter.

spark

 

At its core, Daikon leverages the Apache Spark open source project. By combining that engine with RHEL (Red Hat Enterprise Linux) containers running on OpenShift, we have been able to take great advantage of Kubernetes orchestration. All while merging those features into an application platform that fits the needs of a line of business looking to capitalize on analytics.

This application down view of analytics is refreshing in a market that traditionally starts from the data and moves up to the application.  The architecture focuses the attention on the consumption of the analytics by people who need them the most.

Seamlessly integrated with Red Hat JBoss Middleware, customers will be able to incorporate big data analytics with in-memory data grids, messaging, Java EE applications, Camel end-points, business process management and rules engines, and data virtualization. Or leverage an entire catalog of popular runtimes and application frameworks such as Tomcat, PHP, node.js, Ruby, Python, Perl, .NET, MySQL, Postgres, and MongoDB.

OpenShift allows users to produce simple, multi-tier applications and complex microservice topologies to transform big data analytics into something more people will be able to use to make everyday decisions.

With big data comes a need to pay attention to storage. The Red Hat Storage team has containerized GlusterFS and brought it to the Kubernetes platform through OpenShift. Datacenter architects no longer need to sacrifice data proximity and mobility when selecting a containerized application platform.

This hyper-converged pattern allows Daikon to consume data at line rates needed to get the most out of a data driven decision while keeping data governance in sight.

gluster

Through the leadership of Scott McClellan and Matthew Farrellee, Daikon is taking off at Red Hat. Their team of data scientists and upstream Spark contributors are going to unleash some of the most important capabilities on OpenShift.

Built on top of Docker and Kubernetes, OpenShift will allow a user to simply choose they want to take a data source, get a Spark cluster, run through a message bus, iterate and transform the data, and then merge or display analytics through any runtime or application framework they require across any application deployment pattern they desire. All via linux containers across a multi-tenant platform from a one-click catalog of templates.

Come join us at the Red Hat Summit in San Francisco this June to find out more. OpenShift has long supported feeds from data lakes and standard big data integrations. Daikon adds to that in a dramatic way. It improves upon the fragmented solutions many have turned to in the past in order to build intelligence into applications.

This combination of technologies represents a true shift in the market that can offer you an advantage. Let OpenShift show you how.

Stay tuned for more exciting updates and details about Daikon!

Categories
JBoss, News
Tags
, , ,
Comments are closed.