Industry News Details

Red Hat, Cloudera try to bring big data up to post-COVID speed Posted on : Nov 20 - 2020

Many companies used to talk about speeding up development and delivery of digital services. Then COVID-19 disrupted traditional ways of doing business, and the talking turned action. But much of digital transformation involves notoriously time-consuming data processes, and now there’s more pressure than ever to speed them up.

Pain points around agility and time to value are top of mind for customers lately, according to Tom Deane (pictured, left), senior director of product management at Cloudera Inc. In many companies, a large number of staffers — data scientists, application developers, engineering and operations teams, for example — are needed to execute a single machine-learning or artificial-intelligence project. These teams badly need quicker provisioning and more streamlined processes.

Deane and Abhinav Joshi (pictured, right), senior product marketing manager for OpenShift at Red Hat Inc., spoke with Dave Vellante, host of theCUBE, SiliconANGLE Media’s livestreaming studio, during the KubeCon + CloudNativeCon NA event. They discussed best practices for speeding up data projects and Cloudera and Red Hat’s collaboration and recent announcements. (* Disclosure below.)

Containers spin up a three-minute data warehouse

MLOps — the application of DevOps practices to machine learning — is evolving in places like Kubeflow, a cloud-native community focused on easily deploying and managing an ML stack on Kubernetes. In fact, the use of containers (a virtualized method for running distributed applications) and Kubernetes is key to more efficient data-driven app development, according to Deane.

Containers provide the rapidly provisioned infrastructure needed work with data for real-world business demands. Combining them with a platform designed to cover the end-to-end data lifecycle gives companies a way to put plans into action in an agile manner, according to Joshi. Red Hat found the data analytics and AI capabilities that would pair well with its OpenShift container platform in the Cloudera Data Platform. View More