Qubole, the cloud big data-as-a-service company, is teaming up with Snowflake Computing, a data warehouse built for the cloud, enabling organizations to use Apache Spark in Qubole with data stored in Snowflake.
“Both companies recognize the complementary nature of our respective cloud services,” said Jose Villacis, senior director of product marketing, Qubole. “What we’re trying to do is address the full spectrum of advanced analytics and data science needs in a very tightly integrated cloud native way.”
With the new integration between cloud services, data teams are able to build, train, and put in production machine learning (ML) and artificial intelligence (AI) models in Spark using information stored in Snowflake.
The integration also enables data engineers to use Qubole to read and write data in Snowflake for advanced data preparation such as data wrangling and data augmentation to refine existing Snowflake data sets.
Qubole provides an enterprise cloud data platform for all types of big data workloads. It enables organizations to operationalize data lakes through infrastructure automation and cloud optimizations for leading open source engines.
The new partnership automates the connection between Qubole and Snowflake, eliminating the complexity of manually configuring Spark and reducing the time to train and deploy ML and/or AI models with Snowflake data.
This integration also provides one-time, secure credential management between Qubole and Snowflake, and access to Snowflake data through Scala and Python via Qubole’s Dataframe API for Apache Spark.
Data scientists using different languages or libraries and data engineers who are in charge of the data and looking after assets along with broader users will benefit from this, according to Villacis.
“Whether they access information through Qubole or through Snowflake through different end user tools, they are going to have the benefits of richer and more insightful information,” Villacis said.
The integration of Snowflake and Qubole is immediately available as a feature enhancement to Qubole Data Service, Enterprise Edition.
For more information, visit www.qubole.com.