Data Warehousing Articles
Ask a data engineer why they got into the field, and they'll likely share how they looked forward to bringing concepts to life or solving complex challenges; or they wanted to share their expertise in a collaborative, agile environment; or they simply wanted to provide better visibility into the way products work for end users—and how it could be improved.
Posted August 03, 2022
Kyligence's Intelligent Cloud OLAP Platform now offers support for Amazon EMR Serverless, a serverless option from Amazon Web Services (AWS) that makes it easier for data analysts and engineers to run open source big data analytics frameworks. Using automatic on-demand provisioning and scaling capabilities available through Amazon EMR Serverless, Kyligence Cloud cost effectively meets the changing processing requirements across all data volumes, according to the vendor.
Posted July 15, 2022
AI is delivering new benefits and efficiencies to organizations through greater automation capabilities, ease of use, and accessibility—across a variety of use cases. Spurred by the COVID-19 pandemic and a host of other compounding factors such as climate change and sustainability, supply chain delays, the Great Resignation, and the war in Ukraine, companies are scrambling to take advantage of what AI has to offer during this upheaval.
Posted July 13, 2022
Signal AI, a global External Intelligence company, is launching its External Intelligence Graph, a comprehensive view of an organization's external world built on real-time data and content. Signal AI's External Intelligence Graph maps the relationships between the things a modern organization needs to care about, like climate change, supply chain risk, or competitor intelligence, and highlights how an organization is "associated" to these important topics.
Posted July 12, 2022
To serve the data analytics and applications for business growth and operational needs, data lakes are being widely adopted as the data infrastructure because of their scalability and flexibility. Data lakes are strong at parking petabytes of data and production delivery as a result of their "schema-on-read" structure. But every coin has two sides. Data lakes, as a semantically flexible data store and bypassed governance efforts, have been seen as muddy swamps and inefficient in data management.
Posted July 11, 2022
The traditional approach of providing data access to applications via remote database servers is not ideal for microservices. And while SQL provides standard access to relational databases, GraphQL can be used with any type of database—and it returns JSON documents.
Posted July 07, 2022
A HealthCheck from Rocket MultiValue (MV) Professional Services can provide critical information clients need to get the most from their Rocket MV (Rocket UniVerse, Rocket UniData, Rocket D3) products. Expert consultants know how to isolate and remediate issues to get optimal system performance and help put an effective plan in place for optimization or growth.
Posted July 07, 2022
Object Management Group (OMG) announced Responsible Computing (RC), a new consortium comprised of technology innovators working together to address sustainable development goals. Responsible computing is a systemic approach aimed at addressing current and future challenges in computing, including sustainability, ethics, and professionalism, stemming from the belief that is needed to think about technology in terms of its impact on people and the planet.
Posted June 27, 2022
Splunk Inc., a data platform provider for security and observability, is offering new capabilities to power integrated security and observability on a shared data platform, helping organizations achieve end-to-end visibility, rapid time to investigation and action, and greater extensibility to solve data-centric challenges.
Posted June 23, 2022
When organizations move their SAP applications to a cloud provider, what they are really doing is placing their mission-critical application into someone else's hands—this exacerbates the need for more cybersecurity monitoring to ensure the provider is handling it with care. Beware, some cloud service providers offer a monitoring service, but the customer also needs to have a process in place to understand what activities are ongoing in the hosted SAP system.
Posted June 23, 2022
Snow Software, a provider of technology intelligence, and Anodot, the business monitoring company, are forming a new strategic partnership to help organizations solve the urgent challenge of managing rapidly growing and increasingly complex cloud costs. Snow and Anodot will bridge the disciplines of IT asset management (ITAM) and finance operations (FinOps) together to address evolving issues associated with cloud cost management.
Posted June 23, 2022
As we advance deeper into the digitally roaring 2020s, data executives and professionals are seeing change on a scale never seen before in their careers. A new generation of technologies that often build on previous solutions means new ways of working and ensuring performance for today's increasingly data-driven enterprises. We asked industry leaders for their views on what technology is enhancing enterprises' ability to compete on data.
Posted June 23, 2022
Traceable AI, a leading API security and observability company, is introducing an enhanced API Catalog solution, enabling organizations to overcome their challenges with API discovery and risk assessment.
Posted June 21, 2022
Aerospike, Inc., a real-time data platform provider, is introducing Aerospike SQL Powered by Starburst, enabling customers to run massively parallel, complex SQL queries on petabyte-scale data stored in the Aerospike real-time Data Platform. A hardened solution built on top of open-source Trino platform, the Aerospike SQL Powered by Starburst solution gives data analysts and data scientists a single point of access to federated data using existing SQL analytic tools such as Tableau, Qlik, Power BI, and others.
Posted June 16, 2022
BMC has announced the launch of the BMC Innovation Labs Preferred Partner Program, a collaborative co-innovation program built for, and with, BMC partners and customers. The program is focused on ideation and experimentation to design and ultimately commercialize modern technology solutions to support customers on their Autonomous Digital Enterprise journey. BMC partners can visit the BMC Innovation Labs Preferred Partner Program website to request consideration for the invitation-only program.
Posted June 13, 2022
Data archiving is an important aspect of data governance and data management. Not only does archiving help to reduce hardware and storage costs, but it is also an important aspect of long-term data retention and a key participant in regulatory compliance efforts. When long-term data retention is imposed on your data—anything more than a couple of years—then archiving it can be the most optimal solution.
Posted June 13, 2022
MariaDB Corporation and MindsDB, a provider of in-database machine learning, are partnering on a solution that makes machine learning predictions easy and accessible to cloud database users. By using MindsDB in SkySQL, MariaDB's fully managed cloud database service, data science and data engineering teams can increase their organization's predictive capabilities to plan for and address real-world business issues, according to the vendors.
Posted June 09, 2022
Oracle has announced that its deal to acquire Cerner Corp. will close on June 8, 2022. Cerner is a provider of digital information systems used within hospitals and health systems by medical professionals. Oracle previously announced on June 1 that all required antitrust approvals have been obtained for its proposed acquisition of Cerner, including European Commission clearance. Larry Ellison, Oracle's chairman of the board and chief technology officer, will outline Oracle's strategy to redefine the future of healthcare at a virtual event on June 9, 2022, at 3 p.m. CT.
Posted June 07, 2022
Lacework, the data-driven cloud security company, is introducing new agentless scanning for workloads, providing organizations with comprehensive and frictionless visibility into vulnerability risks across all active hosts, containers, and application language libraries in their environment.
Posted June 07, 2022
Coalesce, the data transformation company, is forming partnerships with Fivetran and Snowflake to make data teams more efficient and productive, delivering faster results than any other data transformation tool on the market. The partnership with Coalesce allows Snowflake customers to automate the data transformation process, cutting down on time and resources spent preparing data to get the most out of Snowflake. Without Coalesce, the process is manual and time consuming, according to the vendors.
Posted June 07, 2022
Cockroach Labs, the company behind CockroachDB, is introducing CockroachDB 22.1, delivering updates across the entire application lifecycle that empower developers and architects to accomplish more, with less effort.
Posted June 03, 2022
Rivery, the SaaS ELT, announced a new funding round of venture capital, receiving $30 million that will enable the company to expedite its growth across all teams in New York and Tel Aviv HQ including R&D, Product, and Sales, as well as expanding on EMEA where a London office has been launched to focus on the regional market.
Posted June 03, 2022
Broadcom Inc., a global technology provider that designs, develops, and supplies semiconductor and infrastructure software solutions, announced it is acquiring VMware, Inc., an innovator in enterprise software. Broadcom will acquire all of the outstanding shares of VMware in a cash-and-stock transaction that values VMware at approximately $61 billion, based on the closing price of Broadcom common stock on May 25, 2022. In addition, Broadcom will assume $8 billion of VMware net debt.
Posted June 02, 2022
There are so many new buzzwords lately, including the data lakehouse, data mesh, and data fabric, just to name a few. But what do all these terms mean, and how do they compare to a data warehouse? This presentation covers all of them in detail and explains the pros and cons of each, with suggested use cases so attendees can see what approach will really work best for their big data needs.
Posted June 02, 2022
Microsoft has recently released a powerful new DMV specifically to help with memory issues, sys.dm_os_out_of_memory_events. It is currently available in Azure SQL Database and Azure SQL Managed Instances. This DMV consolidates and simplifies telemetry from SQL Server ring buffers, applies heuristics, and provides a result set. The DMV stores a record for each out-of-memory (OOM) event that occurs within the database, providing details about the OOM root cause, the memory consumption of database engine components at that point in time, potential sources of memory leaks, and more.
Posted June 02, 2022
PlanetScale, the serverless database provider powered by MySQL and Vitess, is offering a number of new innovations that accelerate delivery of "The Future Database," with new Insights providing granular performance visibility, Portals for multi-region deployment, and Connect enabling expansive analytics platform integrations.
Posted June 02, 2022
Data Intensity recently announced its deepened commitment to accelerate and transform Oracle-powered workloads to Oracle Cloud Infrastructure (OCI), combining a strategic partnership with its own migration and lifecycle management portfolio of expert technical and functional support services.
Posted June 01, 2022
The coming decade is going to require a modern data warehouse to meet demanding new requirements for machine learning, data variety, and real-time analytics—while still satisfying the more traditional need for analysis of structured data at scale.
Posted June 01, 2022
Deepnote, an early-stage startup backed by Accel and Index Ventures, is emerging from beta with version 1.0, opening up to the general availability of collaborative data science notebooks to data teams worldwide. Since the company's Series A announcement in Jan 2022, Deepnote has added many features going into the 1.0 launch. Most notably is the addition of Deepnote Workspaces, which empowers data teams to organize and surface data projects, notebooks, and apps in one place.
Posted May 31, 2022
SAP is introducing new innovations that deliver business value for customers in four critical areas: supply chain resilience, sustainability, business process transformation, and no-code application development. The innovations announced will help SAP customers accelerate their transformation journey with cloud-based solutions that provide the end-to-end business process support customers most need, according to the vendor.
Posted May 25, 2022
Push Technology, a provider of real-time data streaming and messaging solutions, is releasing Diffusion 6.8, adding new features that include the Diffusion Gateway Framework, expanded data wrangling calculations and conditionals, and journal logging.
Posted May 20, 2022
Data consumers need data for BI and analytics to make business decisions. But for most organizations, their current data infrastructure isn't keeping up with demand. In a presentation at Data Summit 2022, titled "Building the Open Data Lakehouse," Mark Lyons, senior director, product management, Dremio, explained why more organizations are moving their analytics and BI to an open data lakehouse and how you can build a successful lakehouse strategy.
Posted May 18, 2022
No other subject seems to capture the attention of IT leaders right now like database migrations. If there were an IT theme for 2022, it would be: Enterprises migrate from legacy data warehouses to the cloud. And it is no longer just the "early adopters" but the entire customer base that is looking to make the move to cloud-based systems. Let's examine the three most common problems that hamper the execution of migration projects and what can be done to avert migration disasters.
Posted May 18, 2022
Thomas Hazel, founder/CTO, ChaosSearch, examined the tools and technologies to get more value from data and how to determine which ones are right for your organization in a Data Summit 2022 keynote. By stripping away data engineering complexity and lowering total cost of infrastructure ownership and maintenance, more and more organizations are unlocking the value of analytics at scale.
Posted May 17, 2022
Data is often described as "the new oil"—a valuable fuel flowing through organizations. But it is time to stop talking about data as the new oil and concentrate instead on acting on its true importance. This is the view of Doug Laney author of "Infonomics," who gave the opening keynote talk at Data Summit 2022 in Boston.
Posted May 17, 2022
Around 85% of analytics, big data, and AI projects will fail, despite massive investments of money. It's not new news, but it still reflects on how powerfully design affects speed, scale, and usage. At Data Summit 2022, Brian O'Neill, founder and principal, Designing for Analytics presented his session, "Technically Right, Effectively Wrong: How to Avoid Creating the ML or Analytics Application No Customer Wants to Use."
Posted May 17, 2022
The case for increased data automation is clear. "Data teams are spending significant amounts of time on service requests like infrastructure, user provisioning, and incident coordination and communication," said Tina Huang, CTO and founder of Transposit. "Teams today are often manually creating tickets, Slack channels, and Zoom meetings, plus communicating with stakeholders. Data teams must ensure internal customers using data have access to the data they need and real-time updates about interferences with that data." Other tasks ripe for automation include log parsing, correlation, permissions and access, and more.
Posted May 16, 2022