Data Warehousing Articles
The big data world is changing in ways never seen before, particularly when it comes to bringing data together and into situations where it can be actionable for the business. The challenge faced by all enterprises—large and small—is being able to discover, identify, and bring the data needed to build products, deliver services, and understand customers. Data integration itself has been a practice—and challenge—for decades. Now, however, new tools and processes are enabling new ways of bringing enterprises to a state in which it can support sophisticated applications such as artificial intelligence, machine learning, and the Internet of Things.
Posted September 27, 2022
HEAVY.AI, an innovator in advanced analytics, is introducing HeavyRF, an extension of the company's deep analytics platform that uses NVIDIA Omniverse to create digital twins that help telco network operators speed deployments of wireless networks.
Posted September 27, 2022
DBTA recently held a webinar titled, "How Cisco Provides World-Class Technology Conference Experiences Using Automation, Programmability, Python, InfluxDB and Grafana," featuring speaker Jason Davis, distinguished services engineer for DevNet at Cisco Systems, to discuss the precise approaches taken by Cisco during CiscoLive events that improve network performance, availability, resiliency, and observability through automation.
Posted September 26, 2022
Modern applications require databases that can constantly adapt to their real-time needs, introducing a variety of complexities when it comes to selecting the right database for the job. The era of the one-size-fits-all approach by employing a singular database is no longer viable; databases crafted for the specific demands of applications are the present—and future—of effective application development and maintenance. AWS Databases, which are purpose-built for a variety of application needs, are the solution amid complexity.
Posted September 22, 2022
Kyndryl, provider of managed IT services, is unveiling Kyndryl Bridge as the latest in Kyndryl's digital integration initiatives. Through real-time, AI-powered analytics and insights for enterprise IT estates, Kyndryl Bridge enables advanced customization and control over mission critical operations. The aim for the platform is to offer enhanced visibility within an organization's operations to prevent potential issues and act on them before they trickle down to affect business operations. Further, the enterprise aims to provide enhanced observability and analytics for modernizing enterprise functions, positioning businesses to be more competitive in a quickly evolving market.
Posted September 21, 2022
Global provider of modern data integration, Fivetran, is debuting the availability of its Metadata API for advanced data tracking within Fivetran-managed pipelines. Data access control is key to Fivetran's latest API, tracking in-flight data from source to target to provide deep insights regarding governance and observability tool employment—allowing users to know who is accessing what data.
Posted September 21, 2022
Relational databases, once the epitome of data management technology, are becoming increasingly archaic as single servers lack the nuance to support the large quantities of data generated by modern enterprises. NoSQL databases offer a solution to legacy database architectures, offering scalable, consistent performance—but how do you migrate such large quantities of data without overcomplicating a new architecture?
Posted September 19, 2022
Open source cloud data platform company, Aiven, is unveiling its beta launch of Aiven for ClickHouse, initially debuted at Uptime—the company's first annual developer conference. The beta iteration of Aiven for ClickHouse introduces the enterprise to the cloud data warehousing market, allowing for accelerated open source columnar database access for Aiven customers. Users seeking to employ high-performance analytics for critical business insights will have Aiven ClickHouse's fully managed cloud data warehouse in their Aiven toolbelt.
Posted September 19, 2022
Data has only become more important as organizations look ahead to what a post-pandemic world could look like. Some of the new approaches being embraced to help drive greater benefit from data are DevOps and DataOps, data quality and governance initiatives, hybrid and multi-cloud architectures, IoT and edge computing, and a range of next-gen databases.
Posted September 14, 2022
Google recently announced their "Simplicity Sprint" initiative, which focuses on improving efficiencies within their workforce during this uncertain economic environment impacted by the ongoing pandemic, supply chain issues, the war in Ukraine, inflation, and the Great Resignation. However, simplifying and creating a more productive workforce is about more than improving focus, it's about uncovering and solving for increased complexity, brought on by an explosion of data, digital transformation initiatives, and the new reality of hybrid work. It is important for businesses and leaders to understand where these complexities are and what the key drivers are before redefining a new strategy to reduce business complexity.
Posted September 14, 2022
Within the realm of data science, deep learning frameworks are predominantly delivered via software found in the Python ecosystem. When looking at the options in the space, it may appear to some as a battle for supremacy, or for one to reign supreme, but the reality is that for a variety of reasons people have their favorites. Calling this a "war" is perhaps being a bit overdramatic.
Posted September 13, 2022
The company behind vendor-neutral unstructured data management, Datadobi, is debuting its latest release of StorageMAP, consisting of a variety of improvements particularly targeting orphaned data. StorageMAP, Datadobi's multi-vendor, multi-cloud data management platform, is a streamlined approach to unstructured data management to declutter and organize an enterprise's data storage. The 6.2 release for StorageMAP tackles orphan data's effect on enterprise resources, enabling IT teams to lower cost, carbon footprint, and risk.
Posted September 13, 2022
Collaboration between MariaDB Corporation, provider of pluggable, propose-built storage engines for specialized workloads, and Qlik, an enterprise focused on offering real-time data integration and analytics solutions, ushers in efficient data migrations with Qlik's data integration platform from legacy database architectures to MariaDB's database solutions. Migration destinations such as MariaDB Enterprise Server, MariaDB Xpand distributed SQL database, or MariaDB SkySQL cloud database service are available for workloads locked in legacy database sources, such as Oracle or Microsoft SQL Server.
Posted September 09, 2022
Alation Inc., a provider of enterprise data intelligence solutions, is launching the Alation Cloud Service for Snowflake, offering departments and organizations of all sizes to start cataloging data on Snowflake's platform. The new offering, launched in partnership with Snowflake, makes data governance easy and accessible, enabling organizations to start small, flexibly expand by adding data connectors, users, and data objects, and support use cases like cloud data migration for less than $100k, according to the vendors.
Posted September 09, 2022
Data observability is a relatively new discipline in the fields of data engineering and data management. While many are familiar with the longstanding concepts of observability and monitoring in enterprise IT networks and infrastructure, data observability has only really come into the spotlight in the last two years. However, it has managed to turn a lot of heads in that short time.
Posted September 08, 2022
In building a logical data model, some entities are considered strong, other entities are considered weak. Strong entities are the most foundational elements within a nascent Entity-Relationship Diagram (ERD) and comprise the list of objects that would likely come to mind first. Strong entities are independent in that they exist all on their own and can be created without having to meet any pre-conditions.
Posted September 08, 2022
Establishing agreed upon services levels for database applications is of the utmost importance for assuring that performance meets required criteria. Without pre-determined, negotiated service level agreements in place, database and application performance can become a never-ending game of blind man's bluff, where DBAs blindly and constantly seek an unspoken goal. Instead, active service level management should be the standard.
Posted September 08, 2022
Global, cloud-led, data-centric software company, NetApp, is announcing an expansion of their continued global alliance with VMware, Inc., a provider of multi-cloud services for all applications. As a partnership spanning over 20 years of alliance, the enterprises maintain their commitment towards mitigating cost, complexity, and risk of migrating and modernizing workloads in multi-cloud environments via various solutions and go-to-market strategies.
Posted September 07, 2022
NoSQL databases, also referred to as non-relational, continue to grow in popularity both on-premises and in the cloud. Of the 395 different database management systems tracked by site DB-engines, more than half are non-relational. These include key-value, document, graph, time series, and many more database models that fall into the NoSQL category. As more organizations modernize their applications or develop new applications from scratch, they adopt a microservices-based architecture that allows them to take advantage of the benefits of NoSQL databases
Posted September 06, 2022
Microsoft SQL Server is a relational database service that supports transactional processing and analytics. With a 30-plus year history, SQL Server has been a mainstay at many organizations. Now, however, open-source technologies like PostgreSQL, have become increasingly popular for customers. More and more customers are migrating to them from overpriced, restrictive commercial databases that lock them in. With an increasing array of choices, the same organizations are looking for lower cost options, including low-cost, cloud-native, fully managed database services like Amazon Aurora PostgreSQL-Compatible Edition, as this lowers total cost of ownership while providing the desired performance.
Posted September 06, 2022
VMware Inc., provider of multi-cloud services for all apps, and IBM, global hybrid cloud and AI, and business services provider, are announcing an expansion of their 20-plus year partnership with the aims of aiding global customers and partners modernize mission-critical workloads and accelerate time to value in hybrid cloud environments, according to the companies. The partnership expansion takes shape in IBM Consulting as a VMware GSI partner, as well as in jointly engineered solutions and development to add to their previous jointly developed technologies such as data encryption in motion and in use. With relevance spanning multiple industries such as financial services, healthcare, and the public sector, the ecosystem partnership invites solutions with reduced cost, complexity, and risk for cloud migration of mission-critical workloads.
Posted September 06, 2022
Leading platform for environments-as-a-service, Quali, is announcing its recent partnership with Interas Labs, a software engineering company that specializes in container orchestration, cloud-native architecture, microservices transformation, and GitOps. This collaboration improves engineering roadmap facilitation—with Interas Labs' optimizations and Quali's power in orchestration.
Posted August 30, 2022
Teradata, the connected multi-cloud data platform for enterprise analytics, is debuting VantageCloud Lake— the first product from Teradata that is built on a new, next-generation, cloud-native architecture. Leveraging the advantages of Teradata Vantage, renamed to VantageCloud Enterprise, VantageCloud Lake aims to bring a flexible, low-cost object store solution to its users.
Posted August 30, 2022
The developer behind the enterprise-scale, immutable archive solution that delivers breakthrough cost, margin, and sustainability benefits, Folio Photonics, is debuting breakthrough archival technology at low cost, high security, sustainability, and capacity. Folio's innovation, the multi-layer optical disc, redefines archival technology and leverages patented advancements in materials science for dynamic multi-layer read/write abilities. Its low-cost, paired with its high-capacity disk storage, presents a breakthrough both in materials science and data storage, according to the vendor.
Posted August 30, 2022
What is DevOps, and why is it so important for data management?As a relatively young concept, DevOps revolves around provisioning data quickly and synchronizing application data in database changes. It is easier said than done, however; challenges in data automation, slow components, application modernization, and team environments require solutions for optimal DevOps functionality.
Posted August 29, 2022
InfluxData, the enterprise behind time-series platform InfluxDB, is debuting new enhancements to its InfluxDB Cloud service. With new serverless capabilities, InfluxDB Cloud sees an acceleration of time-series data collection and processing, as well as an increase to storage capacity. The introduction of InfluxDB Native Collectors brings developers to the forefront with the ability to subscribe to, process, transform, and store real-time data from messaging and other public and private brokers and queues at the click of a button, according to the vendor. Native Collectors eliminate the need for additional software or new code while migrating data from third parties into the InfluxDB Cloud, increasing efficiency and decreasing resource waste.
Posted August 26, 2022
OpenText announced it has reached an agreement to acquire Micro Focus, implying an enterprise value of approximately $6.0 billion on a fully diluted basis. This merger would create one of the largest software and cloud businesses that enables digital transformations.
Posted August 26, 2022
Today's enterprises need to be more agile to improve their customer's experience, respond to changes quickly, and have the freedom to innovate. As part of their digital transformation journey in the cloud, these businesses need the ability to connect more devices to their applications, faster than ever—from smartphones to connected cars, from manufacturing plants to smart devices in our homes. Therefore, these applications need to scale quickly to potentially millions of users, have global availability, manage large volumes of data, and provide ultra-fast response times for customers.
Posted August 25, 2022
Cloudera, a hybrid data organization, is debuting its Cloudera Data Platform (CDP) One, an all-in-one data lakehouse SaaS, promising accelerated and accessible self-service analytics and exploratory data science on any data type. According to the company, CDP One delivers enterprise security and machine learning (ML) without requiring staff, resulting in lower TCO and reduced risk. CDP One is for customers who desire a low-code, self-service solution in conjunction with CDP One, which was not previously offered.
Posted August 25, 2022
Speed is at the forefront of technological innovation; users and customers of any online service have increasingly low tolerance for latency issues. Often, users will abandon a website if it takes too long to load—even if that load time is delayed by mere seconds. The natural response is to increase database performance; with those improvements, however, the costs quickly become detrimental.
Posted August 24, 2022
Deloitte announced a new asset roadmap and suite of cross-business integrated sustainability solution offerings, leveraging SAP technologies. Deloitte's new cross-business sustainability offerings and roadmap for SAP provide the knowledge and resources to help businesses remain resilient and move as fast as the speed of transformation.
Posted August 24, 2022
TDengine, an open-source data platform purpose-built for time-series data in IoT applications, is debuting TDengine 3.0, the latest update for the enterprise's time-series data management solution. As a database with caching, stream processing, and data subscription compiled into its open-source solution, TDengine 3.0 is now formatted with a cloud-native architecture for Kubernetes deployments, optimizing scale and simplicity of deployment and management. The release tackles major pain points for users with increasing amounts of data resulting from large-scale IoT deployments, according to the company.
Posted August 23, 2022
Pinecone, innovator of vector databases for building high-performance vector search applications, is debuting its latest enhancements to vector search that address ongoing challenges for the system. Issues such as determining type and size of index needed for data and performance needs, supporting high throughput, and scaling up indexes without interruption are no longer pain points for Pinecone users. These improvements take shape in features like vertical scaling, collections storage, and p2 pods for optimized vector search usage.
Posted August 23, 2022
BigPanda, Inc., an AIOps platform for IT data insights and action, is announcing an extension of its funding round, which was previously announced in January. The extension is a result of consumer demand for BigPanda, enabling an accumulation of new investments from current customers UBS and Wells Fargo; these investments are made through UBS Next, UBS's venture and innovation unit, and Wells Fargo Strategic Capital.
Posted August 23, 2022
Render, a unified cloud services platform for engineering teams, is launching early access for its latest monorepository feature, available to active Render customers. The tool merges customer code into a single repository, eliminating the need to manage numerous smaller repositories simultaneously.
Posted August 19, 2022
A constant influx of new technologies and strategies to improve enterprise functions and growth can often lead to companies being overwhelmed with choice; which program is right for my needs? How do I get the most out of this application? Am I using the wrong platform for my workload?
Posted August 19, 2022
MemVerge, provider of Big Memory software, is releasing two new software products, Memory Machine Cloud Edition and Memory Viewer. Memory Machine Cloud Edition software uses patented ZeroIO memory snapshot technology and cloud service orchestration to transparently checkpoint long-running applications and allow customers to safely use low-cost Spot Instances. Over time, Memory Machine Cloud Edition will form the basis of an infrastructure cloud service enabling applications to run across a multi-cloud environment.
Posted August 18, 2022
Like Stephen Hawking's famous musings did for the laws of the universe, everything as a service (XaaS) is about to revolutionize the way you think about the world. Offering benefits like operational agility and efficiency, XaaS will be the business model for every equipment vendor in the future. And it will be big. According to Fortune Business Insights, the global XaaS market is projected to grow $2.3 trillion in 2028.
Posted August 18, 2022
As machine learning (ML) becomes the norm of the data industry, it's clear that its potential is limited within current data structures. Tabular data strategies have decreased in efficiency, as they lack the ability to acknowledge relationships interconnecting various data points. Data models create complexities as they become scaled by data scientists, constructed by different code languages for different data pipelines, yielding low productivity and high development times. Leaders in ML and data consumption look towards improving data science strategies to widely increase data value and data model efficiency.
Posted August 17, 2022
Arcion, a provider of a cloud-native, CDC-based data replication platform, is launching its latest product release to further extend their platform's capability to cater towards ease of use and increased performance for data migration and access. The launch continues to address the issue of data trapped in transactional data silos, like Oracle, as well as migration of that data into a variety of cloud data warehouses. The product's release comes after four years of development, adding dramatic depth to their products that help differentiate their service from anyone else on the market, according to the vendor.
Posted August 17, 2022
Reltio, a cloud-native, SaaS Master Data Management (MDM) enterprise, is announcing the launch of the Reltio Connected Data Platform in the Microsoft Azure Marketplace, integrating Reltio streamlined deployment and management properties with the advantages of the Azure cloud platform. The Microsoft Azure Marketplace is an online store which offers cloud applications and services for use on Azure, which assures Reltio customers that the integration will yield the trust associated with industry giants in the market.
Posted August 16, 2022
Hewlett Packard Enterprise company, Zerto, is announcing its integration with Amazon Web Services (AWS) ISV Workload Migration Partner Program, offering AWS workload migration drive and delivery, as well as expedited adoption of its cloud data management and protection solutions. As a platform, Zerto aims to eliminate risk in cloud data management and protection while adapting to the modernization of cloud adoption across private, public, and hybrid deployments.
Posted August 15, 2022
Airbyte, producers of an open-source data integration platform, is launching the company's Postgres source connector, now generally available. Postgres connector support by Airbyte allows users to efficiently migrate data from Postgres storage to other locations, improving analytic capabilities.
Posted August 12, 2022
Thanks to significant innovation and recent disruption in the data management space, organizations are achieving unprecedented value from both internal and external data. Much emphasis has been placed on the importance of achieving digital transformation, yet thanks to these rich data assets, organizations are finding new ways to serve customers across both digital and physical boundaries.
Posted August 11, 2022
The data lakehouse, data fabric, and data mesh, are no longer just dreams shared by analysts at conference presentations. A new survey of more than 200 IT leaders by Unisphere Research, a division of Information Today, Inc., finds considerable uptake of these modern data architectures. "The Move to Modern Data Architecture: 2022 Data Delivery and Consumption Patterns Survey," May 2022, was conducted in partnership with ChaosSearch and included input from directors/managers of IT, directors/managers of analytics, and data architects.
Posted August 11, 2022
Working with databases causes friction. On one side, nontechnical managers want data pros to skip the jargon and clearly describe their needs. On the other side, data pros wish their managers had a deeper understanding of the tech involved. Nontechnical managers may think they need to understand the technology better and get into the weeds to close this inherent trust gap. But this isn't the case—managers are busy tracking resource allocations, Gantt charts, project plans, and punch lists. They must also fill open slots, upskill employees, and keep people from falling prey to the Great Resignation.
Posted August 11, 2022
In science fiction movies, the word "entity" pops up when discussing an as-yet-unseen but at least suspected alien presence, presumed evil (or sometimes evil presence, presumed alien). This entity is not named until half the cast has vanished, then we might hear, "It's Cthulhu's daughter and she's angry!" But not all entities are evil or angry.
Posted August 11, 2022
The challenge with modern supply chains is one of multiple pressures hitting all at once. These include pandemic-induced disruptions, cyber attacks targeting supply chains and the effect that financial and trade sanctions are having on Russia for its war in Ukraine. To be more resilient, many companies have opened the spigot on enterprise investment and technology innovation for supply chain modernization. But these efforts must be well-coordinated to be effective.
Posted August 11, 2022