Data Modeling Articles
Render, a unified cloud services platform for engineering teams, is launching early access for its latest monorepository feature, available to active Render customers. The tool merges customer code into a single repository, eliminating the need to manage numerous smaller repositories simultaneously.
Posted August 19, 2022
A constant influx of new technologies and strategies to improve enterprise functions and growth can often lead to companies being overwhelmed with choice; which program is right for my needs? How do I get the most out of this application? Am I using the wrong platform for my workload?
Posted August 19, 2022
Today's enterprises need to be more agile to improve their customer's experience, respond to changes quickly, and have the freedom to innovate. As part of their digital transformation journey in the cloud, these businesses need the ability to connect more devices to their applications, faster than ever—from smartphones to connected cars, from manufacturing plants to smart devices in our homes. Therefore, these applications need to scale quickly to potentially millions of users, have global availability, manage large volumes of data, and provide ultra-fast response times for customers.
Posted August 19, 2022
Like Stephen Hawking's famous musings did for the laws of the universe, everything as a service (XaaS) is about to revolutionize the way you think about the world. Offering benefits like operational agility and efficiency, XaaS will be the business model for every equipment vendor in the future. And it will be big. According to Fortune Business Insights, the global XaaS market is projected to grow $2.3 trillion in 2028.
Posted August 18, 2022
As machine learning (ML) becomes the norm of the data industry, it's clear that its potential is limited within current data structures. Tabular data strategies have decreased in efficiency, as they lack the ability to acknowledge relationships interconnecting various data points. Data models create complexities as they become scaled by data scientists, constructed by different code languages for different data pipelines, yielding low productivity and high development times. Leaders in ML and data consumption look towards improving data science strategies to widely increase data value and data model efficiency.
Posted August 17, 2022
Arcion, a provider of a cloud-native, CDC-based data replication platform, is launching its latest product release to further extend their platform's capability to cater towards ease of use and increased performance for data migration and access. The launch continues to address the issue of data trapped in transactional data silos, like Oracle, as well as migration of that data into a variety of cloud data warehouses. The product's release comes after four years of development, adding dramatic depth to their products that help differentiate their service from anyone else on the market, according to the vendor.
Posted August 17, 2022
Omni, a business intelligence (BI) platform, is debuting its collaborative data technology to the public, backed by its $26.9 million in funding. The funding includes participation from enterprises like First Round and GV, as well as Series A funding led by Redpoint that yielded $17.5 million. Other participants to the funding round include Box Group, Quiet, Scribble, and angel investors. Omni's innovation as a consolidated BI platform differentiates its approach compared to other solutions on the market, according to the vendor.
Posted August 16, 2022
Hewlett Packard Enterprise company, Zerto, is announcing its integration with Amazon Web Services (AWS) ISV Workload Migration Partner Program, offering AWS workload migration drive and delivery, as well as expedited adoption of its cloud data management and protection solutions. As a platform, Zerto aims to eliminate risk in cloud data management and protection while adapting to the modernization of cloud adoption across private, public, and hybrid deployments.
Posted August 15, 2022
Airbyte, producers of an open-source data integration platform, is launching the company's Postgres source connector, now generally available. Postgres connector support by Airbyte allows users to efficiently migrate data from Postgres storage to other locations, improving analytic capabilities.
Posted August 12, 2022
The data lakehouse, data fabric, and data mesh, are no longer just dreams shared by analysts at conference presentations. A new survey of more than 200 IT leaders by Unisphere Research, a division of Information Today, Inc., finds considerable uptake of these modern data architectures. "The Move to Modern Data Architecture: 2022 Data Delivery and Consumption Patterns Survey," May 2022, was conducted in partnership with ChaosSearch and included input from directors/managers of IT, directors/managers of analytics, and data architects.
Posted August 11, 2022
In science fiction movies, the word "entity" pops up when discussing an as-yet-unseen but at least suspected alien presence, presumed evil (or sometimes evil presence, presumed alien). This entity is not named until half the cast has vanished, then we might hear, "It's Cthulhu's daughter and she's angry!" But not all entities are evil or angry.
Posted August 11, 2022
The challenge with modern supply chains is one of multiple pressures hitting all at once. These include pandemic-induced disruptions, cyber attacks targeting supply chains and the effect that financial and trade sanctions are having on Russia for its war in Ukraine. To be more resilient, many companies have opened the spigot on enterprise investment and technology innovation for supply chain modernization. But these efforts must be well-coordinated to be effective.
Posted August 11, 2022
These days, data managers have an embarrassment of riches when it comes to the platforming, storage, and provisioning of data and associated analytics applications. However, selecting the right environment for pressing business needs can be confusing and overwhelming. The key is understanding how to map the right technologies to the business problems or opportunities at hand.
Posted August 11, 2022
Assuring data quality should be one of the most important goals for IT professionals. This is truer today than it has ever been as organizations rely on data to power their AI and machine learning algorithms. Accurate, quality data is required if you want to make accurate decisions. And that is true, whether the data is being analyzed by a human or a computer algorithm.
Posted August 11, 2022
Accelerated digital transformation has been felt in a variety of ways across all industry sectors for the past 2 years. Digital infrastructure resiliency and agility are crucial in periods of uncertainty and disruption, which many organizations are experiencing with the confluence of disrupted supply chains, rising inflation, geopolitical instability, energy price spikes, the ongoing global pandemic, and climate change.
Posted August 10, 2022
Quali, a provider of Environments-as-a-Service infrastructure automation and management solutions, announced updates to its Torque platform for accelerated infrastructure delivery speeds, and increased cost accountability and management with limited risk. With enhanced end-to-end control plane capabilities for multi-cloud, laC, virtual, and container environments, Torque is able to prioritize and unify infrastructure orchestration for development operations practitioners within a single platform.
Posted August 10, 2022
Ask a data engineer why they got into the field, and they'll likely share how they looked forward to bringing concepts to life or solving complex challenges; or they wanted to share their expertise in a collaborative, agile environment; or they simply wanted to provide better visibility into the way products work for end users—and how it could be improved.
Posted August 03, 2022
CircleCI has announced its collaboration with GitLab Inc. in order to provide native support for customers seeking accessibility between GitLab Inc., The One DevOps Platform for software innovation, and CircleCI. As a result, customers will have access to tools available in all the aforementioned systems, allowing for greater choice and flexibility in software innovation processes.
Posted August 01, 2022
Model9, a provider of cloud data management for the IBM Z mainframe, announced it will participate in The Open Mainframe Project, an open source initiative with 20 programs and working groups that enable collaboration across the mainframe community to develop shared tool sets and resources.
Posted July 25, 2022
IBM is expanding its Power10 server line with the introduction of mid-range and scale-out systems to modernize, protect, and automate business applications and IT operations. The new Power10 servers combine performance, scalability, and flexibility with new pay-as-you-go consumption offerings for clients looking to deploy new services quickly across multiple environments.
Posted July 25, 2022
Pecan AI, a provider of AI-based predictive analytics for BI analysts and business teams, is adding one-click model deployment and integration with common CRMs, marketing automation, and other core business systems. Pecan's customers can now take immediate actions based on the highly accurate predictions for future churn, lifetime value, demand and other customer-conversion metrics generated by Pecan, according to the vendor.
Posted July 21, 2022
Oracle NetSuite is making updates to NetSuite Analytics Warehouse, helping organizations further enhance decision making and uncover new revenue streams. The latest updates boost the prebuilt data warehouse and analytics solution for NetSuite customers by making it easier for customers to blend relevant data sets and introducing new pre-built visualization capabilities.
Posted July 20, 2022
Oracle is introducing the Oracle Construction Intelligence Cloud Analytics platform, combing data from Oracle Smart Construction Platform applications to give owners and contractors a comprehensive understanding of performance throughout their operations. With this insight, organizations can quickly spot and correct issues and target ways to drive continuous improvement across project planning, construction, and asset operation, according to the vendor.
Posted July 20, 2022
Signal AI, a global External Intelligence company, is launching its External Intelligence Graph, a comprehensive view of an organization's external world built on real-time data and content. Signal AI's External Intelligence Graph maps the relationships between the things a modern organization needs to care about, like climate change, supply chain risk, or competitor intelligence, and highlights how an organization is "associated" to these important topics.
Posted July 12, 2022
IBM is acquiring Databand.ai, a leading provider of data observability software that helps organizations fix issues with their data, including errors, pipeline failures, and poor quality. The acquisition further strengthens IBM's software portfolio across data, AI, and automation to address the full spectrum of observability.
Posted July 11, 2022
The traditional approach of providing data access to applications via remote database servers is not ideal for microservices. And while SQL provides standard access to relational databases, GraphQL can be used with any type of database—and it returns JSON documents.
Posted July 07, 2022
Data modeling has always been a task that seems positioned in the middle of a white-water rapids with a paddle but no canoe. On one side of the data modeling rapids are the raging agilists who are demanding working software and decrying virtually all documentation. To this agilists' group, data modeling is often seen as too simple to matter. But at the same time, their implementations will miss standardization in naming or data model patterns. And results may be so far off course that major rework is unavoidable. Sadly, far too many agile practices have been set up to place things under the technical debt umbrella, when in reality those practices never allow the re-factoring closet door to be opened. Poor data models are "overcome" by creating ever more complex logic around the data in order to get to a more proper result, as developers learn what really needs to be accomplished along the way, maybe. The results may work but can be a nightmare to maintain.
Posted July 07, 2022
Kyligence is introducing Kyligence Zen, an intelligent metrics store platform that helps to align business goals and key metrics by automating data pipelines from data lakes or data warehouses to its multidimensional OLAP database to deliver metrics consistency and data trust in a cost-effective way.
Posted June 29, 2022
Rocket Software, a global technology leader that develops enterprise software for some of the world's largest companies, is releasing the next version of its PRO/JCL, a job control language (JCL) management solution that includes a new interface through VS Code1 extension, Enhanced Directed Execution to include options for sending PROCs and PARMLIBs to remote LPARS, and improved visibility for NODE and LPAR in the primary panel. These updates help mainframe data centers achieve and operate a JCL environment that is error-free, standardized, and optimized.
Posted June 27, 2022
NVIDIA announced it is a founding member of the Linux Foundation's Open Programmable Infrastructure (OPI) project, while making its NVIDIA DOCA networking software APIs widely available to foster innovation in the data center. Businesses are embracing open data centers, which require applications and services that are easily integrated with other solutions for simplified, lower-cost and sustainable management. Moving to open NVIDIA DOCA will help develop and nurture broad and vibrant DPU ecosystems and power unprecedented data center transformation.
Posted June 27, 2022
Continuent is releasing Tungsten Clustering and Tungsten Replicator Versions 7.0.1, introducing 52 new features and improvements, along with critical bug fixes.
Posted June 22, 2022
invenioLSI, a company with decades of experience as an SAP integrator offering cloud solutions, in partnership with RISE with SAP, is now building intelligent business operations for the public sector with advanced solutions like AI and robotics. invenioLSI's focus on diversifying their global AMS and cloud portfolio offers RISE with SAP for customers interested in migrating legacy or ERP applications to SAP cloud solutions.
Posted June 22, 2022
MongoDB unveiled its developer data platform vision with a series of new capabilities at its annual conference held at the Javits Center in New York City. With these announcements, MongoDB aims to help development teams to innovate faster by addressing a wider set of use cases, servicing more of the data lifecycle, optimizing for modern architectures, and implementing more sophisticated levels of data encryption.
Posted June 08, 2022
Data modeling is the process of defining datapoints and structures at a detailed or abstract level to communicate information about the data shape, content, and relationships to target audiences. Data models can be focused on a very specific universe of discourse or an entire enterprise's informational concerns. The final product for a data modeling exercise varies from a list of critical subject areas, an entity-relationship diagram (ERD) with or without details about attributes, or even a data definition language (DDL) script containing all the SQL commands to build a set of physical structures within some chosen database management system (DBMS).
Posted June 02, 2022
Rocket Software is introducing the Rocket MV BASIC for Visual Studio Code 1.6.0 extension, now available on the Visual Studio Code Marketplace. Rocket MV BASIC for VS Code (MVVS) allows BASIC developers to edit, compile, and now debug their BASIC applications in Microsoft Visual Studio Code.
Posted June 02, 2022
PlanetScale, the serverless database provider powered by MySQL and Vitess, is offering a number of new innovations that accelerate delivery of "The Future Database," with new Insights providing granular performance visibility, Portals for multi-region deployment, and Connect enabling expansive analytics platform integrations.
Posted June 02, 2022
Deepnote, an early-stage startup backed by Accel and Index Ventures, is emerging from beta with version 1.0, opening up to the general availability of collaborative data science notebooks to data teams worldwide. Since the company's Series A announcement in Jan 2022, Deepnote has added many features going into the 1.0 launch. Most notably is the addition of Deepnote Workspaces, which empowers data teams to organize and surface data projects, notebooks, and apps in one place.
Posted May 31, 2022
Apollo GraphQL is offering supergraph, a network of a company's data, microservices, and digital capabilities that empowers product and engineering teams to quickly create incredible experiences for their customers. A supergraph acts as a composition layer facilitating collaboration between backend data and services, and frontend apps and devices.
Posted May 26, 2022
TigerGraph, provider of a leading graph analytics platform, is introducing the TigerGraph ML (Machine Learning) Workbench—a powerful toolkit that enables data scientists to significantly improve ML model accuracy, shorten development cycles, and deliver more value to the business.
Posted May 25, 2022
Tamr, a cloud-native data mastering solution, is offering Tamr Enrich, a set of enrichment services built natively into the data mastering process using Tamr's patented human-guided machine learning. Tamr Enrich curates and actively manages external datasets and services, enabling customers to seamlessly embed trusted, high-quality external data insights to their data mastering pipelines for richer business.
Posted May 24, 2022
Matillion, provider of an enterprise cloud data integration platform, is releasing Matillion Data Loader 2.0, empowering enterprises to simplify data ingestion and accelerate insights with a cloud-native, no-code experience. Matillion Data Loader provides a single unified experience across batch loading and real-time, log-based change data capture (CDC) pipelines, and a consumption-based pricing model to help customers better manage data integration costs.
Posted May 24, 2022
Push Technology, a provider of real-time data streaming and messaging solutions, is releasing Diffusion 6.8, adding new features that include the Diffusion Gateway Framework, expanded data wrangling calculations and conditionals, and journal logging.
Posted May 20, 2022
Imply Data, founded by the original creators of Apache Druid, announced its $100 million Series D financing, which values the company at $1.1 billion. This investment round was led by Thoma Bravo with participation from OMERS Growth Equity, both new investors. Existing investors Bessemer Venture Funds, Andreessen Horowitz, and Khosla Ventures also participated in the financing.
Posted May 19, 2022
A common pattern in data lake and lakehouse design is structuring data into zones, with bronze, silver, and gold being typical labels. Each zone is suitable for different workloads and different consumers. For instance, machine learning algorithms typically process against bronze or silver, while analytic dashboards often query gold. This prompts the question: Which layer is best suited for applying data quality rules and actions? The answer: All of them.
Posted May 18, 2022
As the world becomes increasingly data-driven, AI/ML algorithms are being incorporated in most business applications. Historically, data in AI architectures was moved to a central location to perform both model training and inference. This centralized approach is becoming untenable due to cost, performance, and privacy reasons.
Posted May 18, 2022
Data consumers need data for BI and analytics to make business decisions. But for most organizations, their current data infrastructure isn't keeping up with demand. In a presentation at Data Summit 2022, titled "Building the Open Data Lakehouse," Mark Lyons, senior director, product management, Dremio, explained why more organizations are moving their analytics and BI to an open data lakehouse and how you can build a successful lakehouse strategy.
Posted May 18, 2022
Wednesday's Data Summit 2022 keynotes opened with Laura Sebastian-Coleman, data quality director, Prudential Financial, who discussed "Data Quality Deniers & What We Learn From Them." One of the biggest organizational obstacles to data quality management is basic pessimism about the possibility of managing the quality of data. This is due to lack of clarity—the goals and processes for data quality management have not been defined or have not been understood—and disbelief that the quality of data could be subject to control.
Posted May 18, 2022
At Data Summit 2022, Sudha Viswanathan, staff engineer, Wayfair, presented a talk titled, "Gaining Insights From Clickstream Data." Viswanathan explained that Wayfair's clickstream data refers to data that contains information about customer actions on the Wayfair site, such as what pages were viewed, the products that were clicked, what was added to the cart, which URL brought the customer to Wayfair. This helps Wayfair make data-driven decisions regarding revenue attribution for different marketing channels and improves traffic and test analysis and ad bidding.
Posted May 18, 2022