Data Modeling Articles
As many tools and platforms have evolved to solve niche problem areas, they are fairly disconnected, creating more confusion for data leaders to decide what tools and platforms are needed to support end-to-end business needs. In simple terms, XOps can be broken down to "X" related to data, infrastructure, business intelligence (BI), and machine learning (ML) models, and "Ops" is the automation via code. The individual component has existed for years, but the difference now is they are interconnected to drive agility and innovation by removing silos.
Posted January 05, 2022
Dealing with data warehouses, data marts, and even data lakes, can be awkward in an agile environment. While adding a single metric onto a dashboard can be very natural, no one builds a dimension table a few columns at a time. This awkwardness has caused many variants in how an agile methodology might be applied to one's analytics databases.
Posted January 03, 2022
The design of a schema in MongoDB is just as important as it is in RDBMS. Indeed, schema design can be even more complicated in MongoDB. At least in SQL databases, we have the "first normal form" representing the starting point for a well-designed first cut data model. In MongoDB, we have more choices, but as a consequence, we have more potential pitfalls.
Posted January 03, 2022
Over the past year, enterprise digital transformation efforts have accelerated dramatically with a substantial focus on not only how data is managed and stored, but how data is leveraged to deliver business insights. DataOps continues to gain a foothold at organizations hungry for speed, agility, and innovation. The adoption of machine learning and complementary technologies, such as knowledge graphs, is on the rise.
Posted December 20, 2021
Tellius, the AI-driven decision intelligence platform, is introducing Live Insights, a new capability for users to quickly generate powerful data analysis within their cloud data warehouses. This new feature leverages the compute power of cloud data platforms for automated generation of advanced insights without requiring data to be extracted from these systems, fueling faster, better decision making, according to the vendor.
Posted December 20, 2021
Vivanti—the enterprise technology consultancy delivering impactful cloud experiences and data-driven innovations with a client-first ethical framework—is officially launching in the United States. Headquartered in New York City, with locations in Manhattan and Washington DC, Vivanti offers advisory, consulting, and managed services across all major cloud platforms, including Snowflake, HashiCorp, Google Cloud, Amazon Web Services, Microsoft Azure, IBM Cloud, and more.
Posted December 17, 2021
Redgate Software, a provider of Database DevOps solutions, is joining other business software providers such as Microsoft, Sage, and Adobe, in moving to a subscription-first model. From January 2022, the majority of its product portfolio will be offered on a subscription-first basis, rather than solely under a perpetual license agreement.
Posted December 16, 2021
Sisense, providing an AI-driven platform for infusing analytics everywhere, is offering Sisense Notebooks, a new code-first functionality within Sisense Fusion Analytics that empowers data analysts with the tools they need to conduct advanced analysis using Structured Query Language (SQL) and Python.
Posted December 16, 2021
Enterprises walk a knife edge when it comes to digital transformation. They must scale their operations on the cloud, but somehow minimize complexity and disruptions. The discipline of cloud operations (CloudOps) aims to strike the right balance by intelligently provisioning resources, utilizing capacity, and mitigating issues-all with the help of cloud log analytics.
Posted December 16, 2021
Altair, the global leader converging simulation, HPC, and AI, is acquiring World Programming, a UK-based technology company specializing in data analytics software. World Programming's platform supports development and execution of multi-language software solutions leveraging popular languages used in data science including Python, R, and the SAS language in a single program.
Posted December 15, 2021
The Data Summit conference focuses on the business and technical aspects of Big Data, Data Management, DevOps, Data Management, AI, Machine Learning, and the ramifications of working in a data-driven environment.
Posted December 15, 2021
Sierra Digital, Inc., Houston-based specialists in digital transformation, is launching APPRISE, an Accelerated Productivity Platform designed to speed and automate SAP's signature digital transformation program called RISE. RISE delivers business transformation as a service in a unified package to help change the mindset of business users, redesign business processes, and reduce internal complexity.
Posted December 15, 2021
SAP is rolling out new products and services that empower citizen and professional developers to accelerate digital transformation. SAP's announcements tackle the talent gap with new tools, integrations, embedded AI, and learning programs to help both employees and applicants build new skills for the cloud-first era.
Posted December 15, 2021
Using surrogate keys within a database is often considered a technique to improve performance. The assumption is that using anything other than a numeric data value to join tables provides "bad" performance. Therefore, whatever the natural key may be—one column, multiple columns, alphanumeric, etc.—the surrogate key can be a 100% numeric single value, standing in for that natural key value set. Some DBMSs have key generators that are numeric, others may be more wide-ranging in values. Some organizations may choose to use surrogate keys generated from hashed natural key values. Will surrogate keys improve everyone's query performance? As with the stock market, specific circumstances differ everywhere, so the individual results may vary.
Posted December 08, 2021
Accenture and UiPath, an enterprise automation software company, are expanding their business collaboration to help companies boost the adoption of enterprise-wide automation, accelerate technology transformation efforts, and create new growth opportunities.
Posted December 08, 2021
The importance of leveraging data quickly and effectively is a message that has come through loud and clear in recent years—and with increasing intensity since the onset of the COVID-19 pandemic. Whether it is anticipating supply chain problems, addressing customer concerns with agility, or identifying new opportunities and pouncing quickly, the ability to achieve a comprehensive view of all available information for real-time decision making has become a strong theme. To help make the process of identifying useful products and services easier, here, DBTA presents a list of Trend-Setting Products for 2022.
Posted December 08, 2021
AI and machine learning are continuing their upward trajectory at companies already pushed to the limit from COVID-19 transformation and disruption. However, experts say that as businesses look to leverage AI for a growing number of increasingly sophisticated applications, they need to take a more data-centric approach to development.
Posted December 06, 2021
The open source enterprise-class database with data immutability at scale, immudb, can now be deployed in cluster configurations for demanding applications that require high scalabilityand high availability. Codenotary's immudb 1.1 update also enables databases to use Amazon's S3 storage cloud so they will never run out of disk space.
Posted December 01, 2021
MathWorks is the developer of mathematical computing software for engineers and scientists, whose flagship product is MATLAB. Recently, Heather Gorr, Ph.D., senior MATLAB product manager, MathWorks, discussed the importance of streaming high-frequency data, data preparation for machine learning, and best practices for putting it all together to implement a successful AI model.
Posted November 30, 2021
At AWS re:Invent, Amazon Web Services, Inc., an Amazon.com, Inc. company, unveiled the new Amazon CodeGuru Reviewer Secrets Detector, an automated tool that helps developers detect secrets in source code or configuration files, such as passwords, API keys, SSH keys, and access tokens. The new Secrets Detector tool uses ML to identify hard-coded secrets as part of the code review process, ultimately helping to avoid problems before being merged and deployed.
Posted November 30, 2021
Cloudreach, an independent multi-cloud services company, is releasing SMART Management, a next-generation managed service fit for the age of true business transformation built on the cloud. SMART Management brings together all of Cloudreach's expertise in cloud professional and managed services, and delivers them as a simple and flexible service designed to help organizations accelerate their cloud transformation projects.
Posted November 30, 2021
PingCAP, a distributed SQL provider, is offering a new Developer Tier for TiDB Cloud, enabling developers to easily launch a small TiDB cluster for free for up to one year. Through this offering, PingCAP is breaking down the adoption barrier for TiDB, providing the crucial time developers need to experiment first-hand how TiDB and TiDB Cloud can support their mission-critical applications and workloads, while providing decision makers a time frame to properly evaluate and determine where TiDB delivers the highest ROI for their needs, according to the vendor.
Posted November 30, 2021
LogicMonitor, a SaaS-based multi-tenant infrastructure monitoring and observability platform for enterprises and managed service providers (MSPs), is offering unlimited log data retention, now available for LM Logs, the company's SaaS-based log management solution.
Posted November 22, 2021
With heightened pressure to compete on analytics, the purpose and role of data architecture is coming into clearer focus to meet business operating necessities. Recently, John O'Brien, CEO and principal advisor of Radiant Advisors, talked with BDQ about the principles of a resilient enterprise data architecture and the enabling methodologies and technologies.
Posted November 11, 2021
MemVerge is introducing its Big Memory Cloud technology, bringing Big Memory Computing to multi-cloud environments. With Big Memory Cloud technology stateful, non-fault-tolerant, and long-running apps can now realize the promise of cloud agility and flexibility, according to the vendor.
Posted November 08, 2021
Talend, a global leader in data integration and data integrity, is introducing its Fall '21 release, offering new service, product, and packaging innovations. With this release, Talend applies data health concepts across its platform to help everyone from business leaders to data professionals realize value from their data quickly.
Posted November 04, 2021
NS1, a provider in application traffic intelligence and automation, is releasing its cloud-managed solution for DNS, DHCP, and IP address management (DDI), delivered through the NS1 Connect platform. NS1 Cloud-Managed DDI enables organizations to deliver core network services across their distributed network footprint with the agility of software-based deployment, the scale of cloud-native operations, and the operating efficiency of SaaS management, according to the company.
Posted November 03, 2021
When normalizing data structures, attributes congregate around the business keys that identify the grain at which those attributes derive their values. Attributes directly related to a person, deriving their value from that individual, will appear on an Employee entity, or a Customer entity, and so forth. However, in the process of normalizing, the data modeler must identify the objects that are meaningful and useful to the organization
Posted November 01, 2021
Tata Consultancy Services (TCS), a global IT services, consulting, and business solutions organization, has released a major new version of TCS MasterCraft TransformPlus, which leverages machine learning algorithms to more effectively analyze applications during modernization. This enriches user annotation in both program flow and technical specification documentation during the analysis of COBOL applications.
Posted November 01, 2021
Amazon Web Services, Inc. (AWS), an Amazon.com, Inc. company, is releasing Amazon Elastic Compute Cloud (Amazon EC2) DL1 instances, a new instance type designed for training machine learning models. DL1 instances are powered by Gaudi accelerators from Habana Labs (an Intel company) to provide up to 40% better price performance for training machine learning models than the latest GPU-powered Amazon EC2 instances, according to AWS.
Posted October 28, 2021
SAP and the EU TUMO Convergence Center for Engineering and Applied Science, which helps bridge the gap between higher education and industry in Armenia, is launching a strategic collaboration aimed at helping university students and recent graduates understand, utilize, and shape digital technologies.
Posted October 27, 2021
Credo AI is emerging from stealth, publicly launching a comprehensive governance platform for Artificial Intelligence that provides tools that help companies ensure their AI systems and machine learning models are aligned with ethical, regulatory, and business requirements.
Posted October 20, 2021
Google AI/ML Specialist Skander Hannachi defines explainable AI and outlines its predictive power and overall value proposition for organizations during his presentation at Data Summit Connect 2021.
Posted October 20, 2021
Nexla, the unified data operations company, today announced it has secured $12 million in a Series A funding round, enabling the company to continue to deliver on growing enterprise demand for ready-to-use data. Founded in 2016, Nexla streamlines the process of getting ready-to-use data to more applications and more users without having to use tens of different tools.
Posted October 18, 2021
Privacera, the unified data access governance provider founded by the creators of Apache Ranger, is releasing PrivaceraCloud 4.0, enabling enterprises to securely and rapidly exchange data—both inside and outside organizational boundaries—with a unified interface to govern and enforce fine-grained data permissions and policies.
Posted October 13, 2021
Streamlit, the creators of an app framework for machine learning and data science, is offering Streamlit 1.0, adding improvements and customization options that allow data scientists to go from data and models to deploying apps. Streamlit is an easy-to-use framework that lets data scientists quickly build web apps to access and explore machine learning models, advanced algorithms, and complex data types.
Posted October 12, 2021
The creators and maintainers of Fluentd and Fluent Bit are launching Calyptia Cloud, a hosted solution for visualizing and optimizing Fluentd and Fluent Bit's observability pipelines. Calyptia Cloud provides a turnkey service for managing and visualizing open source Fluentd and Fluent Bit to relieve the burdens of conjuration and monitoring, allowing customers to focus on gaining the most insights and value out of their data pipelines in cloud native environments, according to the vendor.
Posted October 07, 2021
Brian O'Neill, founder and principal of Designing for Analytics, discussed the key design challenges data product teams face during his presentation at Data Summit Connect 2021.
Posted October 07, 2021
Marvel should have an evil villain named "Null." Nulls have always been trouble in the relational world. Certainly, nulls are used all over the place by virtually everyone. Still, that does not mean that nulls are harmless.
Posted October 05, 2021
The Open Mainframe Project recently announced record growth in contributions with more than 105.31 million lines of code written and more than 9,600 commits submitted by Open Mainframe Project communities so far this year. This is 100% more code than last year with an increased number of active participants in the 20 project and working groups. These numbers will only increase as Open Mainframe continues to be the cornerstone of governance and innovation for modernizing the mainframe and its path to IoT, Cloud and Edge Computing.
Posted October 04, 2021
IBM and Linux Foundation AI and Data (LFAI and Data) have joined together to create a "one-stop shop" for trusted data and AI artifacts in order to reduce duplication across teams when creating assets, as well as mitigate traceability, governance, risk management, lineage tracking, and metadata collection issues.
Posted October 04, 2021
Today's data-driven organizations demand capabilities that adapt to the enterprise and open new paths of innovation to business users. Achieving leadership in today's economy requires identifying and preparing for the emerging technologies and methodologies that deliver transformation.
Posted September 27, 2021
Matillion, a leading cloud data integration platform, announced it has secured $150 million in Series E funding, empowering the company to continue to grow its cloud analytics, AI, and machine learning for large global enterprises. The funding round was led by General Atlantic, a global growth equity firm, with participation from Battery Ventures, Sapphire Ventures, Scale Venture Partners, and Lightspeed Venture Partners.
Posted September 23, 2021
From data ingestion to data modeling and governance, more and more organizations are looking towards automation to accelerate and improve data management and analytics processes. And at a time when data environments continue to expand in size and complexity while IT staff sizes remain relatively flat, it's easy to understand the appeal. Business leaders are hungry for fast, actionable insights. Manual tasks are error prone and time consuming. For many enterprises, the traditional approach to data management is no longer sustainable, particularly when it comes to enabling modern data analytics strategies.
Posted September 23, 2021
Zumasys is offering a video training series on PICK MultiValue Dictionaries. The most recent virtual session features Pete Schellenbach, author of AccuTerm. Additionally, AccuTerm Enterprise is available for Independent Software Vendors (ISVs) or environments with hundreds of users.
Posted September 22, 2021
Domino Data Lab, provider of the Enterprise MLOps platform, is making upgrades to its model monitoring capabilities, allowing companies to place greater trust in the models they deploy. This and other enhancements—including Domino Model Monitor (DMM) support for AWS, GCP, and Azure— are part of Domino 4.6.
Posted September 21, 2021