Data Modeling

Data Modeling and Database Design and Development – including popular approaches such as Agile and Waterfall design - provide the basis for the Visualization, and Management of, Business Data in support of initiatives such a Big Data Analytics, Business Intelligence, Data Governance, Data Security, and other enterprise-wide data-driven objectives.

Data Modeling Articles

Airbyte, creator of the leading open-source data movement infrastructure, is releasing its Snowflake Cortex destination, a new data connector for Snowflake users who are interested in building generative AI (GenAI) capabilities directly within their existing Snowflake accounts.

Posted June 19, 2024

Hammerspace, the company orchestrating the next data cycle, is adding the S3 interface to its Global Data Platform, advancing the orchestration of existing data sets to available compute resources. With this announcement, Hammerspace continues to offer organizations new, advantageous ways to manage and leverage data, according to the company.

Posted June 17, 2024

In today's tumultuous computing landscape, the DBMS (database management system) remains core and central to the IT infrastructure. And, as such, it is central to the applications used by modern organizations to conduct business and service their customers. So, it stands to reason that a core competency for a DBA is to be able to keep their organization's databases up and operational. This requires resilience.

Posted June 17, 2024

DevOps is now the most prevalent software development methodology in use. Since 2009, it has spread beyond development teams into other functional areas. One of the earlier DevOps extensions was into DevTestOps, which emphasized continuous testing throughout the software development lifecycle. This was followed several years later by the emergence of QAOps, which built on that model with a focus on improved quality assurance (QA). At first glance, these terms refer to the same methodology. But when you dig deeper, QAOps represents a significant departure from the purpose and process of DevOps. Let's explore.

Posted June 13, 2024

Data modeling has always had a push-me/pull-you relationship in the IT world. The idea of complete logical and physical data models, insightful definitions, coherent data flow diagrams, and other related informational caches is always desirable. However, far too often, the expectation is that these activities take virtually no time to create. When the expenditure of resources goes beyond a certain level, the activities are jettisoned or otherwise given the short shrift. Actually, getting code in place is viewed as the only evidence of true progress.

Posted June 13, 2024

Most times, if asked, I will rattle off, without hesitation, a list of ways AI is being applied along with all the ways it can go wrong. You may also get bit of a diatribe about why speaking of AI in the royal sense (i.e., "the AI") is always a bad idea. It's practically a (bad) party trick. Yet recently, when asked to characterize the primary ethical issues in AI, I had a perfect moment of mental blankness. It was an uncomfortable and instructive moment on many fronts.

Posted June 12, 2024

Timescale, the Postgres cloud database company, is debuting two new open source extensions—pgvectorscale and pgai—which extend the strengths of PostgreSQL to AI development use cases, such as building retrieval augmented generation (RAG), search, and AI agent applications. Enabling enterprises to benefit from the familiarity of PostgreSQL while still achieving the sort of performance that a specialized vector database provides, Timescale's latest extensions aim to make PostgreSQL better for AI development.

Posted June 11, 2024

Juniper Networks, a leader in secure, AI-Native Networking, is introducing a new round of innovations to its AI-Native Networking Platform, delivering exceptional value and cost savings to enterprises requiring secure branch connections.

Posted June 11, 2024

To gain insight on the adoption and maturity of data management technologies and practices, DBTA and Radiant Advisors surveyed more than 250 IT leaders and professionals at organizations across North America to identify the key perceptions, priorities, challenges, and technology plans underlying modernization efforts today.

Posted June 11, 2024

SqlDBM, a leading collaborative, cloud-based data modeling platform for the enterprise, is unveiling Tx, a transformational workflow solution that empowers teams to facilitate both relational and transformational modeling in one platform. Allowing users to quickly and collaboratively develop and automate modular analytics code, Tx closes the relational/transformational data gap by centralizing these workflows in a single solution. 

Posted June 10, 2024

DBI Software, a provider of performance monitoring, tuning, and trending tools for IBM Db2 LUW and SQL Server databases, is releasing version 10 of the DBI Web Performance Suite.

Posted June 07, 2024

Galileo, a provider developing generative AI for the enterprise, is releasing Galileo Luna, a suite of Evaluation Foundation Models (EFMs) designed to transform how generative AI evaluations are conducted. According to the company, this novel approach is faster, more cost-effective, and more accurate than existing evaluation methods such as askGPT and human "vibe checks." With Galileo Luna, enterprises can bring trustworthy AI solutions to market faster and at production scale. 

Posted June 07, 2024

Guiding enterprises through the thicket of the latest database technologies and strategies, experts joined DBTA's roundtable webinar, New Database Technologies and Strategies for the AI Era, to offer their expertise on the market's best solutions for supporting AI projects.

Posted June 06, 2024

AI has become pervasive across enterprises, and the drive is now on to push this potentially powerful intelligence out to the edge and network, where it can deliver insight and operational performance in real time. These days, no discussion of edge and IoT is complete without weighing the implications of AI. "If people think AI will stop at data centers, they have an unfortunate blind spot, because AI is likely to be deployed in some form at the edge," said Kevin Brown, SVP at Schnei­der Electric. "In my opinion, it will bring with it a host of new challenges regard­ing data privacy concerns, an increasing demand for power, and an infrastructure that will be even more broadly distrib­uted. Undoubtedly, we need to get ahead of these challenges."

Posted June 05, 2024

A first and important step in being successful at almost any job or task is understanding oneself. This is true for engineers, modelers, or even architects. Do you know how to perform your tasks? Are you faster or slower than others doing the same tasks? Do you have more or less errors in your output than others? It seems that a rising number of people are so uncomfortable with competing that they may even avoid asking these kinds of questions of themselves; but this is not about competition, it is about understanding oneself, it is about being responsible, it is about holding oneself accountable.

Posted June 05, 2024

Zilliz is introducing Milvus Lite, a lightweight vector database that runs locally within the Python application, making it a compact and efficient solution ideal for environments with limited computing resources such as laptops, Jupyter Notebooks, and mobile or edge devices. Based on the open-source Milvus vector database, Milvus Lite reuses the core components for vector indexing and query parsing while removing elements designed for high scalability in distributed systems.

Posted May 31, 2024

dbt Labs, the pioneer in analytics engineering, is introducing dbt Cloud enhancements designed to help businesses turn data into a competitive advantage as companies' data volumes explode and the need for trustworthy, high-quality data increases. "Accurate and timely data is crucial, which is why we've delivered a standardized way to quickly build reliable, holistic, and high-quality data pipelines at scale," said Luis Maldonado, VP of product at dbt Labs. "These new features take this even further, significantly improving data workflows and AI workloads, all while empowering more users with powerful business insights."   

Posted May 30, 2024

JFrog Ltd, the Liquid Software company and creator of the JFrog Software Supply Chain Platform, is announcing a new partnership with GitHub, the world's leading AI-powered developer platform. Born from this partnership is a best of breed, integrated platform solution that merges every developer "Ops"—from DevOps to DevSecOps, MLOps, and GenAI-powered apps—within a single interface.

Posted May 29, 2024

Parasoft, a global leader in software testing and quality solutions, is introducing several advancements in software testing technology, equipping teams with automated AI-enhanced API test generation, microservices code coverage collection, and web accessibility testing.

Posted May 28, 2024

To discuss the ways GenAI can be augmented for true success, John O'Brien, principal advisor and industry analyst at Radiant Advisors, and David Jayatillake, VP of AI at Cube, joined DBTA's webinar, Delivering on the promise of AI: Increasing Accuracy with a Semantic Layer, offering the ways that a semantic layer—or a consistent convention of understanding and definition that data adheres to—can position GenAI and large language models (LLM) to live up to their technological intent.

Posted May 24, 2024

Syncari, a leader in data unification and automation, is launching its Autonomous Data Management platform, offering distributed 360-degree data, centralized governance, and democratized access that is essential for powering transformative digital and AI technologies. According to the company, the platform enables enterprises to automate processes seamlessly across all data domains, using a unified master data model, ensuring robust data consistency and transactional lineage.

Posted May 22, 2024

BlueFinity recently looked at a LinkedIn poll that asked, "What do businesses want when designing new MV apps?"—revealing key insights that will shape the future of MV app development. There is, however, a contradiction in the public discourse of what the results of the poll suggested and what is being discussed in public and private forums focusing on MV.

Posted May 22, 2024

Rafay Systems, a Platform-as-a-Service (PaaS) provider for modern infrastructure and accelerated computing, is extending the capabilities of its enterprise PaaS for modern infrastructure to support graphics processing unit- (GPU-) based workloads—making compute resources for AI instantly consumable by developers and data scientists. Additionally, the company also launched a new AI Suite with standards-based pipelines for machine learning operations (MLOps) and large language model operations (LLMOps) to help enterprise platform teams quicken the development and deployment of AI applications for developers and data scientists, according to Rafay Systems.

Posted May 20, 2024

Camunda, the enterprise enabling organizations to orchestrate processes across people, systems, and devices to continuously overcome complexity and increase efficiency, is debuting new functionality for its end-to-end process orchestration platform that further infuses intelligence into business automation. 

Posted May 17, 2024

The Department of Labor announced the release of a far-reaching set of principles that provide employers and developers, that create and deploy artificial intelligence, with guidance for designing and implementing AI in ways that enhance job quality and protect workers' rights. These new guidelines were developed as a result of President Biden's Executive Order on the Safe, Secure and Trustworthy Development and Use of Artificial Intelligence.

Posted May 16, 2024

Oracle is introducing Oracle Code Assist, an AI code companion, to help developers boost velocity and enhance code consistency. Powered by large language models (LLMs) running on Oracle Cloud Infrastructure (OCI) and optimized for Java, SQL, and application development on OCI, Oracle Code Assist is planned to provide developers with context-specific suggestions that can be tailored to an organization's best practices and codebases. Oracle Code Assist will also be designed to be used to update, upgrade, and refactor code written in most modern programming languages, according to the company.

Posted May 15, 2024

Richard Schiller, senior product manager at Quest Software, and John de Saint Phalle, senior product manager at Precisely, joined DBTA's webinar, Cloud Migration Best Practices: Success Factors and Pitfalls to Avoid, to offer their expertise on how to successfully migrate to the cloud by navigating risks, requirements, best practices, and solutions.

Posted May 14, 2024

Boomi, the intelligent integration and automation leader, is acquiring APIIDA's federated API management business and API management assets from Cloud Software Group, allowing enterprises to deliver business value through API products in one end-to-end platform. According to the company, both these acquisitions accelerate Boomi's roadmap for providing solutions to the most pressing API management challenges that companies face today.

Posted May 13, 2024

StarTree, the cloud-based real-time analytics company, is offering new observability and anomaly detection capabilities in StarTree Cloud, alongside vector search capabilities in Apache Pinot. Additionally, the company announced the general availability launch of StarTree ThirdEye, offering advanced anomaly detection, as well as the introduction of a write API facilitating real-time sync for ELT pipelines, and integrations with leading visualization platforms, including Tableau and Grafana.

Posted May 10, 2024

At the annual Data Summit conference, Bharath Vasudevan, head of product, erwin, Quest, led the session, "Making AI Ethical & Explainable," considered how consistent, clean, and curated datasets are key in bridging the gap between data and the real-world, enabling AI to transcend "magic" and ground itself in transparent truth.

Posted May 09, 2024

Are you taking a hard look at your cloud costs this budgeting season? Is your IT budget getting eaten up without a good ROI to show for it? Do you need to justify your cloud expenses and business cases to leadership? At Data Summit 2024, Michael Agarwal, director and global practice leader, site reliability engineering, cloud and NoSQL databases, Datavail, discussed cloud cost optimization strategies, tips, and best practices during his session, "Cloud Cost Optimization: Strategies, Tips, & Best Practices."

Posted May 09, 2024

Zoe Steinkamp, developer advocate, InfluxData, led the annual Data Summit session,  "Architecting for Speed and Scale," highlighting how Apache Iceberg brings data harmony—complemented by flexibility, scalability, and high performance—to enterprises' structured data.

Posted May 09, 2024

Doug Laney opened Data Summit 2024 with a look at Infonomics in the era of AI. Laney, innovation fellow, data and analytics strategy, West Monroe, and Author of Infonomics and Data Juice, visiting professor at University of Illinois Gies College of Business, shared insights from his best-selling book, Infonomics, about how organizations can actually treat information as an enterprise asset.

Posted May 09, 2024

Time series analysis plays a crucial role in enhancing the capabilities of AI by providing valuable insights into temporal patterns, trends, and dependencies within datasets. At Data Summit 2024, Salochina Oad, ML engineer, U.S.Xpress, Inc. held her session, "Empowering AI Through Time Series Analysis."

Posted May 08, 2024

At the annual Data Summit conference, the session "Data Fabric Key Enablers," led by John Bagnall, senior product manager, Matillion, illustrated how ETL plays an integral role in data fabric implementation, enabling enterprises to easily and efficiently manage, integrate, and analyze data from diverse sources.

Posted May 08, 2024

Ranjeeta Bhattacharya, senior data scientist, BNY Mellon, and Yetkin Ozkucur, director for professional services and presales, Quest, led the annual Data Summit session, "Putting Generative AI to Work," assessing the ways in which GenAI-based enterprise applications can be set up for success based on both development and data best practices.

Posted May 08, 2024

There is no doubt that data mesh principles resonate with so many data professionals, particularly those looking to move beyond brittle, monolithic architecture. However, adopting data mesh can seem daunting, due to both a scarce but improving ecosystem of tools, as well as organizational change management. At Data Summit 2024, Elliott Cordo, CEO/founder/builder, Data Futures, LLC, presented "From Daunting to Doable: The Evolution of Data Mesh."

Posted May 08, 2024

The combination of Apache Flink, Apache NiFi, and Apache Kafka for building real-time data processing pipelines is extremely powerful, as demonstrated by Timothy Spann, principal developer advocate, streaming, Cloudera and future of data meetup, startup grind, AI Camp, during his Data Summit 2024 session, "Building Real-Time Pipelines With FLaNK."

Posted May 08, 2024

The vast majority of current GenAI projects will fail, not because of inherent flaws in large language models (LLMs), but because of misconceptions about how to use them and the lack of capabilities needed to successfully design, develop, and operationalize GenAI-driven applications. At Data Summit 2024, Kjell Carlsson, head of AI strategy, Domino Data Labs, presented his session, "Shatter the Seven Myths of GenAI to Operationalize Impact," debunking the most harmful myths that set up projects for failure.

Posted May 08, 2024

Machine learning is primarily concerned with accuracy and pattern recognition, while natural language processing (NLP) is concerned with computer-human language interactions, specifically how to program computers to process, and analyze large amounts of natural language data. At Data Summit 2024, Christy Bergman, developer advocate, Zilliz, presented how to use an open source vector database to power GenAI chatbots, ecommerce recommenders, and similarity search-based apps during her workshop, "Taking Advantage of Machine Learning & Natural Language Processing."

Posted May 07, 2024

Semantic layers stand out as a key approach to solving business problems for organizations grappling with the complexities of managing and understanding the meaning of their data. At Data Summit 2024, Joseph Hilger, COO, Enterprise Knowledge and Sara Nash, principal consultant, Enterprise Knowledge LLC, discussed "Building the Semantic Layer of Your Data Platform," during their workshop session.

Posted May 07, 2024