Big Data Quarterly Articles



Many organizations still remember the sting of being a victim of the dreaded patent trolls. Patents were granted to encourage, recognize, and reward innovation. Awarding the inventors with a well-defined degree of exclusivity for a period of time improves their chances of both financial reward and the recouping their initial investment.

Posted April 01, 2022

In the world of machine learning (ML), there are a few very important processes which are critical to anyone in the ML space. The first is making sure the data used in machine learning is clean. This topic gets talked about a lot so, while it is very important, let's skip this and move on to the next step. Assuming a clean and complete dataset already exists, the user then proceeds to start training models.

Posted April 01, 2022

With the push to automate increasingly complex data environments, along with a greater need to spur collaboration to deliver more effective and timely analytics capabilities, organizations are turning to DataOps as well as a series of related "Ops" methodologies. Will DataOps—eventually conjoined with DevOps, AIOps, and MLOps—help businesses compete in the digital era? Industry observers point out that these approaches are promising, but a lot of work lies ahead to achieve true collaborative and automated innovation in the data management space.

Posted April 01, 2022

IT executives are struggling to source skills that enable cloud and edge adoption, which has been the largest barrier to deploying cloud-based technologies. To help address the problem, Google announced in October that it will help more than 40 million people build cloud skills. With this pressing issue in mind, Rahul Pradhan, head of cloud products, engineering, Couchbase, recently reflected on the impact the skills shortage is having on DevOps teams, and how organizations can address this issue.

Posted March 31, 2022

Ecosystems are nothing new or revolutionary. What is new is that new waves of digitalization are forcing entities of all sizes and strategies to interact and operate together in an increasingly fast-changing and complex environment. In today's digitally enabled markets, the concept of a social, business ecology, as outlined back in 1985 by organization consultant Peter Drucker, has become a full-blown reality.

Posted March 08, 2022

The most successful organizations view automation as impera­tive to their success. A chief automation officer can serve as a cham­pion at the top that advocates for end-to-end process automa­tion yet knows how to translate business requirements into technical specifications. Rather than relying on a chief information officer or a chief digital officer to spearhead this effort, the narrower scope of a chief automation officer can provide the focus needed to unite all the stakeholders under a common set of goals.

Posted March 08, 2022

DataOps is gaining traction due to its ability to help provide more powerful insights to everyone in an organization—not just CTOs and IT teams. Recently, Geir Engdahl, co-founder and CTO of Cognite, and a former Google senior software engineer, explained why he believes adoption of DataOps has become a business imperative and not just a "nice to have"—especially in the heavy asset and manufacturing space.

Posted March 03, 2022

Databricks has announced the Databricks Lakehouse for Financial Services, an open, modern data platform tailored to customer use cases across the banking, insurance, and capital markets sectors.

Posted February 15, 2022

When building a product or application, most systems designers understand that you can't have it all. Creating a high-performing and scalable system can be a daunting challenge since those considerations are often in opposition to one another—typically high performance in a single machine's memory space or scalable across several servers.

Posted February 14, 2022

Teradata has announced the results of one of the largest-scale cloud analytic tests ever undertaken in the industry. "As critical analytic workloads increasingly move to the cloud, we recognize the need to provide our largest enterprise customers with a single system to manage all of their complex analytics," said Hillary Ashton, chief product officer at Teradata.

Posted February 10, 2022

Wallaroo Labs, a company that helps enterprises deploy, run, and observe ML models in production at scale, has closed $25 million in a Series A round led by Microsoft's venture arm, M12.

Posted February 10, 2022

There's been a lot of hype recently around the concept of a data lakehouse, and for good reason. Essentially, it is a new data management paradigm that combines the capabilities of data warehouses and data lakes, changing the way data teams operate together. This new architecture represents a significant fundamental shift in the way we work with data.

Posted February 08, 2022

The noted motivational speaker and author Zig Ziglar was quoted as saying, "When obstacles arise, you change your direction to reach your goal; you do not change your decision to get there." This sentiment rings truer today than ever. In the past 21 months, companies across every industry have had to alter their "go-to-market" strategies to simply survive. For the local diner, this may have initially meant relying on take-out orders, then finding ways to create outdoor seating areas, and later dealing with the weather inconveniently imposing itself on outdoor patrons. For much of corporate America, changing their company's direction to reach their goals has meant converting traditional workforces to remote employees.

Posted January 18, 2022

The roots of open source go back to the original pioneers of the computer revolution. Early pioneers of computing at organizations such as Bell Labs and MIT held a belief that sharing program code was essential to the progression of computer technology.

Posted January 17, 2022

The ultimate goal of almost all enterprise technology is to automate manual activities into digital processes. BPM (business process management) and workflow systems have been used for decades, and, under the cover of most business applications, sit complex process, task, and workflow management. It is hard to define the sheer scale and breadth of process automation other than to say that it is pervasive. Indeed, although industry analysts love to slice and dice technologies into quadrant and wave silos, doing so with process automation technology is difficult and often, though not deliberately, misleading.

Posted January 17, 2022

Organizations, public and private, are codifying principles, regulations are emerging, and standards are proliferating.

Posted December 22, 2021

Graph databases are powerful new tools for managing and analyzing heterogeneous data across the enterprise. Most importantly, organizations are beginning tounderstand the specific use cases that graph databases solve well.

Posted December 15, 2021

With the combination of the PyData community and commercial software offerings (especially those accelerating Python's foundational components), as well as all the startups building solutions, there is a lot of momentum propelling Python forward.

Posted December 15, 2021

There are some words that you have never heard of and when you hear them for the first time—bam! From that instant, you hear them every day and read them everywhere. "Metaverse" is such a word. Today, the metaverse, long seen as a futuristic dream, is quickly becoming a reality. What it will become remains to be seen.

Posted December 15, 2021

The amount of data we use and manage doubles annually, and performing analytics on that data can uncover heretofore unknown insights that lead to competitive advantage.

Posted December 15, 2021

With heightened pressure to compete on analytics, the purpose and role of data architecture is coming into clearer focus to meet business operating necessities. Recently, John O'Brien, CEO and principal advisor of Radiant Advisors, talked with BDQ about the principles of a resilient enterprise data architecture and the enabling methodologies and technologies.

Posted November 11, 2021

Now is the time to put better strategies around edge implementations so they fit more safely and easily into the wider enterprise environment.

Posted November 11, 2021

In the rush to bring AI and data solutions to bear, don't guess and don't just ask, "Why?"; also ask, "Why not?" Consider why this application might not be a good idea, may not lead to our intended outcome, might not be well-received, and might not safeguard human dignity and liberties.

Posted September 27, 2021

The pandemic has shown clearly that the risk of doing nothing in digital is exceeding the risk of doing something. Now is the time to seize the opportunity to become the next digital rainmaker.

Posted September 27, 2021

Unlike their historical ancestors who carried out their acts during a violent war, these pirates of the information superhighway hone their skills so that they can attack remotely when war is imminent or whenever else they wish. They can use these cyberskills to disrupt key infrastructure such as a gas pipeline, a hospital, or other critical facets of an ever-narrowing and fragile supply chain. While they do not carry letters of marque, we know many are state-sponsored.

Posted September 27, 2021

The amount of data associated with networks is massive, especially when compared to the percentage of traffic that is actually malicious. There is just too much data to analyze in a single day, and this problem is compounded on a daily basis. Threat tactics are constantly changing, with events occurring at a higher frequency, which is forcing the network security industry to prepare for and react to any questionable situation. To make matters worse, cybersecurity specialists are in very high demand, and there is a limited pool of talent from which to draw.

Posted September 27, 2021

Today's data-driven organizations demand capabilities that adapt to the enterprise and open new paths of innovation to business users. Achieving leadership in today's economy requires identifying and preparing for the emerging technologies and methodologies that deliver transformation.

Posted September 27, 2021

Today, organizations need data-driven insights to advance decision making at all levels and digital transformation is a key component of those efforts. Supporting data-driven insights and digital transformation takes an ever-growing range of services, products, and tools from forward-thinking companies that are working to help their customers deliver the right insights to the right people at the right time.

Posted September 08, 2021

In the quest for digital transformation and the use of data to become "data-driven," data quality is taking on even greater importance than it ever has before. Recently, Tyler Warden, senior vice president, product and engineering, Syniti, shared his insights on how organizations can improve the quality of their data and, as a result, enable more informed decision making.

Posted August 24, 2021

Lynda Partner, senior vice president for products and offerings at Pythian, spoke at Data Summit Connect earlier this year about how to accelerate value with machine learning. In this interview with BDQ, Partner continues the conversation and highlights how to select the right use cases for ML, avoid mistakes, and manage an ML project once it becomes a reality.

Posted August 04, 2021

As enterprises rushed to digitize their offline assets over the past year, data finally won widespread recognition as the lifeblood of modern commerce. At a high level, data enabled pandemic-shocked businesses to comprehensively understand their changing landscapes, then generate actionable predictions for how demand would shift. There's little question that data has grown in importance every year, but in 2021, there's now no question that its value is crystal clear to virtually every enterprise.

Posted August 04, 2021

Founded by the creators of Apache Kylin, venture-backed Kyligence and is dual-headquartered in San Jose, California, and Shanghai, China. Luke Han, co-founder and CEO at Kyligence, recently explained the company's connection to the open source project, its future goals, where it fits into the global data management ecosystem, and how it plans to differentiate itself from competitors.

Posted June 08, 2021

Polyglot persistence, the practice of selecting the best database for the job, is on the rise. The days of the one-size-fits-all approach are gone as companies strongly embrace a range of NoSQL/NewSQL and relational, cloud and on-prem, and proprietary and open source options. With this trend, comes the opportunity to choose the right database for the job but also greater complexity.

Posted May 26, 2021

As restrictions caused by the pandemic begin to ease and a "new normal" for business comes into view, some organizations are emerging as winners. Key to thriving and not just surviving, many experts say, is the ability to use data more effectively, enabled by the well-applied use of the right database technologies and cloud resources as well as automation and AI.

Posted May 26, 2021

Everyone is talking about digital transformation and the new normal of working from home, which has inarguably brought cybersecurity threats to a new level. With the boundaries of the network parameter all but disappearing, the risks of an attack are greater than ever.

Posted May 26, 2021

Network security logs are a ubiquitous record of system runtime states and messages of system activities and events. Parsing logs with regular expressions is the most widely utilized method available for network log analysis. Providing a toolset powered by NLP to perform log parsing is a game changer in the critical and time-sensitive area of cybersecurity.

Posted May 26, 2021

As many people in the world pass through the eye of the pandemic storm, aspiring to survive and experience the sun again, another catastrophe looms—albeit barely visible. This potentially devastating problem lurks around the corner from the big-box store that may have just provided their COVID-19 vaccinations, but it is of a very different nature. We are facing a pending tsunami of automation.

Posted May 26, 2021

Empowering every data user starts with reassessing how we think people work with data. Too often, we think "data professionals" but hear "data scientists," "business analysts," and "power users."

Posted May 26, 2021

A new type of channel looms on the horizon for Customer 360 projects, and it is going to be the toughest one of all to achieve. In order to master it, customer experience needs to evolve to the next level—a level that can be thought of as the "connected customer experience." The channel? Connected products.

Posted May 26, 2021

Deploying AI fairly, safely, and responsibly requires clarity about the risks and rewards of an imperfect solution, not the attainment of perfection. An AI algorithm will make mistakes. The error rate may be equal to or lower than that of a human. Regardless, until data perfectly representing every potential state—past, current, and future—exists, even a perfectly prescient algorithm will err. Given that neither perfect data nor perfect algorithms exist, the question isn't whether errors will happen but instead: When, under what conditions, and at what frequency are mistakes likely?

Posted May 26, 2021

The move to next-generation databases is driven by their ability to help companies achieve competitiveness and reach customers faster and more efficiently. These new breeds of systems can be a force for business transformation—whether it is generating new sources of revenue, enhancing customer experience, or producing data-driven insights that improve how organizations interact with customers.

Posted May 26, 2021

In 2020, very few open source software projects remained truly "open" without a single company acting essentially as an owner. PostgreSQL and Debian are probably the last relics of the idealistic era of the 1980s and 1990s. Let's look at how and why the OSS market and the ownership of open source software projects have changed over time, and take a glimpse into what the future will bring as open source projects continue to mature and as adoption continues to rise.

Posted May 06, 2021

A few years ago, if you had asked a group of C-Level executives to project which software delivery trend would be more important for organizations, most would have ranked DevOps ahead of containers. DevOps promised to profoundly refocus and reenergize software teams while containers looked like an interesting new way to repackage resources that were already there. Today, the rankings have flipped.

Posted May 05, 2021

Data is a critical company asset that has continued to grow exponentially for over a decade. However, to create game-changing business value, data not only needs to be analyzed, but it needs to be utilized.

Posted April 15, 2021

In the future, 2021 may be viewed as a sharp turning point when companies recovered from the dramatic changes of 2020 and moved from surviving to thriving. Recently, John O'Brien, CEO and principal advisor, Radiant Advisors, spoke with BDQ about the challenges and opportunities for organizations as they emerge from the seismic shifts of the past year.

Posted April 09, 2021

After a wild and turbulent 2020, the new year has ushered in a renewed commitment to establishing or improving corporate governance. Yet, positive energy aside, our traditional approach to endorsing governance of data, analytics, or AI remains fraught. As a result, governance initiatives springing from an earnest desire to do right (e.g., responsible AI), as well as the need to not do wrong (e.g., regulatory/compliance), struggle to enlist broad coalitions of the willing.

Posted April 05, 2021

The full potential for companies that digitally transform is predicted to be $100 trillion by 2025. This astonishing value would be reached through the combination of digital technologies—mobile, cloud, AI, sensors, and analytics, among others. These are accelerating progress exponentially, said the World Economic Forum, but this growth can be realized only if there is collaboration between business, policymakers, and non-governmental organizations.

Posted April 05, 2021

As the world of data analytics continues to evolve and reshape after a tumultuous 2020, the need for agility is rapidly driving a new era in data culture in which it is imperative to handle data immediately and at scale. While emphasis on self-service data and analytics has been top-of-mind for some time now, the shift to self-sufficiency is held back by culture, not technology. With the new year pushing more robotics process automation at all levels of the business—and for all data users—organizations are becoming more acutely aware that true enablement isn't just about tools and tech. It's about people.

Posted April 05, 2021

The world changed over the last year. Future historians will complete their theses focusing on different quarters or even specific months of 2020. But one of the most overused cliches in thinking about this period of time has been the idea that "the more things change, the more they remain the same." Let's consider sports in 2020. Major League Baseball had a 60-game season, the NBA finals were played in October, and cardboard cutouts took the place of fans in every sport. However, the Lakers won the NBA finals, the Dodgers won the World Series with the Yankees playing deep into the playoffs, and Tom Brady went to his 10th Super Bowl. The more things change …

Posted April 05, 2021

Securing information systems and data is a foundation for any organization. Detection of insider threats can be a considerable challenge for threat detection systems and security analysts. This is due to the difficulty of determining non-normal actions from internal system behavior data.

Posted April 05, 2021

Pages
1
2
3
4
5
6
7
8
9
10
11
12
13

Newsletters

Subscribe to Big Data Quarterly E-Edition