Big Data Quarterly Articles



In many organizations, data management pros are still challenged by a collection of legacy enterprise data warehouse architectures, Hadoop, and cloud storage (to name just a few). The ever-growing volumes of data that we generate lead us to looking for places to put the data, such as the data lake. It grows and grows with data that may or may not have value, but the prevailing thought is that it may be needed someday.

Posted December 13, 2018

Evolving compliance obligations, including the EU's General Data Protection Regulation (GDPR) and the NYDFS Cybersecurity Regulation (23 NYCRR Part 500), are driving the urgent need for governance, and, in the U.S., high-profile hacks, leaks, and data breaches amplify security risks and underscore the ongoing requirement to protect corporate data from spying, harvesting, and exfiltration. As of now, all 50 U.S. states, the District of Columbia, and many U.S. territories have data breach notification laws on the books.

Posted December 12, 2018

Because companies across all industries are realizing the need for data in evidence-based decision making over gut instinct, they're increasingly relying on more minds, teamwork, and tighter collaboration for confidence and trust in analytical outcomes. Today, machine learning is improving the process by being a new "mind" to supplement and enhance our human thought.

Posted December 12, 2018

To understand how monetization models are changing, we must look at the state of software licensing and monetization as it is now and how technology will work in the future.

Posted December 11, 2018

The rate of speed at which technology is changing is matched only by the speed of new applications. From high-frequency trading (HFT) to the Internet of Things (IoT), sophisticated processing capabilities mean that we just keep receiving and using data faster.

Posted December 11, 2018

The newest edition of the TOP500 list of the world's fastest supercomputers puts five U.S. Department of Energy (DOE) supercomputers in the top 10 positions, with the first two captured by Summit at Oak Ridge National Laboratory (ORNL) and Sierra at Lawrence Livermore National Laboratory (LLNL).

Posted November 12, 2018

Arun Murthy—CPO and co-founder of Hortonworks—who will also serve as CPO at Cloudera after the merger is complete—recently shared his thoughts on what's ahead for 2019. According to Murthy, data at the edge, AI, IoT, open source, and cloud will all factor in strongly in organizations' plans for analytics and governance.

Posted November 12, 2018

The data lake has become accepted as an important component of a modern data architecture, enabling a wider variety of data to be accessed by users. Yet, challenges persist. Recently, John O'Brien, CEO and principal advisor, Radiant Advisors, talked about the cultural transformation underway as companies increasingly realize the power of data, and the tools and technologies helping them to expand what is possible.

Posted October 24, 2018

In my last article, I discussed how the Internet of Things market is showing early signs of maturity, but that many projects still can stumble. I identified seven "habits" that successful projects have in common, which, when used together, are powerful enough to set your IoT project on the right path.

Posted September 27, 2018

Volumes of data surround us. The internet, advertising, social media, connected cars and smart homes have driven an exponential increase in information, primarily unstructured data. But, this data is useless unless we can also comprehend, analyze and make operational, tactical and strategic (yet democratized) decisions based on the information. This realization has pushed organizations to rethink business strategies and outcomes as related to big data and digital transformation. It's also prompted an investment in technologies that enable data mining, as well as prescriptive, descriptive and predictive analytical solutions.

Posted September 27, 2018

Thanks to the dramatic uptick in GPU capabilities, gone are the days when data scientists created and ran models in a one-off manual process. This is good news because the one-off model was typically not optimized to get the best results. The bad news is that with an increase in the total number of models created—including iterations over time—the amount of data used as inputs and generated by the models quickly spirals out of control. The additional bad news is that there are a variety of complexities associated with model, data, job, and workflow management.

Posted September 26, 2018

This past summer, I had the opportunity to stay in a wide variety of hospitality establishments for both personal and professional travel, which, for me, has generated another fun way to look at data governance that I am excited to share. Because, let's face it, without good analogies, data governance on its own can be, well, kind of dry. Welcome to the Hotel Data Governance. Such a lovely place. (The tune is already in your head isn't it? You're welcome.)

Posted September 26, 2018

Many organizations nowadays are struggling with finding the appropriate data stores for their data, making it important to understand the differences and similarities between data warehouses, data marts, ODSs, and data lakes. All these data structures clearly serve different purposes and user profiles, and it is necessary to be aware of their differences in order to make the right investment decisions.

Posted September 26, 2018

Both Oracle and SQL Server have very well-established communities. While they are different, they are also similar in many ways. All DBAs worry about the performance and security of the data and the database. Out of necessity, Oracle DBAs have become more specialized. Will this happen to SQL Server DBAs now that the database is offered on Linux?

Posted September 25, 2018

New tools and technologies are becoming established in enterprises, helping organizations extract more value from data. Recently, industry experts weighed in on the trends that loom large in the future and those that appear to be waning.

Posted September 18, 2018

IT departments are under increasing pressure to keep up with the pace of business innovation. As data volumes rise, automation looms as a light at the end of the complex-process tunnel. The ability to leverage software, framework, and application tools to generate automated sequences based on various trigger events has become critical to the IT industry. But, it doesn't come without its challenges. When well-executed, IT automation can increase efficiency and productivity, reduce cost, and speed time to value. However,  poorly crafted automated sequences and lack of integration between applications can make a lasting impact on application deployment and management, causing a ripple effect across the entire IT landscape.

Posted September 18, 2018

Today, organizations everywhere want to become data-driven—directed by business knowledge rather than intuition or experience from the past. But to reach that level of sophistication, they need someone at the helm who is capable of forming a strategy for data usage and governance. Enter the "chief data officer," or CDO. Recently, Big Data Quarterly spoke with Ramesh Nair, North America Financial Services leader at Accenture Applied Intelligence, about why more companies are putting executives in that role.

Posted September 17, 2018

Previous technology shifts, such as the introduction of enterprise resource planning software, tended to be inward-facing, involving little contact with the customer. Things are different this time around. The companies that are embracing today's digital transformation trend are focusing squarely on the customer—connecting customer-facing initiatives with business processes to stay ahead of the competition.

Posted September 17, 2018

Identifying new and disruptive technologies, as well as evaluating when and where they may prove useful, is a challenge in the fast-changing big data market. To contribute to the discussion each year, Big Data Quarterly presents the "Big Data 50," a list of forward-thinking companies that are working to expand what's possible in terms of collecting, storing, protecting, and deriving value from data.

Posted September 13, 2018

Today, data management environments are highly complex and often span multiple vendors with deployments across on-premise data centers, clouds, and hybrid installations. In addition to the heterogeneity of systems, the processes surrounding database development and management have also changed. DevOps, a methodology for data scientists, developers, database administrators (DBAs) and others to participate in an Agile workflow, puts a premium on speed and also means that DBAs do not wield the firm control they did in the past.

Posted September 06, 2018

Veritas Technologies, data protection leader, today unveiled Veritas NetBackup 8.1.2 with a new and improved user interface that, simplifying access for employees across an organization.

Posted August 22, 2018

Envorso, a provider of business transformation solutions, is entering a strategic partnership with Signafire Technologies, an industry-leading fusion and content analysis company. The partnership will allow Envorso to offer enterprise data fusion solutions.

Posted August 17, 2018

Today, data is understood to be the fuel that propels companies' growth and success. As a result, safeguarding that valuable resource is more important—but also harder—than ever.

Posted August 07, 2018

The way that many organizations approach the backup process has failed them, as evidenced by the hundreds of millions of dollars they have spent on ransomware to retrieve their data.

Posted August 02, 2018

For organizations dealing with critical infrastructure and systems, as well as governmental agencies and operators, there are several solutions that can help with IT network security.

Posted July 26, 2018

By automating the centralization process, organizations can ensure that data is up-to-date and accurate, improving their customer experience and paving the road for GDPR compliance.

Posted July 23, 2018

Better cybersecurity requires a mindset that looks beyond the technology itself and focuses on having the technology, processes, and people working together in tandem to ensure a secure infrastructure.

Posted July 18, 2018

Today, there is a resurgence in the power of data visualization—alongside a virtual gold rush of bigger, more diverse, and more dynamic data—is providing new tools and innovative techniques to help us transform raw data into compelling visual data narratives. Propelled by this newfound horsepower in data visualization, we are recreating the entire analytic process. We're also making it increasingly more visual—from how we explore data to discover new insights all the way to how we curate dashboards, storyboards, and interactive visualizations to share the fruits of our labor.

Posted July 16, 2018

With so many layers that may be vulnerable to attack, securing an ERP system involves much more than just one piece of cybersecurity software.

Posted July 16, 2018

Organizations need dynamic data mapping capabilities for a precise view of their data and to provide transparency around "the rights of the data subject," such as the rights to be forgotten, rights of accessibility, and rights of rectification.

Posted July 13, 2018

Organizations can significantly reduce threats with basic security hygiene and education for proper user habits since studies show that more than 90% of ransomware attacks start with employees interacting with email.

Posted July 13, 2018

The role of the CDO is growing—as are data-based threats to businesses.

Posted July 12, 2018

Blockchain has been one of the most loudly trumpeted new technologies on the enterprise database scene in recent history. However, the concept of a blockchain is not really a new notion. It is more of a repackaging of existing constructs to deliver a new set of benefits to any organization leveraging it for their use cases. It provides the benefit of irrevocable proof, and it reduces friction with information exchange.

Posted May 11, 2018

In the past few years, IoT has been greatly overhyped; hence, many IoT vendors had to convince the market of their pedigrees by touting use cases and customer success stories. In reality, IoT was only getting traction in very few markets—manufacturing being one—with the rest trailing behind.

Posted May 11, 2018

Silicon Valley has achieved an almost mythical status in both modern American popular culture as well as the annals of world economic history. Located south of San Francisco, the name "Silicon Valley" was coined in the early 1970s due to the volume of silicon chip innovators and manufacturers in the area. Today, the valley is synonymous with technology innovation and venture capital: two mighty forces of change.

Posted May 11, 2018

Across industry and academia, the past several years have seen a proverbial explosion of new business analytics education programs.If you're new to the analytics labor market—or looking to advance your credentials—academia has likewise undergone a period of massive innovation as educators work diligently to keep pace with market demands and produce a new breed of business analytics education. The change has been nothing short of astonishing

Posted May 11, 2018

Aside from data, "governance" is the most used term in data governance. Duh! It's in the name, right? But not only is it the most used, it is also the most misused and misinterpreted. The general perception of the term "governance" generates a widespread misunderstanding of the purpose of data governance. With excitement and fear rapidly growing around the use of data in businesses across all industries, data governance is becoming a hotter-than-hot topic! But, as with many corporate buzzwords, the more viral the term and concepts of data governance become, the more inappropriately used and abused they are.

Posted May 11, 2018

Although security is often related to privacy, they are not synonymous. Data security can be defined as the set of policies and techniques to ensure the confidentiality, availability, and integrity of data at all times. Data privacy refers to the fact that the parties accessing and using the data do so only in ways that comply with the agreed-upon purposes of data use in their roles. These purposes can be expressed as part of a company's policy, but are also subject to legislation. In this way, several aspects of security can be considered as necessary instruments to guarantee data privacy.

Posted May 11, 2018

Write this down: Converged transactional and analytical data platforms stand for digital business. None of us has been alive long enough to remember a time without the printing press, but such a time did once exist. The printing press revolutionized the world of books, journalism, scientific research, and countless other areas by automating a process that was once tedious and time consuming.

Posted May 11, 2018

Technology is constantly changing, and IT architects need to keep up with modern developments to ensure that their companies are achieving the best possible return on their IT investment. This can be achieved by architecting a solid IT infrastructure with modern components spanning the hardware, software, network resources, and services required for the operation and management of an enterprise IT environment.

Posted May 11, 2018

As the old saying goes, the more things change, the more they stay the same. Many companies have been in a frenzy the past 2 years preparing for regulations that are either turning or about to turn the corporate world upside down. Financial services firms have been scrambling to deliver the transparency required by the second Markets in Financial Instruments Directive (MiFID II), while everyone else serving EU residents has been lining their ducks in a row to comply with the General Data Protection Regulation (GDPR).

Posted May 11, 2018

If blockchain could only be described in one word, that word would be "trust." It is an ideal mechanism to establish trust among multiple parties, demonstrated by its seminal use case as an abstraction for currency. The currency paradigm is instructive because it demonstrates the core concepts that could be leveraged in other use cases.

Posted May 11, 2018

Enterprise architects are making major waves. In fact, a recent KPMG study spotlighted enterprise architecture (EA) as today's most in-demand tech skill, as companies recognize EA's critical role in cutting both costs and complexities. But while enterprise architecture is one of the fastest-growing skillsets, it's also undergoing a major evolution. Where the role previously involved exhaustive plans consisting of excessive amounts of analysis, slow timelines, and rigid conceptual models, the agility and DevOps movement has forced old EA mentalities into obsolescence.

Posted May 11, 2018

Fueled by the growing demand for data-driven insights, as well as the explosion of new data sources and formats, innovative big data technologies continue to expand. While the long-trusted RDBMS still reigns supreme in most organizations, the surging force of data from social media, mobile devices, IoT, and other sources, as well as the availability of additional options for data storage and processing, means that there is plenty of room for disruptive new approaches.

Posted May 11, 2018

We're all familiar with the IT "war room" scenario. When there's an issue, members of the IT team come together to troubleshoot and find a solution. For organizations with important applications, such as SQL Server running in virtual infrastructures, these IT teams are no strangers to the IT war room environment. In this case, input from the SQL Server system administrators and DBAs isn't considered (or even requested) when the infrastructure team implements it virtualization plan.

Posted May 07, 2018

GDPR has gone into effect. Rex Ahlstrom, chief strategy and technology officer at BackOffice Associates, a provider of information governance and data stewardship solutions, discussed what's at stake.

Posted May 01, 2018

Recently, the revised Markets in Financial Instruments Directions (MiFID II) launched in the EU. The sweeping regulatory changes will impact transaction reporting on all financial instruments traded in Europe and affect all U.S. firms that do business with European counterparts or customers. Firms will face new requirements in tracking data—including emails, texts, and documents related to every transaction—and will need to be able to quickly reconstruct trades and search across data silos,  presenting a significant challenge. Here, Ken Krupa, CTO at enterprise database company MarkLogic, discusses the impact to U.S. firms, and how new regulations underscore the importance of increasing transparency, consumer protection, and data integrity.

Posted April 30, 2018

DataStax is making enhancements to its DataStax Enterprise platform, making upgrades to deliver twice the responsiveness and the ability to handle twice the throughput on the same infrastructure. DataStax Enterprise (DSE) 6 allows customers to maintain hybrid cloud flexibility with all the benefits of a distributed cloud database on any public cloud or on-premises.  DSE 6 includes all the advantages of Apache Cassandra and much more.

Posted April 18, 2018

As the volume and complexity around data grows, it has become more critical than ever for organizations to develop a deep knowledge of their business context and to understand and quantify the value of that data.

Posted April 18, 2018

The key to understanding AI's current and future impact is its transformation of business processes. A widespread misconception is that AI systems, including advanced robotics and digital bots, will gradually replace humans in one industry after another. Self-driving vehicles, for example, will one day replace taxi, delivery, and truck drivers. That may be true for certain jobs, but what we've found in our research is that, although AI can be deployed to automate certain functions, the technology's greater power is in complementing and augmenting human capabilities.

Posted April 13, 2018

Pages
1
2
3
4
5
6
7
8

Newsletters

Subscribe to Big Data Quarterly E-Edition