Over time, different types of data integrity systems and methods for promoting data integrity have been developed. Data integrity emphasizes confirming the data remains unchanged and consistent over the data’s entire lifecycle. In essence, the data remains pure and uncorrupted. Security plays an important role in ensuring the data is not altered and maintains its […]
Starburst Expands Support for Building Interactive Applications on Data Lakes
According to a new press release, Starburst, a leading analytics solutions provider, has announced an expansion in its support for building interactive applications on data lakes. The company’s initiative aims to enhance the efficiency and accessibility of data lakes, which are repositories for vast amounts of raw data. With this expansion, Starburst seeks to empower […]
Empowering Power BI with the Semantic Layer
Today’s organizations widely acknowledge the significance of leveraging data and analytics. Virtually every executive envisions establishing a data-driven organization. However, a survey conducted by New Vantage Partners reveals that only a mere 26.5% of companies have effectively achieved this transformative goal. Part of the problem lies in the ineffective collaboration between business and technology teams. In the […]
Understanding Data Mesh Principles
ThoughtWorks consultant Zhamak Dehghani defines data mesh as a “decentralized sociotechnical approach to sharing, accessing, and managing analytical data in complex and large-scale environments – within or across organizations.” This type of Data Architecture continues to generate interest among corporations, and data professionals will need to become familiar with data mesh architectures, such as those with data lakes or warehouses. […]
The Semantic Lakehouse Explained
Data lakes and semantic layers have been around for a long time – each living in their own walled gardens, tightly coupled to fairly narrow use cases. As data and analytics infrastructure migrates to the cloud, many are challenging how these foundational technology components fit in the modern data and analytics stack. In this article, […]
Data Lakehouses: The Future Of Data Migration
It’s no surprise that, in 2023, business enterprises want to become truly data-driven organizations. For many of these organizations, the path toward becoming more data-driven lies in the power of data lakehouses, which combine elements of data warehouse architecture with data lakes. Data lakehouse architecture is particularly attractive to businesses that want to more rapidly […]
Data Mesh Architecture Benefits and Challenges
ThoughtWorks consultant Zhamak Dehghani created the concept of data mesh as a self-serve, domain-oriented design that later evolved into a data-as-a-product design. By integrating and analyzing data from disconnected systems all at once, the data mesh architecture benefits the organization by eliminating the need to pull data from multiple systems and preprocess it. In a […]
Are Data Warehouses Still Relevant?
Over the past few years, enterprise data architectures have evolved significantly to accommodate the changing data requirements of modern businesses. The emergence of advanced data storage technologies, such as cloud computing, data hubs, and data lakes, makes us question the role of traditional data warehouses in modern data architecture. Data warehouses were first introduced in the […]
The Hype Around Semantic Layers: How Important Are Standards?
There are several reasons why the notion of semantic layers has reached the forefront of today’s data management conversations. The analyst community is championing the data fabric tenet. The data mesh and data lake house architectures are gaining traction. Data lakes are widely deployed. Even architectural-agnostic business intelligence tooling seeks to harmonize data across sources. Each […]
Scaling Data Access Governance
The rise of data lakes and adjacent patterns such as the data lakehouse has given data teams increased agility and the ability to leverage major amounts of data. However, this ability comes with potential consequences. Constantly evolving data privacy legislation and the impact of major cybersecurity breaches has led to the call for responsible data […]