How the Cloud Data Warehouse is developing more and more into a Data Lakehouse — In the ever-evolving landscape of data management, two prominent concepts have emerged as pillars of modern data architecture: SaaS Data Warehouses and Data Lakehouses. These structures have fundamentally changed how organizations store, process, and analyze their data, revolutionizing the way businesses harness insights. While traditionally distinct, the lines between these…

How to use the Azure Cloud as a stable and modern Data Platform — Building a Data Mesh with Azure services like Azure Data Lake, Azure Synapse Analytics, and Azure Data Share enables organizations to create a scalable, decentralized data architecture. In the era of Big Data, organizations are continually seeking efficient ways to manage, analyze, and share their vast volumes of data. The…

How Snowflake integrates Iceberg Tables even more into it’s Ecosystem — In the area of Data Warehouses and Lakehouses more and more data will be integrated and analyzed in a key value pair structured form — here Snowflake of a new structured data type when using Iceberg tables. This new structured type is an ARRAY, OBJECT, or MAP that contains elements…

How you can now easily explore Data with Power BI — Microsoft just launched a new Data Analysis tool called Explore, which is integrated into Power BI. In Power BI, users often find themselves in need of spontaneous data exploration. This scenario might involve an analyst gaining access to a fresh dataset or source and wanting to delve into the data…

How to evaluate how relevant a Term is to a Tokenized Document — Google just launched a few new functions with which you can now more easily analyze text data — one of them is the TF_IDF function. In two other articles I already wrote about the new text functions within BigQuery, also with a small tutorial, with which you can now realize…

How Data Engineering & Data Science will become more easy through AI — Microsoft enforces their strategy to support Azure services, especially Data Engineering and Data Science tools with AI capabilities. Now, they have announced Copilot for Microsoft Fabric. This should assist users in swiftly initiating their journey by aiding them in generating reports within the Power BI web environment. With a concise…

How you can use it for better Data Analysis Performance — Data Skew can be a huge performance killer, however, you can now see query performance insights about partition skew within BigQuery[1]. If your data is uneven distributed it is called skew. An optimal table distribution has no skew. Skewed data distribution can cause queries to run slowly and therefore also…

How you can now use more advanced Mathematical Functions in BigQuery — Google just launched very useful functions which you can use for various mathematical and statistical Data Science cases. Just last week Google already announced the availability of more advanced text analysis functions in BigQuery and BigQuery ML with that you can realize Tokenization and Bag of Word with SQL. Now…

How to extract and analyze Terms from unstructured Text — Lately, Google has added a lot of new functions for BigQuery and BigQuery ML for analyzing and using prominent Data Science tools like Tokenization and Bag of Words. Another important new function that comes with these other updates is the PATTERN_ANALYZER function[1]. First thing, you should start getting into the…