Design Principle for designing a Modern Data Platform — When you build a Data Lakehouse, it is not that different from the architecture of a classical Data Warehouse, where the Medallion approach has established itself. Data Lakehouse Recap Building up a Data Lakehouse is not just about integrating a Data Lake with a Data Warehouse, but rather integrating a Data Lake, a…

More Options when using Round Function in BigQuery SQL — A quite popular function in the area of math functions in BigQuery is the ROUND() function. Here, Google has now provided some new options. This is maybe also an interesting article when working with BigQuery and mathematical functions. Mathematical Functions you should know in BigQuery How to Work with Numbers in BigQuerymedium.com Firstly, a short recap of what the ROUND() function does and how…

New Tool for Seamless Replication from Databases to BigQuery — Google already offers data integration options for BigQuery with Dataflow, Data Prep and the Data Transfer Service, but with Datastream it should now become even easier. While Data Flow needs a lot of programming and Dataprep is more used for data preparation and the Data Transfer Service only offers some…

Great News for Data Engineers who work with Snowflake — In Snowflake, tasks are a very powerful tool to build data pipelines or processes. Conveniently, there are now some news here. I recently wrote an article about how you can use Snowflake Tasks to map ETL or ELT processes, e.g. as a Data Engineer — read more here. Building Modern ELT Pipelines in Snowflake How to realize Data Pipelines with SQL and Tasks in Snowflakemedium.com

What is the better Business Intelligence Solution? — Data Analytics and (self-service) Business Intelligence are two topics that are definitely trending in companies right now. But which solution is the best? This time we compare Google Data Studio and Microsoft Power BI. To compare the two products, I evaluated the following three categories against each other. Infrastructure & Connectors As far…

What is the Job of a Big Data Analytics Director and what do they earn? — What does a Big Data Analytics Director do and how widespread is it? And perhaps the most interesting question: What do you earn in this position? So the good thing first, there is actually information about this position and also you can find job postings about it, they may not…

Is PHP good for Artificial Intelligence Use Cases? — Admittedly, when you think of Data Science, Machine Learning, etc. you tend to think of Python, Rust or R. But in fact use cases can also be implemented with PHP. Short Recap: AI, ML and DL Artificial Intelligence is an umbrella term and describes the broad approach of using machines to imitate intelligent human behavior in…

How to use Cloud Storage and BigQuery to build up a modern Data Platform — The Data Lakehouse is a modern approach to designing data platforms, it combines Data Lake and Data Warehouse — how you can build one in the Google Cloud you will learn in the following article. With Google’s cloud services, you have the right tools at your disposal, but before we…

How the new Feature can save you Performance and Money — In the operation of cloud applications, costs can be saved compared to conventional on-premise variants, especially in the area of Data Analysis, where many resources only have to be made available for a short time, but if used incorrectly or without optimization, unnecessary additional costs can also arise. …