How to use the Function in Google BigQuery SQL — A perhaps not so well known but quite interesting function in BigQuery is the ROW_NUMBERfunction — how and when you can use it, you will learn in this small tutorial. The function is equally interesting for Data Scientists as well as Data Engineers. It allows you to assign a row…

What does a Big Data Engineer do and what can they earn? — In the field of data, in addition to Data Scientists and Data Engineers, there are also more and more job postings for Big Data Engineers — but what do they do and what can they earn? What are the Job Tasks? As a Big Data Engineer, you provide the data that your colleagues from Data…

How to implement a solid Data Platform on Azure — Data Lakehouses and Data Meshes are on the rise, it is important to say that they do not replace Data Warehouse and Data Lake but they extend them, so to speak. Microsoft also offers solutions in its Azure Cloud, here is an overview of how such a Data Mesh can…

Technology to save our Planet? Higher Computing Performance with significantly lower Energy Consumption — At Massachusetts Institute of Technology (MIT) a multidisciplinary team is working on developing a type of man-made analog synapse. In the process, they had already succeeded in producing synapses with a performance that could exceed that of biological synapses in the human brain by a factor of one million [1].

Google just integrated Cloud Spannner and BigQuery — Recently I wrote an article about how Google is building BigQuery more and more into a Big Data analytics form. With an integration into BigTable, BigLake and Analytics Hubs, BigQuery has become even more powerful as a SaaS, today the next good news are regarding BigQuery and Cloud Spanner. Spanner…

How BigQuery, BigTable and BigLake are now connected better — Google is pushing ahead with the expansion of its Google Cloud Platform services and, above all, the BigQuery Data Warehouse into a Big Data Platform. Indeed, the news are not completely new, because Google had already announced that BigTable and BigQuery are now easily integrable in itself and also an…

Governance and Security in Data Science Projects and Products — Data protection is becoming an increasingly important issue. Companies want to avoid the risk of horrendous fines [1], however we all personally should handle personal data with confidence, because everyone wants their personal information to be handled responsibly. Tension between Data Protection and Big Data In relation to the topic of Big Data, there is a certain…

How to control your Costs better in Google’s Data Warehouse — Google just announced a nice and handy new feature for BigQuery when using materialized Views: The max_staleness materialized view option [1]. With this option you can create views with consistently high performance but with controlled costs when processing large, frequently changing datasets. What are materialized Views and why using them?

How Microsoft focusses on the Mobile Business Intelligence Market — In the future, Microsoft will offer Power BI as an integration of its mobile Teams version — this should give the trend towards Mobile Business Intelligence another boost. Mobile Business Intelligence solutions deliver decision support information to tablets and smartphones. In essence, these are key figures that evaluate the course…