How BigQuery, BigTable and BigLake are now connected better — Google is pushing ahead with the expansion of its Google Cloud Platform services and, above all, the BigQuery Data Warehouse into a Big Data Platform. Indeed, the news are not completely new, because Google had already announced that BigTable and BigQuery are now easily integrable in itself and also an…

Governance and Security in Data Science Projects and Products — Data protection is becoming an increasingly important issue. Companies want to avoid the risk of horrendous fines [1], however we all personally should handle personal data with confidence, because everyone wants their personal information to be handled responsibly. Tension between Data Protection and Big Data In relation to the topic of Big Data, there is a certain…

How to control your Costs better in Google’s Data Warehouse — Google just announced a nice and handy new feature for BigQuery when using materialized Views: The max_staleness materialized view option [1]. With this option you can create views with consistently high performance but with controlled costs when processing large, frequently changing datasets. What are materialized Views and why using them?

How Microsoft focusses on the Mobile Business Intelligence Market — In the future, Microsoft will offer Power BI as an integration of its mobile Teams version — this should give the trend towards Mobile Business Intelligence another boost. Mobile Business Intelligence solutions deliver decision support information to tablets and smartphones. In essence, these are key figures that evaluate the course…

Definition & Best Practices — A developer portal is a website with documentation of your APIs, tools or services. In such portals, consumers can discover, for example, APIs, learn how to use them, request access, and try out the APIs. A developer portal, or application programming interface (API) portal, is an important tool for companies…

No more ETL needed in between BigQuery and BigTable — With BigQuery, you can analyze data relatively easy using SQL and even create Machine Learning models using BigQuery ML. With BigLake you can now even analyze data across different platforms, so for example AWS and Azure. Now, Google introduces a new interesting feature regarding Google BigTable. You can use BigTable…

In which Countries can you earn the Most? — I recently did a salary comparison between EU and Europe regarding the salary for Data Engineers, this time I want to see in which countries you can generally expect a good salary. Now it might be interesting to know in which countries you can generally earn good money as a…

How to realize modern Data Management — A Data Fabric is an end-to-end data integration and management solution that lets you share data across your organization and lets you to go over and to manage data. A Data Fabric is designed to help organizations solve complex data problems and use cases by managing their data regardless of…

How to use the new Function in BigQuery SQL — If you’re like me and often work with Google Cloud and BigQuery, then you’re probably always eager to see new updates that will help you in your daily life, one of them is this new LOAD DATAfeature. While Google already had the EXPORT DATA statement implemented which allows to export…