Generative AI, or GenAI for short, is the latest buzzword in tech, but what exactly is it? Let’s break it down in simple terms.

GenAI refers to artificial intelligence systems that can create new content, whether it’s text, images, music, or even code. These systems learn patterns from …

I have been playing with the COVID-19 data since it has been released by Johns Hopkins on GitHub. This data is updated every day from various data sources such as WHO, CDC and health organizations of other countries.

This blog talks about how to implement Timeseries Forecasting using Prophet for …

In the previous blog on Framework for Data Governance, I introduced the three spheres of data governance. This blog focuses on the first sphere — the Organization Sphere — and explains in detail the factors and levers within it.

Organization refers to the people part of the enterprise, and the part …

The need for Data Governance has been established — it has become one of the key initiatives organizations are focusing on when it comes to managing data. This blog talks about the differences in Data Governance in the digital era compared to traditional Data Governance practices.

DG Process and …

Data governance (DG) has become one of the key themes of information management. Data leaders in corporate organizations are feeling the need to put data governance into practice. Changing business models, technology democratization, security, and increasing digital assets have made data governance …

Organizations are generating and using data more than they ever had. The value of data is undisputed — comparisons are being made with oil and gold. The ecosystem that organizations operate in is also changing, both externally as access to technology has been democratized by cloud providers, and …

Greeks are famous for many things. But the first thing that comes to mind when we hear “Greek” is Greek Architecture and Greek Alphabets (alpha, beta, gamma…).

Greek Architecture is the flowering of geometry.

What happens when we merge Greek alphabets with Greek architecture? We …

The first part of this post can be found at Processing Real-Time Streams in Databricks – Part 1.

This is the continuation of Part 1 — we won’t repeat the architecture and setup. In this section we go into Azure Databricks and create the cluster and notebook to ingest data in real-time, …

Databricks is becoming the new normal in data processing technologies in cloud, both Azure and AWS. This is a step-by-step guide to get started on real-time (streaming) analytics using Spark Streaming on Databricks.

Architecture

The demo was built to show the speed layer (hot path) of a typical …