Metadata Intelligence: Making Your Catalog Work for You
AI-Augmented Data Engineering — Article 5 of 7
Tech4Nirvana
A space where Data Engineering, AI, and Cloud Architecture meet timeless wisdom. Written by Karthik Darbha — Senior Data Engineering & AI Leader with 23+ years of experience across Healthcare, Pharma, Retail, and Financial Services.
Latest articles
Root Cause Analysis Without the War Room
AI-Augmented Data Engineering — Article 4 of 7
Observability That Thinks: AI for Pipeline Monitoring
AI-Augmented Data Engineering — Article 3 of 7
AI-Driven Data Quality: From Rules to Reasoning
AI-Augmented Data Engineering | Article 2 of 7 | tech4nirvana.com
The Case for AI in Data Engineering
Series: AI-Augmented Data Engineering | Article 1 of 7 There is a quiet crisis in most data engineering teams. Pipelines fail at 2 AM. The on-call engineer spends three hours tracing a root cause tha
The Art of Program Visibility: Managing Databricks + Azure Data Programs at Scale
The Invisible Failure Most data platform programs don't fail loudly. They fail quietly — one missed dependency, one unreported pipeline issue, one status update that said 'green' while the underlying
Letting Go of Control: What Advaita Teaches Us About Liquid Clustering
There is a pattern in mature engineering: the more you try to control, the more brittle the system becomes. Liquid Clustering is Delta Lake's answer to over-engineering. Vedanta figured this out mille
Unity Catalog - the Unified Self
How Databricks Unity Catalog Mirrors the Advaitic Vision of One Undivided Reality
Migrating SPC Run Rules from SAS to Databricks
A Pharma Supply Chain Engineering Perspective · tech4nirvana.com Why This Migration Is Non-Trivial Earlier, I worked as Product Owner and Data Architect on a SAS to Databricks migration for a Pharma
