PinnedPublished inRazorpay EngineeringReal-Time Denormalized Data Streaming Platform (Part-1)Contributors: Amit Prabhu, Tajinder Chawla, Harjeet SinghMar 30, 20231Mar 30, 20231
PinnedReconciliation at Scale — Part 1I remember a poem we read in English Literature that went likeAug 15, 2023Aug 15, 2023
PinnedPublished inData Engineer ThingsTransition to Data PlatformI am a data engineer and want to understand what is a data platform. How do I prepare for a data platform interview given I have decent…Sep 3, 2023Sep 3, 2023
ART(O) of taking an InterviewThe following article contains the methodology of interviewing and making an informed decision.Sep 22, 20242Sep 22, 20242
Data Engineering: System Design -L1System Design is a key make-or-break round at senior levels of any software engineering role. While it's easy to practice and implement…Aug 31, 2024Aug 31, 2024
Decoding the DOMAIN in DataSoftware Development is a tricky process, the choice of infrastructure, technologies used and the process followed is based on sound…Mar 31, 2024Mar 31, 2024
Cost Cutting. The Approach.You would have come across this word in recent times more often than not being used in different slack channels or thrown around in…Dec 9, 2023Dec 9, 2023
Reconciliation at Scale — Part 2I started with a poem in the previous article on reconciliation, if you haven’t read part 1 or want another look at the poem, please find…Sep 16, 20232Sep 16, 20232
Breaking into Data EngineeringData Engineering has become very popular over the past 4–6 years and many folks now want to switch to this data field. I am writing small…Jul 16, 2023Jul 16, 2023
Stuck In Middle- Data AspectWas recently having a discussion on a project where this term came up in my mind and it resonates with multiple people I talk to. And it is…Apr 8, 2023Apr 8, 2023
Data Engineer Interview- Entry LevelSome points I will try to cover in this write-up are:Jan 1, 2023Jan 1, 2023
Changing Looker Filters Via APIsLooker is a well-known BI tool. I was recently involved in some work where I had to modify the looks/tiles of a Dashboard via looker API…Aug 13, 2022Aug 13, 2022
Distributed Systems- ModernizationNote — DS → Distributed Systems wherever referred This is a modern take on distributed systems, you can read the other articles written by…May 22, 2022May 22, 2022
Data Engineering — W’sData Engineering is a niche in software engineering (you can disagree here.). It’s been there with Data Science at the start but it is…May 14, 2022May 14, 2022
Distributed Systems — ShardingThis is the third story in distributed systems, you can read the others here.Jul 25, 20211Jul 25, 20211
Capturing multiple outputs from Module -TerraformSo Terraform helps you create infrastructure, the way it works is we define resources that “need” to be created and TF helps you fulfill…Jul 23, 2021Jul 23, 2021
Creating Secrets in K8 using Multiple Provider -TerraformI recently got a chance to work on terraform in detail. One of the problems we solved was writing secrets to different K8 namespaces using…Jun 26, 2021Jun 26, 2021