Streaming pipeline
Built a streaming pipeline processing 5M events a day with exactly-once delivery.
DatabricksSparkKafka
BS-0068 · Remote · India (IST)
Data Platform Lead
10 years building data platforms teams trust.
Experience10 years
Work typeRemote
Time zoneIST · UTC+5:30
EnglishProfessional
About
Data Platform Lead with 10 years of experience, the last several leading teams of 4–8. Designs lakehouse platforms and leads data engineering teams. Strongest in Databricks, Spark, Kafka. Has worked directly with US, UK and EU product teams.
Selected work
Modern data stack
Migrated reporting to a modern data stack with modelled, tested tables. Dashboard refresh went from daily to hourly.
DatabricksSparkKafka
Skills
- DatabricksExpert
- SparkExpert
- KafkaAdvanced
- Delta LakeProficient
- AzureProficient
How BS-0068 was vetted
- ✓ GATE 01Technical screen
- ✓ GATE 02Live coding
- ✓ GATE 03System design
- ✓ GATE 04Communication & culture