Seasoned Lead Engineer with a resourceful, hardworking, and quality-driven mindset. Skilled in system design, building Integration systems and Big data landscape.
Overview
16
16
years of professional experience
Work History
Lead Engineer - Integration Services
Singtel
04.2023 - Current
Driving 3-year roadmap for Integration Services for IPaaS.
Directing MCP Hub strategy to enhance agent communication among various MCP servers.
Lead Integration Services Team which consist of 9 members across Singapore and India.
Engages extensively with EA and Infosec to secure ARB and SRB clearance, with recent highlights on hybrid Kafka Ecosystem offerings (On-Prem and AWS) and Point to Point Messaging as a Service (On-Prem and Azure).
Owns Messaging as a Service strategy for Event Streaming (Kafka Ecosystem Hybrid Offering) and Point to Point Messaging (AMQs and MQTT Brokers).
Oversaw design and execution of AWS MSK Kafka addressing defined use cases.
Established robust data-at-rest security protocols within Hadoop environments.
Senior Engineer
SAP Labs
10.2018 - 03.2023
Experienced Leader, Guided the global team of 9 members distributed across various time zones (India, US and Budhapest).
Led the complete implementation (infrastructure build, platform build) for 15+ Apache Kafka, Hadoop Clusters for various Data Centers as part of One Strike Project (on premise to Cloud) using Terraform (IAC), Jenkins(Orchestration Engine).
Led the migration of Big data Application from On-Prem to Cloud for 20 Data Centres.
Data Platform consists of Data Streaming platform (Kafka), Data Processing Engine (Flink), HDFS Data Lake (with different zone like Landing, Staging, archive) and Hive Data Warehouse which was used for Reporting Data Partitioning and bucketing to improve the performance of Data Warehouse.
Has experience handling various stakeholder and present solutions.
Worked on project to reduce the cost of big data application in cloud by 20%.
Has experience on FINOPS
Has experience handling multiple projects and delivery to completion.
Designed and implemented E2E Big Data Platform by Cloudera (CDP).
Implemented Apache Flink Clusters across 20+ Data centers for Stream Processing.
Directed the global team while troubleshooting various performance issue for the E2E pipelines.
Has good understanding of various file formats.
Design and implement data migration strategies of Cloudera Data Platform Well versed with Data management, data warehousing, data modelling concepts and implementation.
Worked as Tech Lead for big data application covering complete data cycle management and operations.
Implemented security for data platform Kerberos (Authentication) and Ranger (Authorization).
Led the project to implement CICD pipeline for automation of Release Management (Jenkins, GIT and Python/Shell Scripting)
Good understanding of various Machine Learning Algorithms. Ml-Ops lifecycle and design.
Senior Engineer
Singtel
04.2015 - 07.2018
Lead the first Cloudera Hadoop implementation
Day to day Hadoop operations activity including performance tuning, troubleshooting.
Capacity Planning
Oracle DBA day to day activities including installation, performance tuning.
Setting up RAC cluster
Configuring backup strategies RMAN, Export-Import
Setting up the DR environment using oracle Data guard
Performed the migration of database from non-ASM to ASM.
Created Day to Day operations tool based on Shell Scripts
Senior Engineer
Wipro Technologies Limited
11.2009 - 04.2015
Installed and configured Oracle Server and Client Software in Unix.
Configured and managed databases in Production Environment.
Performed the migration of database from non-ASM to ASM.
Data Guard setup.
Performance Tuning
Education
Post Graduate Diploma - Data Science (Deep Learning)
IIIT Bangalore
India
02.2022
Bachelors Of Engineering - Electrical Engineering
Govind Ballabh Pant Engineering College
Uttarakhand India
05.2008
Skills
undefined
Interests
Photography, Squash
Timeline
Lead Engineer - Integration Services
Singtel
04.2023 - Current
Senior Engineer
SAP Labs
10.2018 - 03.2023
Senior Engineer
Singtel
04.2015 - 07.2018
Senior Engineer
Wipro Technologies Limited
11.2009 - 04.2015
Post Graduate Diploma - Data Science (Deep Learning)