Sushil Mohanty
Software Engineer/ Data Architect
Summary
Seasoned software engineer with over 15 years of experience in developing large-scale applications, data platforms, high-performance event processing pipelines, and designing data lakes and warehouses. Passionate about building cloud-native applications and creating scalable distributed systems, while adhering to DevOps best practices. A proven leader with a track record of managing teams and launching award-winning products from the ground up. A versatile contributor and open-source advocate, serving as a committer for Apache Lens, with extensive experience across both startup and enterprise environments.
Overview
17
17
years of professional experience
4
4
years of post-secondary education
Work History
Software Engineer(Data & Cloud)
Millennium Capital Management(Singapore)
10.2019 - Current
- Designed and implemented a real-time data platform integrating positions, trades, corporate actions, reference data, cash, PnL and more, utilizing Kafka, Spark Streaming, EMR, Redis, and Redshift. This platform serves as the firm's central data source, aggregating information from various sub-ledgers.
- Developed a data lake for efficient storage and retrieval of orders and events, utilizing Spark, Iceberg, AWS Glue, and Athena to meet reporting needs.
- Engineered a stateful datastore for cash balance calculations using Kafka kslDB.
- Contributed to the development of microservices for data delivery, leveraging Java and Spring Boot, Docker and Kubernetes.
- Developed tools and utilities for data migration, reconciliation, data quality management, process monitoring, and cloud infrastructure upgrades.
AVP, Sr Data Engineer
Mediacorp Pte Ltd
08.2018 - 09.2019
- Led the design and development of meID, a cloud-based user analytics platform integrating data from sources like Clickstream (Adobe), Google DFP, Lotame (DMP), Cxense (CR), and predictive analytics models, leveraging data trading partnerships, machine learning, and audience segmentation using big data technologies (Hadoop, Spark, Azure, SQL Warehouse, Scala, Kafka). meID won five awards at the Global BIGGIES Awards Data & AI 2019. Also spearheaded the development of Digital Optimizer, a platform for building lookalike target audiences and optimizing digital campaigns to enhance engagement rates.
Technical Lead - Big Data Platforms
Inmobi Technology Services Pvt. Ltd.
9 2008 - 8 2018
- Led the design, coding, unit testing, and code reviews for key features in Apache Lens, contributing to its development as a core member.
- Worked on a high-performance NoSQL store and service with a read latency of less than 10ms which caters over million of TPS at terabyte scale. The store serves as a cache for the ad serving system and analytic store for real-time/batch segmentation and model creation.
- Led the development of core data pipelines using Hadoop, MapReduce, and Oozie, enabling efficient data ingestion into a central warehouse for interactive reporting.
- Built a comprehensive data warehouse from the ground up to meet internal and external reporting needs, evaluating technology stacks, running pilot projects, designing dimensional data models, hierarchical rollups, data lifecycle policies, and ETL/ELT processes, while collaborating with cross-functional teams to gather requirements and optimize reporting and analytics.
- Played a key role in the early engineering team, designing an ad network data model with a focus on schema design, indexing, and optimizing complex queries for performance.
- Developed a highly available (99.99% uptime), scalable, low-latency (10TB) on PostgreSQL, and implemented tools for system performance analysis, database health checks, maintenance, capacity planning, and disaster recovery.
Database Administrator
Objectorb Technologies Pvt. Ltd.
12.2007 - 08.2008
- I was responsible for managing multiple database instances running in development, QA and production environment.
- Implemented replication solutions, participated in product benchmarking, implementing high availability systems and performance tuning.
Education
Bachelor of Engineering(Hons.) in Electronics & Instrumentation -
BPUT
India 01.2002 - 04.2006
Skills
BigData, Data Modelling, Data Warehouse, Datalake
Scala, Java, Python, SQL
Spark, Hadoop, Iceberg, Hive, EMR, Glue, Athena
Object-Oriented Programming, Functional Programming
TDD, Agile, Scrum
JPA, Spring Boot, REST
Jenkins, Octopus, Tidal, CI/CD, Docker, Kubernetes, Helm
Kafka, RabitMQ, ksqlDB
Postgresql, Mysql, Oracle, Redshift, Azure SQL Warehouse, Infobright, Vertica
DynamoDB, Redis
Timeline
Software Engineer(Data & Cloud)
Millennium Capital Management(Singapore)
10.2019 - Current
AVP, Sr Data Engineer
Mediacorp Pte Ltd
08.2018 - 09.2019
Database Administrator
Objectorb Technologies Pvt. Ltd.
12.2007 - 08.2008
Bachelor of Engineering(Hons.) in Electronics & Instrumentation -
BPUT
01.2002 - 04.2006
Technical Lead - Big Data Platforms
Inmobi Technology Services Pvt. Ltd.
9 2008 - 8 2018