Summary
Overview
Work History
Education
Skills
Certification
Job Profile
Residingaddress
Disclaimer
Personal Information
Timeline
Generic

Raghu Ramamoorthi

Senior Data Engineer
Singapore

Summary

Solid hands-on experience with Big Data Technologies like Apache Hadoop, Spark, Hive, Kafka, etc Specialized in using AWS services such as S3, Redshift, EMR, Lambda, Glue, and EC2 to build scalable and secure cloud data architectures. Great exposure in data ingestion involving large or near-real-time datasets, high data quality, increasing pipeline robustness and reducing the need for human intervention. Solid experience in building batch processing, real time and near real time data ingestion pipelines with Apache Kafka, Apache Spark streaming using Python, Java and Scala. Proven experience in Design, Develop, Test, Build and deploy Big Data and machine learning solutions for handling Petabyte scale data using Python, Java and Scala. Good exposure to Azure cloud technologies like ADLS, Synapse Analytics, Azure Databricks , ADF, Azure functions, Keyvault, AzureML, logic apps, AKS, etc Hands on experience in writing HiveQL and SparkSQL queries for querying and analyzing large volume of data. Hands on experience in Hive joins, partitions and bucketing and transactions. Worked with various file formats like Flat files, images, GIS, Avro, ORC, Parquet, XML, JSON, etc Solid hands on experience with containerization and orchestration using Docker and Kubernetes on various cloud platforms and on premise. Diligent Data Engineer with robust background in data engineering and proven ability to design and implement complex data pipelines. Successfully contributed to optimizing data architecture and enhancing data processing efficiencies. Demonstrated expertise in big data technologies and proficiency in Python and SQL.

Overview

11
11
years of professional experience
6
6
years of post-secondary education
1
1
Certification
2
2
Languages

Work History

Senior Data Engineer

MODEC Offshore production systems
02.2022 - Current
  • Led the design and implementation of a data lake on AWS S3, facilitating efficient storage and retrieval of large-scale datasets
  • Hands on experience in design and develop data engineering services and storage using distributed databases and orchestration using Apache Airflow and distributed stream/batch data processing Kafka, Kinesis and apache Spark
  • Design and develop MLOps production pipelines; provide technical support to data scientists/ML engineers by getting their ML/DL models deployed at scale and meeting SLAs on both cloud and on-premises GPU and CPU instances
  • Employed advanced machine learning techniques to derive insights from diverse data sets.

Senior Data Engineer

Vulcan AI pvt ltd
02.2020 - 02.2022
  • Involved in the Design, Coding and Testing for the AI ops as per the client requirement
  • Designing, implementing, Developing and orchestrating Machine Learning pipelines for various machine learning models using tensorflow, cuda as per the requirement
  • Implemented a serverless data processing solution using AWS Lambda and AWS Step Functions, streamlining workflows and reducing costs
  • Optimized ETL pipelines using AWS Glue, achieving a 60% improvement in data processing speeds and reducing operational overhead
  • Data preparation, Pre-processing and Ingestion
    from various data sources like Satellite images, XML, GIS files
  • Responsible for integrating, building & testing of Data pipelines in AWS
    Data pipeline
  • Involved in CI/CD pipelines using Jenkins, Masterdeploy Containerization and orchestration using Docker
  • Setting up the different environments in AWS for dev, testing and production

Senior Data Engineer

Credit Agricole CIB
09.2018 - 02.2020
  • Worked in building the data pipeline to ingest the data to the centralized data lake
  • Coordinated with the business team directly to gather the requirements and translating the functional requirements to the technical designs
  • Well versed in designing the data flow architecture based on the business team inputs
  • Extensively worked on writing Spark codes based on java to cleanse, filter, normalize, nest, persist the data files and referential files from various sources to the data lake
  • Hands on experience with the data orchestration by on boarding the data ingestion as a part of automation
  • Great exposure in building the Jenkins build pipelines and master deploy jobs deployment in various environments
  • Helped in data ingestion pipeline performance improvements

Senior Analyst – Big Data

Ernst and Young (EY)
01.2017 - 05.2018
  • Collaborated with stakeholders to identify business needs and data sources.
  • Partnered with interdisciplinary teams to articulate requirements and build comprehensive solutions in data engineering.
  • Designed and executed scalable data solutions to enhance system performance for high-traffic applications.
  • Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
  • Implemented cutting-edge machine learning algorithms to unlock valuable insights from large volumes of structured and unstructured data.
  • Devised and deployed predictive models using machine learning algorithms to drive business decisions.

Senior Systems Engineer

Cognizant Technology Solutions
02.2014 - 12.2016
  • Provided expert guidance on best practices in systems engineering, improving team performance and product quality.
  • Optimized system performance by identifying and resolving complex technical issues.
  • Collaborated with clients to determine need and devise appropriate software and hardware solutions.
  • Performed root cause analysis to provide resolutions for production issues.
  • Mentored junior engineers in advanced concepts, fostering professional development within the team.

Education

B.E - Computer Science and Engineering

Sriram Engineering College
India
05.2008 - 05.2012

12thStd -

Thavasumuthu Nadar Hr.Sec School
India
01.2008 - 12.2008

10thStd -

Thavasumuthu Nadar Hr.Sec School
India
01.2006 - 12.2006

Skills

Apache Hadoop

Apache Spark

Kafka

Hive

HDFS

YARN

Python

Java

Scala

MySQL

Oracle

SQL Server

Hbase

Cassandra

MongoDB

AWS

MS Azure

undefined

Certification

Databricks certified Data Engineer Associate

Job Profile

Senior Data Engineer, MODEC Offshore production systems, Singapore, 10.6 Years, 7 Years, 8.6 Years, 4 Years, 7 Years, 2 Years

Residingaddress

#09-277, BLK 310, Clementi Avenue 4, Singapore, 120310

Disclaimer

I assure you that the details furnished above are true to the best of my knowledge.

Personal Information

  • Blood Group: A1 Positive
  • Date of Birth: 06/02/91
  • Gender: Male
  • Nationality: Indian
  • Visa Status: Employment Pass

Timeline

Senior Data Engineer

MODEC Offshore production systems
02.2022 - Current

Senior Data Engineer

Vulcan AI pvt ltd
02.2020 - 02.2022

Senior Data Engineer

Credit Agricole CIB
09.2018 - 02.2020

Senior Analyst – Big Data

Ernst and Young (EY)
01.2017 - 05.2018

Senior Systems Engineer

Cognizant Technology Solutions
02.2014 - 12.2016

B.E - Computer Science and Engineering

Sriram Engineering College
05.2008 - 05.2012

12thStd -

Thavasumuthu Nadar Hr.Sec School
01.2008 - 12.2008

10thStd -

Thavasumuthu Nadar Hr.Sec School
01.2006 - 12.2006
Databricks certified Data Engineer Associate
Raghu RamamoorthiSenior Data Engineer