Preeti Tripathi
Senior Data Engineer
Summary
As a software developer I've focused on developing
scalable and robust code. I
enjoy working collaboratively but can also run with
projects on own. Looking out for an opportunity to enhance learnings and skills and build next generation software's. Aspiring for enhancing data scientist skills.
Overview
12
12
years of professional experience
3
3
years of post-secondary education
Work History
SENIOR DATA ENGINEER
Quess Corp LTD
8 2022 - Current
- Identify and resolve data issue .
- Build data pipelines that clean, transform, and aggregate data from disparate sources.
- Enhancing picoline to migrate data from HDFS to AWS S3 as per business requirement. .
- Participated in strategic planning sessions with stakeholders to assess business needs related to data engineering initiatives.
- Reduced operational costs by automating manual processes and improving overall data management efficiency.
- Prepare ad hoc visualization report for cluster metrics and batch performance.
DATA ENGINEER
BlackStraw AI Tech
08.2021 - 07.2022
- uilding attribution Model(ETL pipeline) for
analyzing revenue and performance of
brands and factors impacting the campaign and
their sales. - Automated routine tasks using Python scripts, increasing team productivity and reducing manual errors.
- Developed python based model to perform
cleaning of raw data, pre and post processing
validation to avoid outlier's and inconsistence
results.. - Designed and visualize report for data
science team to map different raw data and
highlight keys/factor which helps to increase
sales/revenue of items periodically. - Collaborated with system architects, design
analysts and others to understand business and
industry requirements. - Fine-tuned query performance and optimized
database structures for faster, more accurate
data retrieval and reporting.
SENIOR SYSTEM ENGINEER
Larsen And Toubro Infotech
09.2017 - 09.2019
- Collaborated in development of PaaS
application which enable users to perform ETL,
data margining , cataloguing and interactive
with different data sources and format of data. - Identified software issues and handled
troubleshooting to resolve quickly. - Improved application services but automating
hive table creation with dynamic partitions as
soon as data loaded into PaaS application. - Build scalable, reliable data pipelines to cleans,
transforms, and aggregates data from various
sources (SAP,,RDBMS,,CLOUD ) and platforms into
data warehouse. - Supported platform deployment to Cloud.
HADOOP CONSULTANT
Xebia India IT Architect PVT LTE
05.2016 - 09.2017
- Writing batch processing jobs for performing data
cleaning and aggregation task. - Experience with different form of data ie
AVRO,json, delimited etc. - Collaborate with business team, translate
business requirements, design and build useful data
metrics and data products in order to support and scale business needs. - Rest-API service developed to fetch data from
No Sql HBASE. - Exposure in writing UDF.
- Developing solution to provide unified report for
publishers whose advertising data come from
different sources.
ASSOCIATE
Cognizant Tech. Solutions
10.2015 - 05.2016
- Developed script to generate 5000 messages
per second which will change status of meters
either ON/OFF. Script is used to generate dummy
data . - Importing and exporting data from HDFS using
Flume. - Developed multiple MapReduce job in java for
data cleansing and preprocessing.
SYSTEM ENGINEER
Tata Consultancy Services
06.2012 - 10.2015
- Resolved issues and escalated problems with knowledgeable support and quality service.
- Contributed in design of interface used to
perform configuration network element NEM. - Designed prototype to display all information
over command line which help user in
configuring network element. - Developed solution to parse correct properties of
network element before storing in middleware in
multi-threading while designing framework and
interface of COM (Common Operation and Maintenance).
Education
MASTERS OF COMPUTER APPLICATIONS -
Rajiv Gandhi Proudyogiki Vishwavidyalaya
07.2009 - 05.2012
Skills
- Big Data
- Hadoop
- Spark, Java Spark
Python ,PySpark
Jira ,Grafana
- PL/SQL, SQL
- Scheduling workow
- MariaDb,RabbitMq
- Java , Scala
- NoSql, HBASE
- Bash , CI/CD, Google Cloud
Traits
I hold the good experience in building ETL batch pipelines for a business requirement.
Familiar with data warehouse concept and have production experience.
Good team player and have good analytical skill, willing to accept challenges and quick in resolving problems.
Able to design resilient and robust data ows.
Optimizing batch and processing to meet SLA.
Fix and Enhance pipeline to migrate data from HDFS to AWS S3.
Visualize data report.
Accomplishments
- Achieved Rookie Award from client DBS for
performance in resolving production issue and
improving deliverables. - Received multiple client appreciation notes for production optimization and meeting SLA.
- Received best team member from client IRI for re-designing attribution model with scalable model and designing automation pipeline for pre and post processing.
- Received Awards from TCS for employee of the month.
Timeline
DATA ENGINEER
BlackStraw AI Tech
08.2021 - 07.2022
SENIOR SYSTEM ENGINEER
Larsen And Toubro Infotech
09.2017 - 09.2019
HADOOP CONSULTANT
Xebia India IT Architect PVT LTE
05.2016 - 09.2017
ASSOCIATE
Cognizant Tech. Solutions
10.2015 - 05.2016
SYSTEM ENGINEER
Tata Consultancy Services
06.2012 - 10.2015
MASTERS OF COMPUTER APPLICATIONS -
Rajiv Gandhi Proudyogiki Vishwavidyalaya
07.2009 - 05.2012
SENIOR DATA ENGINEER
Quess Corp LTD
8 2022 - Current
Similar Profiles
Syed AssadullahSyed Assadullah
Master Trainer at Quess Corp LtdMaster Trainer at Quess Corp Ltd
SAMPATH KUMAR BOJJASAMPATH KUMAR BOJJA
Documentation Executive at QUESS CORP LTDDocumentation Executive at QUESS CORP LTD
Krishna Kumar MKKrishna Kumar MK
Sr.Manager - Finance at Quess Corp LtdSr.Manager - Finance at Quess Corp Ltd