Thallam Gowthami
Summary
Senior Data Engineer with 9+ years of experience in building data intensive pipelines in Big Data environment. Expert in AWS, SparkSQL, PySpark, MariaDB, SQL and CI/CD tools. Collaborated with cross functional teams to deliver projects on time in BFSI, Telecom and Retail domains.
Overview
7
7
years of professional experience
Work History
BigData Engineer
DBS Bank Singapore
Singapore
03.2022
- Engaged with stakeholders in gathering requirements and developed the end-to-end job creation using AWS framework
- Built data validation and unit testing process across the regional group
- Supported the End Users in Live data verification, providing them assistance in using the reports and documenting the validation process for production
- Successfully created the monitoring framework for production jobs and supported the jobs in case of any discrepancy in data observed.
BigData Developer
TCS
01.2021 - 03.2022
- Successfully integrated hive and spark ecosystem and validated the configuration
- Automated the SQL scripts based on the requirements of business
- Deployed the jobs into production and documented the whole process
- Supported the jobs in production to the End Users
- End to End application development in AWS environment.
Bigdata Developer
Deloitte
08.2019 - 12.2020
- Worked on SparkSQL to build several data validation and user sign-off framework
- Implemented Attribute-based access control (ABAC) in the client environment to have control over the jobs
- Using ABAC framework to run the jobs
- Created several jobs in the ETL process and applied transformation on source data
- Whole ETL process developed and implemented using AWS.
Digital Data Practitioner
KPIT
02.2015 - 10.2016
- Developed queries in Impala and Hive to data workflow
- Worked on Sqoop for data transfer between RDBMS and HDFS
- Built enhanced Data Modeling structure for the Sales Forecasting project
- Implemented Hive Data sampling, Buckets and Cluster methods for schema
- Worked on to design the Hadoop Job workflows & scheduling using Oozie
- Worked on to test QlikView Dashboard.
Skills
- Big Data & Big Data Ecosystem
- Hadoop
- HDFS
- Hive
- Spark
- SparkSQL
- AWS
- AZURE
- Data Factory(ADF)
- HQL
- Sqoop
- Kafka
- Python
- Eclipse Oxygen
- IntelliJ
- ADA
- PowerBI
- SQL
- S3
Education
B.Tech from SRIT (CSE) under JNTU University from 2008 to 2012.
Timeline
BigData Engineer
DBS Bank Singapore
03.2022
BigData Developer
TCS
01.2021 - 03.2022
Bigdata Developer
Deloitte
08.2019 - 12.2020
Digital Data Practitioner
KPIT
02.2015 - 10.2016
Similar Profiles
Prashant ShilvantPrashant Shilvant
DELIVERY Lead at DBS Bank SingaporeDELIVERY Lead at DBS Bank Singapore
Yi ZhenYi Zhen
Network Automation Engineer at DBS Bank, SingaporeNetwork Automation Engineer at DBS Bank, Singapore
Mira LankatharanMira Lankatharan
Big Themes Xperiments Intern (University Internship) at DBS Bank, SingaporeBig Themes Xperiments Intern (University Internship) at DBS Bank, Singapore
KEZIA JACOBKEZIA JACOB
Bigdata Engineer at American Express, AMEXBigdata Engineer at American Express, AMEX
Dheeraj Reddy MalluDheeraj Reddy Mallu
Bigdata Engineer at DVR SOFTEKBigdata Engineer at DVR SOFTEK