Hadoop Administrator, Solution Architect, Data Engineer,
Singapore
Summary
Passionate professional with 12+ years of experience in Information Technology, specializing in delivering end-to-end Analytics products both on-premises and in the cloud.
Result-driven associate manager with a track record of success in leading cross-functional teams in complex and large-scale Analytics and Big Data system integration projects.
Experienced in setting up and managing large Cloudera CDP Hadoop clusters, troubleshooting production servers, and resolving infrastructure and application issues.
Skilled in Cloudera CDP version upgrades, implementing Transparent Data Encryption (TDE), and configuring Hadoop distribution tools like Cloudera Manager. Proficient in commissioning, decommissioning, balancing, and managing nodes for optimal cluster performance.
Expertise includes setting up enterprise analytics platforms from scratch in government data centers and public clouds, as well as implementing data virtualization platforms using Denodo.
Possesses effective interpersonal and communication skills, strong analytical abilities, and the capacity to work independently or as part of a team.
Overview
13
13
years of professional experience
5
5
years of post-secondary education
Work History
Application Associate Development Manager
Accenture
03.2023 - Current
Leading an AMS (Application Maintenance & Support) team to support and maintain the Government Finance Analytical Systems
Performed the Cloudera Cluster upgrade from CDP 7.1.7 to 7.1.9
Implemented Transparent Data Encryption (TDE) for Cloudera Clusters
Upgraded MicroStrategy 2021 update 4.1 to MicroStrategy 2021 update 12
Built Data Virtualization and self-service data delivery platform from the scratch using Denodo 9.0 and created an MVP for exploring new capabilities
DWH Schema / Table Design for new enhancement requests
Effort Estimation & Impact Analysis for new enhancement requests
Designing the Server Architecture, Firewall Requirements for setup and upgrades of new data analytics and data lake Environments
Established Single-Sing on for various applications using SAML Authentication
Responsible for Data Analytics System Monitoring & Maintenance, which includes regular VA scans to assess the vulnerable components and to promote the fixes to the windows, Linux servers for various BI, ETL and Hadoop, and Bigdata applications
Lead Consultant
NCS PTE Ltd
07.2020 - 03.2022
As a Lead Consultant, I'm responsible for the following high-level activities
BI Platform Upgrade MicroStrategy 2019 to MicroStrategy 2020
BI Platform Migration from the existing data center to Government Data Centers
Built Cloud-based BI solution for the Clients using Government Cloud Provisions on Azure
Responsible for BI Platform is up and running 24/7 to support for ministries users from Singapore Government
Responsible for BI Serve Monitoring & Maintenance
Integrating R with MicroStrategy to create predictive analytics metrics for reporting usage for end clients
Senior Consultant
Avensys Consulting PTE Ltd
07.2018 - 07.2020
BI Platform Upgrade MicroStrategy 10.4 to MicroStrategy 11 (MSTR 2019)
Effort Estimation & Impact Analysis for new enhancement requests
Designing the Server Architecture & Firewall Requirements for BI Platforms
Estimating the Licensing Requirements
Integrating R with MicroStrategy to create predictive analytics metrics for reporting usage for end clients
Integrating the Hadoop data lake as data source for BI applications such as MicroStrategy, Tableau & Power BI
Responsible for BI Platform is up and running 24/7 to support for ministries users from Singapore Government
Responsible for BI Server Monitoring & Maintenance
Senior Software Engineer
Motivity Labs Inc
01.2016 - 06.2018
Senior Associate
InfoCepts
03.2015 - 10.2015
Systems Engineer
Tata Consultancy Services
06.2012 - 02.2015
Education
B.E - ECE
Thiagarajar College of Engineering
Madurai, India
01.2009 - 01.2012
Diploma - IT
Swami Abedhanandha Polytechnic College
Thellar, India
01.2007 - 01.2009
Skills
Data Migration & Data Center Transition Management