Soumya Thakur Choudhury
Summary
Dynamic Data Application Specialist with a proven track record at Ampol, excelling in Snowflake and Dataiku. Spearheaded integration of CI/CD pipelines, enhancing deployment efficiency. Adept in data management and business analysis, driving impactful solutions that elevate operational performance and stakeholder alignment. Recognized for expert troubleshooting and fostering collaboration across teams.
Overview
13
13
years of professional experience
1
1
Certification
Work History
Data Application Specialist
Ampol
07.2024 - Current
- Serving as the product owner for enterprise data platforms—**Snowflake** and **Dataiku**—ensuring they meet business, governance, and operational needs.
- Leading end-to-end **platform lifecycle management**, including product upgrades, roadmap planning, and capacity scaling.
- Spearheading the **integration of Git for version control and CI/CD pipelines**, improving collaboration, audibility, and deployment efficiency.
- Collaborating with cross-functional teams including **data engineers, developers, and business stakeholders** to validate design solutions and ensure technical fitment for production use.
- Managing all **vendor relationships**, including contract oversight, delivery governance, SLA tracking, and roadmap alignment.
- Driving **design reviews, quality assurance, and production readiness checks** for all data pipelines and applications deployed on the platforms.
- Overseeing the day-to-day operations and performance of the data platforms, ensuring uptime, scalability, and compliance with internal policies and external regulations.
- Acting as a key point of contact for **issue resolution, stakeholder alignment**, and enabling business value through scalable data solutions.
Solution Architect -Data and Transformation
Enterprise Singapore
03.2022 - 07.2024
- Designed, built, and maintained scalable ETL pipelines on AWS Lambda enabling seamless data ingestion from diverse and complex source systems.
- Utilized AWS DMS (Database Migration Service) for real-time, accurate, and consistent data replication from multiple sources to target systems.
- Engineered robust data transformation workflows using DBT, facilitating the creation of efficient data models, staging layers, and data mart tables in cloud data warehouses.
- Ingested real-time data via API integrations and loaded it into Amazon Redshift, supporting high-performance analytics and business intelligence solutions.
- Developed and managed CI/CD pipelines using AWS CodePipeline and CodeBuild, automating deployments, testing, and integration workflows for production-grade systems.
- Implemented containerized ETL processes using Amazon ECS, improving scalability, deployment efficiency, and runtime resource management.
- Led infrastructure automation initiatives with Terraform enabling repeatable and consistent infrastructure provisioning across multiple environments.
- Managed version control and collaborative development workflows through AWS CodeCommit, ensuring reliable and auditable code changes.
Data Architect
Great Eastern Singapore
09.2020 - 02.2022
- Developed robust ETL pipelines using Talend Bigdata , integrating data from multiple heterogeneous sources for seamless transformation and loading across systems.
- Executed data orchestration workflows using UC4, ensuring timely and reliable data movement within the IFRS 17 regulatory reporting project at Great Eastern.
- Performed data profiling, validation, and impact analysis**, contributing to high data accuracy, consistency, and compliance standards.
- Created data model diagrams, process flows, and system use cases using Microsoft Visio, enabling clear communication with stakeholders and solution alignment with technical requirements.
- Drafted and optimized end-to-end business process flows, collaborating with third-party vendors to ensure interface compatibility with their systems and requirements.
- Actively collaborated with source system owners and business stakeholders, gathering requirements and designing detailed ETL mappings for multiple modules.
- Involved in full SDLC phases, from requirement gathering, design, and development to system testing and production deployment.
- Led stakeholder interviews to gather detailed user and business process requirements, ensuring solutions align with operational needs.
- Performed data modeling activities, laying down structured and scalable foundations to derive actionable business insight
BI Solution Architect
Duty Free Shop
03.2012 - 08.2020
- Architecting end-to-end data design and transformation solutions**, including system analysis, low-level design documentation, and source-to-target mappings aligned with business and technical requirements.
- Developing and optimizing complex ETL jobs using tools like IBM DataStage, with a focus on performance tuning, scalability, and efficient data processing
- Writing advanced SQL scripts for Snowflake and Netezza, enabling seamless transformation and loading into cloud and on-premise data warehouses.
- Utilizing strong command of UNIX and shell scripting to support automation, ETL workflows, and data engineering operations.
- Demonstrating strong cross-platform database expertise across Snowflake, Netezza, Oracle, and SQL Server, with deep experience in **query optimization, performance tuning, and database administration.
- Leading digital transformation initiatives, including the design and implementation of real-time data pipelines to support executive dashboards and near real-time analytics.
- Managing the entire BI production landscape**, including **incident resolution, change management, service request handling, and root cause analysis**, reducing recurring issues and improving operational stability.
- Managing the entire BI production landscape, including incident resolution, change management, service request handling, and root cause analysis, reducing recurring issues and improving operational stability.
- Driving automation of monitoring activities performed by offshore teams, increasing operational efficiency and reducing manual overhead.
- Delivering project management responsibilities, including estimation, status reporting, impact analysis, and execution oversight for critical system and data changes.
- Conducting impact assessments for change requests, ensuring data integrity and seamless integration with minimal disruption.
Education
Bachelor of Technology - Computational Science
West Bengal University Of Technology
West Bengal10-2010
Skills
- Snowflake
- Dataiku
- Data Scrapping
- Business analysis
- End user support
- Expert troubleshooting
- Incident management
- Python
- Data management
- ITIL framework
- Data modeling
- Enterprise architecture
- Analytics
- Data mining
Certification
- AWS Certified cloud Practitioner
- AWS Certified Data Analytics -Specialty
- Snow Pro Core Certified
- IBM Certified Infosphere Developer
- IBM Certified Pure Data system for Analytics
- Professional Scrum Master
- ITIL V4
Timeline
Data Application Specialist
Ampol
07.2024 - Current
Solution Architect -Data and Transformation
Enterprise Singapore
03.2022 - 07.2024
Data Architect
Great Eastern Singapore
09.2020 - 02.2022
BI Solution Architect
Duty Free Shop
03.2012 - 08.2020
Bachelor of Technology - Computational Science
West Bengal University Of Technology
Similar Profiles
JAMIE HUBINSKIJAMIE HUBINSKI
Operations Manager QLD/NT at AmpolOperations Manager QLD/NT at Ampol
Vishesh Donthi PrasadVishesh Donthi Prasad
Customer Service Representative at AmpolCustomer Service Representative at Ampol
Shuvecha BhattacharjeeShuvecha Bhattacharjee
Customer Service Representative at AmpolCustomer Service Representative at Ampol