JOHN JEYARAJ.S
Singapore
Summary
Senior Azure Data Engineer with over10 years of experience in Data Warehousing and Business Intelligence, with expertise in analysis, design, development, testing, and implementation of reporting and ETL processes.4+ years of hands-on experience with Microsoft Azure, including Azure Data Factory (ADF) and Azure SQL Data Warehouse. Proficient in working with Microsoft Fabric. Skilled in Data Migration, System Integration, Reporting, and Data Management.
Overview
15
15
years of professional experience
1
1
Certification
Work History
Azure Data Engineer
Singsoft Solutions Pvt Ltd
03.2020 - Current
- Successfully automated ETL workflows for large-scale data integration, reducing manual effort by70%
- Integrated data from multiple sources including on-premises databases, cloud-based systems (Azure Blob Storage, SQL Databases), and third-party APIs using Azure Data Factory pipelines
- Optimized ETL performance by implementing incremental load strategies and managing data volume efficiently
- Reduced pipeline execution time by40% through performance tuning and optimized data transformation logic in Azure Data Factory
- Implemented parallel data processing strategies to handle large datasets, leading to a significant reduction in processing time
- Implementing Copy activity, Custom Azure Data Factory Pipeline Activities
- Responsible for extracting data from blob storage, API files and Oracle Fusion files
- Design and development of Azure SQL data warehousing scripts, database design and query optimization
- Deploying all the codes in Azure DevOps for version control
- Weekly reporting of project task management
- Ensuring project deliverables PSA Quality standards
- Client: PSA
- Customer Type: Logistics
- Container Lifecycle Visibility: Once a container is declared, a lifecycle process begins to track its movement through various stages, including arrival/discharge entry points and the container offloading system
- The offloading system for shipping containers consists of a longitudinal body with spacers attached to the lower section for structural support
- When mounting a volume into a container, the specified directory is the one that gets mounted into the container
- Container Load refers to a shipment that either fully fills a container by bulk or reaches the maximum allowable weight, representing the volume of goods that can be transported in a standardized shipping container
- DSO (Days Sales Outstanding): DSO is a key metric for monitoring customer payment behavior and is included in monthly group reporting
- It is typically calculated at month-end based on customer aging data
- However, for more effective monitoring, DSO should also be calculated daily using the customer aging by invoice table
- To ensure accurate DSO calculation, revenue data must be uploaded to the Global AR Cube as part of the process
Team Lead
DataSemantics
01.2018 - 02.2020
- Extracted data from Salesforce, Ensag, Oracle, and Excel, then loaded it into Azure SQL Database using Azure ADF, Azure Data Lake, and Logic Apps
- Worked extensively with OLAP cubes using SSAS, including creating and managing them
- Developed reports, scorecards, and dashboards using PerformancePoint Server
- Created calculated members, named sets, and advanced KPIs for SSAS cubes
- Optimized queries and enhanced database server performance using Performance Monitor and SQL Profiler
- Designed table schemas and stored procedures for Data Quality Control (QC)
- Provided executives and operational users with powerful analytical tools and detailed insights into operational and sales performance
- Integrated custom visuals into Power BI based on business requirements
- Used Power BI and Power Pivot to develop data analysis prototypes, and leveraged Power View and Power Map for report visualization
- Published Power BI reports across required organizations and made dashboards available on web clients and mobile apps
- Embedded Power BI reports in the Salesforce portal and managed user access through roles
- Client: Emaar
- Customer Type: Point of Sales
- The PQA Handover Dashboard is a crucial tool with high management visibility, requiring a technical migration along with design enhancements
- Once a property is developed, the Emaar QA process generates a snag list that must be resolved
- This is followed by a customer pre-handover inspection, which leads to a customer-specific snag list that also needs to be tracked and closed
- The final outcome is a successful handover of the property
Senior BI Consultant
DataSemantics
01.2016 - 12.2018
- Extracted data from Salesforce into SSIS using the Salesforce connector
- Profiled and transformed data from the source to meet user requirements
- Analyzed databases to provide detailed operational insights and forecasts for future years
- Delivered powerful analytics and detailed information on operational and sales performance to executives and operational users
- Integrated custom visuals in Power BI based on business requirements
- Embedded Power BI reports into the Salesforce portal and managed user access to reports and data using roles
- Collaborated with the Microsoft team to address product limitations and communicated these limitations and tool capabilities to IT and business stakeholders
- Created ad-hoc Excel reports based on business user requirements
- Client: Philips
- Customer Type: Healthcare
- The BMC OnePager provides accurate funnel projections by comparing historical data to actuals, including funnel commit, best-case scenarios, and gaps to AOP
- It tracks the top reasons for losses, monitors funnel progression at each sales stage, and evaluates SFDC data in terms of market coverage
- Additionally, it highlights top opportunities in priority areas and assesses the market's past performance in win rates and EOD accuracy
Programmer Analyst
Software Paradigm InfoTech
01.2014 - 12.2015
- Worked with advanced analysis techniques, including table calculations, calculated fields (such as KPIs) using various functions (SUM, IF, MAX, MIN, AVG, ATTR, DATE Functions, etc.), parameters, sets, background images, logos, totals, forecasts, trend lines, and dual axes to create robust reports
- Created Tableau dashboards with diverse filters, parameters, and calculated fields
- Designed and published visually appealing and interactive Tableau workbooks and dashboards to support executive decision-making
- Developed complex reports using advanced charts such as waterfall, funnel, bump, and control charts
- Utilized Tableau’s data blending feature to combine data from multiple databases
- Contributed to technical design documentation, including project solution and technical scope documents
- Created, scheduled, and managed ETL operations for Sales and Inventory using Microsoft SSIS
- Client: Energizer Battery
- Customer Type: Retail
- This project involved creating Tableau reports for Sales and Inventory, enabling business users to monitor the overall performance of the sales operations
- Enhanced functionality improved report interaction, making it more efficient and allowing users to quickly respond to the insights presented
Programmer Analyst
Software Paradigm InfoTech
04.2012 - 11.2013
- Contributed to the creation of technical design documents, including Project Solution and Technical Scope Documents
- Built and managed ETL operations for large data volumes using Microsoft SSIS
- Proficient in designing high-level SSIS packages to integrate data from heterogeneous sources (Excel, CSV, Oracle, flat files, text formats) using OLEDB connections and various SSIS transformations such as Data Conversion, Conditional Split, Bulk Insert, Merge, and Union All
- Expertise in creating Star and Snowflake schema cubes using SSAS
- Extensive experience working with OLAP cubes in SSAS
- Created and managed OLAP cubes using SSAS
- Client: Hershey Kroger
- Customer Type: Retail
- The Hershey Company is a leading North American manufacturer of high-quality chocolate, non-chocolate confectionery, and chocolate-related grocery products
- This project focuses on managing customer details, points of sale, seasonal sales, and predictive analysis
- Data is generated through an ETL process to ensure it is clear and actionable
BI Consultant
Distil Information PVT LTD
01.2010 - 03.2012
- Developed dashboards to visualize sales and commission data, highlighting goal achievement and attainment
- Created alert reports for users and managed user privileges
- Designed the database structure based on dimensions and measures
- Client: Bugshan Group [AL-Athar]
- Customer Type: Auto Mobile Industry
- AL-Athar specializes in the distribution and promotion of high-quality international products in cosmetics, perfumery, and luxury accessories
- This project involved creating a series of dashboards and reports to help business users monitor overall sales performance and commissions, integrated with various ERP applications
- The solution enabled users to compare sales data from the past10 years, providing valuable insights to aid in future budget planning
Education
MCA -
Bishop Heber College
Trichy, Tamil Nadu01.2009
BCA - undefined
St. Joseph College
Trichy, Tamil Nadu01.2003
Skills
- Expertise in Data Warehousing concepts, including Dimensional Modeling, Star Schema, and Snowflake Schema methodologies
- Hands-on experience with:
- Database Management: Azure SQL Datawarehouse, Microsoft SQL Server2008R2/2012
- ETL Tools: Microsoft ADF, Microsoft SSIS2012, Shiloh Data Loading
- Analysis Tools: Microsoft Azure AAS, Mondrian Schema OLAP
- Reporting Tools: Power BI, SSRS, and Tableau
- Experienced in creating dynamic Tableau reports, including charts, filters, scorecards, drill-down, drill-through, and parameterized reports with advanced formatting
- Proficient in designing and implementing data storage solutions using Azure Data Lake Storage, Azure Blob Storage, and Azure SQL Database
- Familiar with Azure Synapse Analytics (SQL Pools) and Azure SQL Data Warehouse for data warehousing solutions
- Skilled in creating and managing ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) pipelines using Azure Data Factory and Azure Synapse Pipelines
- Experience in orchestrating data workflows, managing datasets, and performing data transformation
- Expertise in integrating data from various sources, including SQL databases, API, on-premises sources, and cloud-based systems
- Proficient in using Azure Data Factory, Azure Logic Apps, and Azure Databricks for data integration
- Hands-on proficiency with Microsoft Office Suite, especially Microsoft Excel
- Adept at gathering business requirements, translating them into technical specifications, and providing training/support to end users
- In-depth knowledge of Software Development Life Cycle (SDLC)
- Strong analytical, problem-solving, and interpersonal skills
- Ability to work independently or collaboratively in team environments
- Data modeling
Certification
- Microsoft Certified: Azure Data Engineer Associate (DP-203)
- Microsoft Certified: Azure Fundamentals (AZ-900)
Timeline
Azure Data Engineer
Singsoft Solutions Pvt Ltd
03.2020 - Current
Team Lead
DataSemantics
01.2018 - 02.2020
Senior BI Consultant
DataSemantics
01.2016 - 12.2018
Programmer Analyst
Software Paradigm InfoTech
01.2014 - 12.2015
Programmer Analyst
Software Paradigm InfoTech
04.2012 - 11.2013
BI Consultant
Distil Information PVT LTD
01.2010 - 03.2012
BCA - undefined
St. Joseph College
MCA -
Bishop Heber College
Similar Profiles
Jissin AntonyJissin Antony
Assistant Manager - Financial Shared Services at Thinksynq Solutions Pvt Ltd (Outsourced to Servion Global Solutions Pvt Ltd)Assistant Manager - Financial Shared Services at Thinksynq Solutions Pvt Ltd (Outsourced to Servion Global Solutions Pvt Ltd)
Hari Prasad PoovalingamHari Prasad Poovalingam
Quality Analyst at Nthrive Global Solutions Pvt. Ltd (Formerly E4E Business Solutions Pvt. Ltd)Quality Analyst at Nthrive Global Solutions Pvt. Ltd (Formerly E4E Business Solutions Pvt. Ltd)
Madhusree GaraiMadhusree Garai
Assistant Vice President at Bharat Fincare Pvt. Ltd. (Previously Joint To Lead Solutions Pvt Ltd)Assistant Vice President at Bharat Fincare Pvt. Ltd. (Previously Joint To Lead Solutions Pvt Ltd)