Cloud Solution Architect
Microsoft Certified Solution Architect | Data Engineering Expert | Data Bricks | Spark | Kafka Streaming | Synapse | Snowflake | Python | Scala | Java | SQL | Delta Lake | Machine Learning | GenAI | Passionate about exploring cutting-edge technologies
About Me
I'm a passionate cloud solution architect who thrives on solving complex business problems through innovative data solutions. With expertise in real-time streaming, AI-powered analytics, and scalable data lake architectures, I help organizations unlock the true potential of their data.
Core Tech Stack
Python
Scala
Java
SQL
Apache Spark
Kafka
Snowflake
Databricks
14+ Years
Cloud & Data Experience
20+ Projects
Large-scale Cloud Solutions
AI & ML
Generative AI Expertise
Featured Projects
Real-world projects showcasing expertise in streaming platforms, AI-powered analytics, and scalable data architectures.
Data Commerce Solution-Fiserv Small Business Index|Single Auth| DQA| Consumer Keying and Linking | Consumer 360 Solution
- FSBI aggregates consumer spending activity across millions of U.S. small businesses, using transactional sales data to gauge growth- Fiserv Small Business Index
- Implemented large-scale data processing solutions with expertise in strategic partitioning and harnessing Spark’s in-memory capabilities. Optimized data ingestion using cutting-edge technologies like Data Bricks, Azure ADLS, and Kafka, ensuring efficient handling for streamlined joins and transformations.
- Integrated the Consumer 360 Solution to provide comprehensive consumer insights.
- Designed and implemented a versatile data ingestion utility using Data Bricks, enabling seamless data movement between on-premises and cloud environments as well as on-premises to on-premises data transfers
Databricks
Azure
Spark
Python
Impact: Boosted data efficiency, accuracy, and economic insight delivery.
Card Console Management
- Architected and developed a highly scalable Spark Streaming end-to-end pipeline to process real-time events related to cardholder information for Fiserv’s financial institution clients.
- Successfullyimplemented a comprehensive end-to-end streaming solution utilizing Hadoop, Spark, Kafka, OGGBD, and Azure SQL database.
- Successfully deployed Oracle Big Data Adaptersetup for real-time data ingestion from the Tandem system to a Kafka topic.
- Successfully implemented a robust Disaster Recovery solution for Spark Streaming applications using Kafka SRM tool, serving multiple business units across Fiserv.
- Implemented a Kafka data parsing utility for validation, resulting in a 5% reduction in effort during testing and validation phases across Fiserv.
Spark
Hadoop
Azure
Oracle
Impact: Enhanced real-time processing, resilience, and testing efficiency across systems.
Debit Card Modernization
- Led the design and development of a mission-critical end-to-end Debit data architecture using the big data ecosystem to efficiently handle real-time settlements and debit card fee calculations for Fiserv’s esteemed clients.
- Developed Spark, Kafka structured Streaming consumer application for debit data processing.
- Played a key role in setting up and configuring Kafka clusters, topics, and partitioning strategy.
- Designed and implemented a versatile utility for real-time data ingestion from the tandem system to Kafka, utilizing Oracle Big Data Adapter, resulting in a remarkable 50% reduction in development efforts and a 5% cost savings for the project. This utility has been adopted by multiple business units across Fiserv.
Databricks
Azure
Spark
Python
Impact: Boosted data efficiency, accuracy, and economic insight delivery.
Report View Product
- Spearheaded the design and deployment of a cutting-edge cloud-based big data solution leveraging technologies such as Apache Spark, Data Bricks, Azure Data Lake Storage (ADLS)
- Contributed significantly to Fiserv’s client acquisition and retention strategies by providing actionable insights and data-driven decision-making capabilities
Databricks
Spark
Azure
Python
Impact: Improved client retention through faster, insight-driven decision-making.
Energy Management Solutions (EMS)
- Implemented ETL pipeline to process energy data using Sqoop, PySpark SQL, HDFS, HBase, HIVE and extensively for Prokarma EMS product.
Spark
Hadoop
Azure
Oracle
Impact: Enhanced real-time processing, resilience, and testing efficiency across systems.
Dispute Expert
Established a comprehensive Spark Structured Streaming consumer application using Kafka for the Dispute Expert Correction module.
Databricks
Spark
Azure
Python
Impact: Improved client retention through faster, insight-driven decision-making.
United Automobile Insurance
Designed and implemented a Job Monitoring Tool that enables proactive identification and resolution of job issues, resulting in a remarkable 30% reduction in monthly incident counts
Databricks
Spark
Azure
Python
Impact: Improved client retention through faster, insight-driven decision-making.
Key Achievements
Designed and Developed Enterprise-Scale Databricks Spark Ingestion Framework for Azure Data Lake
- Created a modular Spark framework to ingest data from multiple enterprise sources (Oracle, SQL Server, MySQL, Netezza, Snowflake) and diverse file formats (ACH Payments Files, Fixed-length, CSV) into Azure Data Lake. Supported 10+ teams across 5 business units, reducing onboarding time by 50%. Standardized ingestion workflows to minimize manual effort, enhance pipeline resilience, and accelerate analytics delivery across the enterprise.
- Led the implementation of a cloud-based big data solution for the enterprise-level Report View product at Fiserv, driving improvements in client acquisition and retention. Successfully migrated 100+ financial institution clients from the Existing Notulus product to Report View, resulting in an annual revenue increase of $4 million.
- Spearheadedthedesign and delivery of an innovative real-time streaming analytics platform with Apache Kafka/Spark at Fiserv. This platform is set to replace the critical legacy fecal and settlement banking process, impacting 5% of Fiserv's annual revenue from the fee calculation unit.
- Pioneereda groundbreaking Kafka-COE initiative, empowering 70+ associates with advanced skills, resulting in a significant increase in project acquisitions and
Certifications & Awards
Professional certifications, hackathon wins, and speaking engagements that showcase continuous learning and industry recognition.
- Professional Certifications
AWS Certified Solution Architect
AWS
2023
Azure Certified Data Engineer
Azure
2022
Learning symposium-Kafka and Spark Expert
Kafka & Spark
2023
DataBricks GEN AI Engineer
AI Engineer
2021
Top Performer of the Year
Titan Award
2023
DataBricks Certified Data Negineer
Databricks
2022
Microsoft Certified Solution Acrhitect
Microsoft
2023
SnowFLake SnowProCore Certified
SnowFlake
2023
- Awards & Recognition
![top performer of the year[1]](https://harendrasingh.info/wp-content/uploads/2025/08/Top_Performer_of_the_Year1-740x1024.jpg)