Shivam Jain

About Me

Architect. Builder. Leader.

I own systems end-to-end — from client conversations and whiteboard HLD to production reliability.

Senior Software Engineer with 5+ years designing and delivering scalable distributed systems. I specialize in Java & Spring Boot microservices, HLD/LLD, event-driven architecture with Kafka, Redis caching and API/database performance tuning.

At Q3 Technologies I lead backend design for the Capex Cockpit platform managing INR 5B+ across 20+ locations, built a multi-tenant cyber risk scoring engine in Node.js, and designed a serverless AWS ETL pipeline (Lambda, Glue/PySpark, Step Functions, Athena) ingesting data from 15+ security tools.

Beyond code, I work closely with product, frontend, QA, DevOps and client teams, support pre-sales with architecture proposals and estimates, and mentor junior engineers through design reviews, code reviews and pair programming.

🏗️
Led HLD/LLD for high-scale production microservices

⚡
Kafka · Redis · Resilience4j — event-driven & fault-tolerant

☁️
AWS serverless ETL: Lambda, Glue, Step Functions, Athena

🟩
Polyglot: Java / Spring Boot · Node.js · React · Python

🤝
Pre-sales, cross-team collaboration & mentoring

⚡ Quick Stats

Current RoleModule Lead & Senior SWE

CompanyQ3 Technologies

LocationGurugram, India

Primary StackJava · Spring Boot · Node.js

Messaging & CacheKafka · Redis

Data / ETLGlue/PySpark · Step Functions · Athena

CloudAWS · Azure

AI / LLMSpring AI · RAG · pgvector

EducationB.E. IT, NSIT Delhi

FocusOpen to New Opportunities

Engineer.java

public class ShivamJain {
  String role  = "Module Lead & Senior SWE";
  int    years = 5; // and counting
  List   stack = List.of("Java", "Spring Boot",
                 "Kafka", "Redis", "Node.js", "AWS");

  Impact ship() {
    return design().scale().observe(); // end-to-end
  }
}

Beyond Code

How I Add Value

Engineering impact goes past writing code — it's about shaping solutions, teams and outcomes.

🏗️

System Design & Ownership

Own services end-to-end — HLD/LLD, API contracts, data modelling, resilience and observability — from design review to production.

💼

Pre-Sales & Solutioning

Partner with sales and business teams on client calls — requirement scoping, architecture proposals, effort estimates and technical demos — contributing to 10-12 new project wins.

🤝

Cross-Team Collaboration

Work across product, frontend, QA, DevOps and client stakeholders to align on API contracts, release plans and production issues across multiple concurrent projects.

🧑‍🏫

Mentoring Juniors

Mentor junior engineers through code reviews, design walkthroughs and pair programming — and onboard new members onto codebases and best practices.

🧩

Polyglot Full-Stack Range

Production work across Java/Spring Boot, Node.js, React, Python/PySpark and AWS serverless — picking the right tool for each problem.

📈

Performance Mindset

Measure first, then fix — p95 latency down 25-30%, DB load down 40%, aggregation response time down 60-70%.

Tech Stack

Tools I Build With

Technologies I've used in production — from design through deployment.

// Languages

Java Python SQL JavaScript TypeScript

// Backend

Spring Boot REST APIs Spring Security JPA/Hibernate Spring Cloud Resilience4j Node.js (Express)

// Frontend

React.js Redux Toolkit React Query

// Databases & Messaging

MySQL PostgreSQL DynamoDB Redis Apache Kafka

// Cloud

AWS S3 AWS Lambda AWS Glue Step Functions AWS SQS AWS Athena CloudWatch SNS Azure Blob Storage SharePoint

// Data Engineering & ETL

PySpark Bronze-Silver-Gold (Medallion) SCD Type 2 Serverless Pipelines Multi-Tenant Data Isolation

// Testing & Observability

JUnit 5 Mockito Zipkin Prometheus Grafana Micrometer

// AI / LLM

Spring AI RAG LLM Tool-Calling Vector DB (pgvector) Embeddings Claude/OpenAI APIs Prompt Engineering

// DevOps & Tools

GitHub Actions Jenkins Docker Bitbucket GitHub Nexus Postman Swagger/OpenAPI

// Core Concepts

DSA System Design (HLD/LLD) Distributed Systems & Microservices Event-Driven Architecture Concurrency & Multithreading DB Design & Query Optimization Caching Strategies High Availability & Fault Tolerance Rate Limiting Multi-Tenancy

Experience

Career Timeline

5+ years of progressive ownership at Q3 Technologies — from full-stack development to leading backend architecture across Java, Node.js and AWS.

Q3 Technologies · Gurugram Jun 2024 — Present

Module Lead & Senior Software Engineer

Promoted to Module Lead in June 2025 — owning module delivery end-to-end, from design and task planning to code reviews and production releases

// Java & Spring Boot Microservices

Led backend design (HLD/LLD) of Spring Boot microservices for the Capex Cockpit Platform managing INR 5B+ across 20+ locations
Engineered a Redis cache-aside layer for high-read data (dashboards, OTP, configs) with TTL invalidation — cutting DB load by 40%
Evaluated and introduced Resilience4j (circuit breaker, bulkhead and jitter-retry) per operation — preventing cascading failures
Designed a Kafka-based event pipeline with at-least-once delivery and idempotent consumers — reducing notification failures by 25-30%
Standardized cross-service observability with distributed tracing and MDC trace propagation — significantly cutting incident diagnosis time
Implemented 2-tier sliding-window rate limiting (per-IP and per-user) at the API gateway layer — reducing abuse-related incidents by 30%

// Node.js · Multi-Tenant Cyber Risk Platform

Architected schema-per-tenant multi-tenancy with automated tenant provisioning and strict client-level access control
Built a multi-source cyber risk scoring engine in Node.js — automating external security-signal ingestion, normalization and score computation

// AWS Serverless ETL & CI/CD

Designed a serverless, multi-tenant AWS ETL pipeline (Lambda, Glue/PySpark, Step Functions, DynamoDB, Athena) ingesting from 15+ security tools
Implemented a Bronze-Silver-Gold architecture with SCD Type 2 history, per-execution cost tracking and SNS failure alerts
Built GitHub Actions CI/CD with OIDC for multi-environment AWS deployments — reducing new data-source onboarding to a single config change

// Leadership, Pre-Sales & Collaboration

Drove technical pre-sales and solutioning — requirement scoping, architecture proposals, effort estimates and demos — contributing to 10-12 new project wins
Collaborated across product, frontend, QA, DevOps and client teams to align API contracts, release plans and production fixes across concurrent projects
Mentored junior engineers through code reviews, design walkthroughs and pair programming, raising code quality and delivery consistency

JavaSpring Boot Node.jsKafka RedisResilience4j AWS LambdaGlue/PySpark Step FunctionsDynamoDB AthenaGitHub Actions

Q3 Technologies · Gurugram Jun 2022 — Jun 2024

Software Engineer

Optimized REST APIs via JPA tuning, indexing and HikariCP sizing — p95 latency down 25-30%, throughput up 40%
Redesigned grid aggregation across 12+ linked tables using CompletableFuture parallel fetching — cutting response time by 60-70%
Implemented stateless authentication & authorization with Spring Security, JWT, RBAC and server-side token revocation
Built a hybrid local/Azure Blob storage layer — delivering 99.9% upload reliability through fault-tolerant pipelines
Architected a reusable DMS/Intranet template (60+ modules) — cutting delivery time by 70% and driving new business across 10+ clients
Engineered a low-latency, paginated Global Search System on Microsoft Graph API — reducing search time by 50-60%
Worked directly with client stakeholders and cross-functional teams to gather requirements, demo features and support UAT and go-live

Spring SecurityJPA HikariCPCompletableFuture MS Graph APIJWT RBACAzure Blob SharePoint

Q3 Technologies · Gurugram Jun 2021 — Jun 2022

Junior Software Engineer

Built workflow automation and multi-level approval systems — reducing manual operations by 40%
Developed reusable React components, backend CRUD APIs and export/import utilities — reducing data-handling errors by 20-25%
Built multi-source data ingestion pipelines (LinkedIn, SAP, SFTP) with scheduled background sync — saving 50+ hours/month of manual updates
Migrated 50,000+ records with zero data loss via optimized batch processing — 60% faster migration
Set up a Jenkins CI pipeline producing versioned FE/BE artifacts to Nexus — enabling automated team deployments

React.jsSpring Boot JenkinsNexus Batch Processing

Projects

Things I've Built

Personal projects exploring distributed systems, AI, and microservices architecture.

Live

Document Intelligence System

Agentic RAG platform for enterprise document Q&A — ask natural-language questions over your documents and get source-cited answers.

Agentic RAG with pgvector + LLM tool-calling — 50% faster retrieval across 1K+ docs
Async ingestion (Apache Tika, OpenAI embeddings, SHA-256 dedup) for S3 & local storage with pre-signed URLs
Caching & backpressure controls — repeat-query latency 110x faster (11.9s → 110ms), zero upload failures under load

Java Spring Boot Spring AI Claude pgvector Redis AWS React

View Live → GitHub →

Live

AI-Powered Quiz Platform

Microservices quiz platform with AI-generated questions and an event-driven scoring pipeline.

OpenAI-driven, difficulty-based question generation with graceful fallback on LLM failures
Scoring & notifications decoupled via a Kafka transactional outbox (at-least-once) with idempotent, retry-safe processing
Spring Cloud service discovery (Eureka) and API Gateway routing

Spring Cloud Eureka API Gateway Kafka PostgreSQL OpenAI React

GitHub →

Live

Job Portal System

Full-stack job portal with secure, role-based access and auditability built in.

Tri-role RBAC (Admin / Recruiter / Applicant) with JWT + BCrypt and server-side token revocation
AOP audit logging across all state-changing operations with centralized exception handling

Spring Boot Spring Security JWT AOP PostgreSQL React.js

GitHub →

Architect. Builder. Leader.

How I Add Value

Tools I Build With

Career Timeline

Things I've Built

Foundations & Awards

Let's Work Together

Open to Senior & Staff Roles