Sidharth RameshLead Data Engineer

AI Specialist building intelligent, scalable data solutions that drive business innovation

8+
Years Experience
7
Certifications
Gen AIAWSAzureMLOpsData PipelinesSparkSnowflake
Sidharth Ramesh - Lead Data Engineer

About Me

I'm an accomplished Lead Data Engineer with over 0+ years of expertise in creating and maintaining data and MLOps pipeline architecture from the ground up.

My passion lies in Gen AI Technologies and building intelligent, scalable solutions that drive business innovation. I've successfully delivered automation frameworks that resulted in $0K annual savings and reduced manual workloads by 0%.

With dual Master's degrees in Computer Science (Georgia Tech, 2024) and Mechanical Engineering (Rose-Hulman, 2016), I bring a unique blend of theoretical knowledge and practical expertise to every project.

Location
Edison, New Jersey
Experience
0+ Years

Core Specializations

Gen AI & LLMsMLOps PipelinesData EngineeringCloud ArchitectureBusiness IntelligenceAutomation

Professional Experience

8+ years of building scalable data solutions across diverse industries

Lead Data Engineer

Tiger Analytics
Aug 2021 - Present
Edison, NJ

Leading data engineering initiatives and Gen AI implementations for Fortune 500 clients.

Key Achievements

  • Developed MLOps application reducing manual workload from 3 weeks to 2 hours
  • Built Gen AI automation using Llama 400B, saving $300K annually
  • Created agentic chatbot with RAG capabilities for retail sales data interaction
  • Led Oracle to Snowflake migration for multiple schemas with Star Schema design
  • Built Tableau dashboards reducing manual work by 40 hours monthly

Technologies Used

PythonSparkStreamlitLangchainLlama 400BSnowflakeTableauAirflow

Data Engineer

Canada Clean Fuels
Jun 2020 - Aug 2021
North York, Toronto, ON

Architected AWS-based data solutions and enterprise data warehouse migration.

Key Achievements

  • Designed AWS 3-tier highly available and secure architecture
  • Migrated enterprise data warehouse from MySQL to PostgreSQL Aurora RDS
  • Developed data pipeline infrastructure integrating fuel distribution and GPS systems
  • Created Tableau dashboards for operational efficiency monitoring

Technologies Used

AWS LambdaPythonPostgreSQLAurora RDSRESTful APITableau

Data Engineer

Goeasy Ltd
Mar 2019 - Jun 2020
Mississauga, ON

Enhanced data quality and implemented AI/ML solutions for enterprise systems.

Key Achievements

  • Led ETL pipeline development using SSIS for Salesforce integration
  • Implemented AI/ML solutions in Knime and SAS Viya
  • Participated in SQL Server Data Warehouse migration to Azure
  • Engineered advanced SQL scripts for dimension and fact tables

Technologies Used

SSISSQL ServerSalesforceKnimeSAS ViyaAzure

Data Analyst

Karsun Solutions LLC
Apr 2016 - Jan 2019
Washington, D.C.

Facilitated GSA cloud migration and developed federal data reporting systems.

Key Achievements

  • Developed ETL data models from MongoDB and AWS Redshift
  • Established Proof-of-Concept using Apache Zeppelin, Hadoop, and Spark
  • Built business reports for federal Transactional Data Repository
  • Implemented multi-layer cloud architecture using AWS and Ansible
  • Maximized data quality through database optimization solutions

Technologies Used

AWSMongoDBRedshiftApache SparkTableauDrupalAnsible
4
Companies
Fortune 500 to Startups
8+
Years Experience
Data Engineering & AI

Technical Expertise

Comprehensive skillset spanning modern data engineering and AI technologies

Cloud Platforms

AWS
EC2RDSS3LambdaRedshiftBedrockSagemaker
Azure
Data LakeFunctionsSQL DatabaseML Studio
GCP
BigQueryCloud FunctionsAI Platform

Gen AI & ML

LLMs
Llama 400BClaude Sonnet 4ChatGPT 4oDeepSeek R1
Frameworks
LangchainRAGVector DBsFAISSPinecone
MLOps
Model MonitoringPipeline AutomationA/B Testing

Data Engineering

Big Data
Apache SparkPySparkHadoopHive
ETL/ELT
SSISAirflowApache SparkCustom Pipelines
Data Warehouses
SnowflakeDatabricksRedshift

Databases

SQL
PostgreSQLSQL ServerMySQL
NoSQL
MongoDBDynamoDB
Time Series
InfluxDBTimescaleDB

Programming

Python
PandasNumPyFlaskDjangoStreamlit
SQL
T-SQLPL/SQLQuery Optimization
Shell
BashLinuxAutomation Scripts

DevOps & Tools

Containers
DockerKubernetes
CI/CD
JenkinsGitHub ActionsAnsible
Monitoring
GrafanaCloudWatchLogging

Additional Technologies & Tools

BI Tools

TableauApache SupersetJasperApache Zeppelin

Web Development

DjangoFlaskStreamlitHTMLDrupal

Operating Systems

LinuxUbuntuRedHatWindows

Methodologies

AgileDevOpsCI/CDScrum

Featured Projects

Transformative solutions delivering measurable business impact

Gen AI

Gen AI DPIS Automation

Revolutionary web application automating Demo Product Information Sheet process using Streamlit, Langchain, and Meta's Llama 400B model.

$300K Annual Savings
@ Tiger Analytics

Key Achievements

  • Reduced manual processing time by 95%
  • Automated complex document generation
  • Integrated with enterprise systems

Technologies

StreamlitLangchainLlama 400BPythonGen AINLP
Professional Project
MLOps

MLOps Model Monitoring Platform

Comprehensive model monitoring application for pricing engineering team, built from scratch using Python OOPs and automation frameworks.

3 weeks → 2 hours
@ Tiger Analytics

Key Achievements

  • Automated model behavior analysis
  • Real-time performance monitoring
  • Reduced manual workload significantly

Technologies

PythonOOPBashMLOpsAutomationMonitoring
Professional Project
AI/ML

Agentic RAG Chatbot

Intelligent chatbot with RAG capabilities enabling natural language interaction with retail sales data and automated PowerPoint report generation.

Automated Reporting
@ Tiger Analytics

Key Achievements

  • Natural language data querying
  • Automated report generation
  • Enhanced user experience

Technologies

RAGVector DBsLLMsPythonNLPPowerPoint API
Professional Project
Data Engineering

Oracle to Snowflake Migration

Led comprehensive data migration project from Oracle to Snowflake, designing and implementing Star Schema Data Model for multiple schemas.

Enterprise Migration
@ Tiger Analytics

Key Achievements

  • Migrated multiple enterprise schemas
  • Designed optimized Star Schema
  • Ensured zero data loss

Technologies

OracleSnowflakeSQLETLData ModelingStar Schema
Professional Project
Cloud

AWS 3-Tier Architecture

Designed and implemented highly available and secure AWS architecture for database and web applications with enterprise data warehouse migration.

Scalable Infrastructure
@ Canada Clean Fuels

Key Achievements

  • Highly available architecture
  • Secure multi-tier design
  • Successful database migration

Technologies

AWSMySQLPostgreSQLAurora RDSLambdaArchitecture
Professional Project
Government

Federal Data Repository

Developed comprehensive business and analytical reports for federal Transactional Data Repository with advanced data visualization and chatbot PoC.

Government Solution
@ Karsun Solutions

Key Achievements

  • Federal-grade data reporting
  • Advanced data visualization
  • AI chatbot implementation

Technologies

AWS RedshiftJasperPythonMXNetBIChatbot
Professional Project

Interested in Similar Solutions?

I specialize in building scalable data engineering solutions, Gen AI applications, and MLOps platforms that deliver measurable business impact.

Professional Certifications

Industry-recognized credentials validating expertise across cloud and data technologies

7
Certifications
Industry-recognized credentials
Professional

Snowflake SnowPro Core

Advanced data warehousing and cloud data platform expertise

Snowflake
June 2024
Data Warehousing

Key Skills

Data WarehousingSQLCloud ArchitecturePerformance Optimization
Verified
Professional Credential
Associate

AWS Solutions Architect Associate

Designing distributed systems and cloud solutions on AWS

Amazon Web Services
March 2021
Cloud Architecture

Key Skills

Cloud ArchitectureAWS ServicesSecurityCost Optimization
Verified
Professional Credential
Associate

Databricks Certified Associate Developer

Apache Spark 3.0 development and data engineering on Databricks

Databricks
January 2021
Big Data

Key Skills

Apache SparkPySparkData EngineeringML Engineering
Verified
Professional Credential
Associate

Azure Data Engineer DP-201

Designing Azure data solutions and data storage systems

Microsoft
January 2020
Data Engineering

Key Skills

Azure Data ServicesData ArchitectureETLData Security
Verified
Professional Credential
Associate

Azure Data Engineer DP-200

Implementing Azure data solutions and data processing

Microsoft
October 2019
Data Engineering

Key Skills

Azure ImplementationData ProcessingMonitoringOptimization
Verified
Professional Credential
Fundamental

Azure Fundamentals AZ-900

Core Azure services, security, privacy, compliance, and trust

Microsoft
August 2019
Cloud Fundamentals

Key Skills

Cloud ConceptsAzure ServicesSecurityCompliance
Verified
Professional Credential
Associate

Tableau Desktop 10 Qualified Associate

Data visualization and business intelligence with Tableau

Tableau
September 2017
Business Intelligence

Key Skills

Data VisualizationDashboard DesignBusiness IntelligenceAnalytics
Verified
Professional Credential

Continuous Learning Journey

Staying current with the latest technologies and industry best practices through continuous certification and hands-on experience.

AWS Certified
Azure Certified
Snowflake Certified
Databricks Certified
Tableau Certified

Educational Background

Strong academic foundation combining computer science expertise with engineering discipline

3
Degrees
Advanced qualifications
2
Master's
Graduate degrees
13
Years
Academic journey
Graduate
2024

Master of Science in Computer Science

Georgia Institute of Technology
Atlanta, Georgia, USA

Advanced coursework in machine learning, data science, and artificial intelligence with focus on practical applications in enterprise environments.

Key Highlights

Specialized in Machine Learning and AI
Advanced Data Science Coursework
Enterprise Software Development
Research in Gen AI Applications

Career Relevance

Directly applicable to current Gen AI and MLOps expertise

Graduate
2016

Master of Science in Mechanical Engineering

Rose-Hulman Institute of Technology
Terre Haute, Indiana, USA
Specialization: Finite Element Analysis

Focused on advanced engineering analysis, computational methods, and applied mathematics with thesis research in Finite Element Analysis.

Key Highlights

Thesis: Finite Element Analysis
Computational Methods
Advanced Mathematical Modeling
Research Methodology

Career Relevance

Strong analytical foundation supporting data engineering expertise

Undergraduate
2011

Bachelor of Technology in Mechanical Engineering

Jawaharlal Nehru Technological University
Hyderabad, India

Comprehensive engineering education with strong emphasis on problem-solving, analytical thinking, and technical fundamentals.

Key Highlights

Engineering Fundamentals
Problem-Solving Methodologies
Technical Analysis
Project Management

Career Relevance

Foundation for systematic approach to complex technical challenges

Academic Foundation

My dual Master's degrees in Computer Science and Mechanical Engineering provide a unique blend of computational expertise and analytical rigor, directly supporting my success in data engineering and AI applications.

Computational Methods

Advanced algorithms, mathematical modeling, and analytical thinking

Research Excellence

Thesis research, academic rigor, and evidence-based problem solving

Continuous Learning

Commitment to lifelong learning and staying current with technology