Charan G N
Associate Data Engineer at Mareana · 2 years · Apache Spark, PySpark, Spark SQL
Bengaluru
About
I am an Associate Data Engineer at Mareana with over 1.6 years of hands-on experience designing and maintaining scalable ETL/ELT pipelines using Apache Spark, PySpark, Databricks, and cloud data platforms. I have worked on processing large-scale structured and semi-structured datasets, building data validation and reconciliation checks, and optimizing Spark SQL queries to improve pipeline reliability and reduce manual effort. My strongest skills include PySpark, Databricks, SQL, and ETL/ELT pipeline development, with a focus on delivering accurate, well-documented reporting solutions. I am looking to further grow my expertise in data engineering and contribute to impactful data-driven projects.
Experience
Associate Data Engineer
Jan 2026 – PresentMareana, princeton, new jersey, united states
Design and maintain scalable ETL pipelines using PySpark and Databricks to process large-scale structured and semi-structured datasets for analytics and reporting. Build data validation and reconciliation checks between the Data Lake and reporting views to ensure accurate, error-free deliverables. Optimize Spark SQL queries and automate workflow execution in Databricks, improving pipeline reliability and reducing manual effort.
Data Engineer Apprentice
Aug 2024 – Feb 2025Target India Corporation, Bengaluru
Built Kafka–Spark–Hive ingestion pipelines to process large-scale transactional datasets across the full data lifecycle: ingestion, transformation, and consumption. Processed JSON data and loaded transformed data into Hive external tables within the Hadoop ecosystem for downstream analytics. Implemented ETL workflows and CI/CD pipelines, and performed pipeline monitoring, troubleshooting, and SQL-based data validation to maintain data quality.
Education
Dayananda Sagar Academy of Technology and Management
2020 – 2024B.E., Computer Science and Engineering · Grade: 8.72
Projects
Charity Management System
HTML, CSS, JavaScript, SQL
Built a team website for fund distribution and task management using HTML, CSS, JavaScript, and SQL.
Image Forgery Detection
CNN, VGG16, JavaScript
Built a web application that classifies uploaded images as original or forged using CNN, VGG16 architecture, and error-level analysis.
Skills
Certifications
Azure Databricks and Spark SQL (Python)
Azure
Introduction to Spark
Udemy
Core Java
Apna College
Web Development
Internshala
0 questions answered on readyforhires in the past year, 0 active days, longest streak 0 days.