Big Data Engineer (Current)
Big DataWorking on critical financial compliance data pipelines, implementing secure and scalable solutions for handling petabyte-scale data processing while ensuring regulatory compliance and data security.
Key Achievements
Engineer batch processing pipelines for financial compliance data at petabyte scale using Hadoop ecosystem (HDFS, Hive, HBase) on distributed clusters with 400TB+ RAM
Reduced ETL execution time by 37% through Python automation scripts while processing 6TB+ of sensitive financial data daily