Big Data Engineer (Current)
Big DataWorking on critical financial compliance data pipelines, implementing secure and scalable solutions for handling petabyte-scale data processing while ensuring regulatory compliance and data security.
Key Achievements
Engineer batch processing pipelines for financial compliance data at petabyte scale using Hadoop ecosystem (HDFS, Hive, HBase)
Achieved 37% reduction in ETL execution time through Python automation scripts while processing 6TB+ of sensitive financial data daily