Job Title
Senior Data Engineer
Location
Remote (East Coast United States)
Company Overview
Join a leading company in the financial services technology sector, where innovation and tackling challenging issues are at the forefront of our mission. Our team is collaborative, entrepreneurial, passionate, and committed to having fun while making a significant impact.
We offer a modern platform that delivers payment facilitation as a service, complete with a comprehensive suite of payments and risk management services designed for vertical SaaS companies. Our platform enables SaaS providers to integrate payment solutions seamlessly into their systems, creating new revenue streams rapidly.
With a proven track record of substantial growth, we are poised for continued success and expansion.
Role Summary
The Senior Data Engineer will be instrumental in managing and optimizing data processes within our AWS-based infrastructure. This role involves extensive data handling, ensuring data integrity, and supporting strategic business initiatives through robust data management practices.
Key Responsibilities
- Oversee the ingestion, storage, and management of data across various AWS-based platforms, including S3, Glue, and Athena.
- Collaborate with technical teams to develop and maintain ETL processes using SQL and AWS’s big data technologies.
- Partner with operational, risk, and financial teams to develop best practices in data reporting and analytics, ensuring data integrity and actionable insights.
- Enhance and streamline data engineering, reporting, and analysis processes, aiming for automation and improved self-service capabilities for partners.
- Provide mentorship and guidance to fellow team members, promoting a culture of continuous learning and development.
What You Bring
- Expertise in Python (Spark) for ETL design, implementation, and maintenance.
- Strong experience with AWS’s big data platforms including AWS S3, Glue, Athena, QuickSight, and Lambda.
- Proficient in SQL query writing and schema design, with a good understanding of data modeling principles.
- Experience with machine learning, and familiarity with data processing frameworks and systems like Hive, Hadoop, Spark, Presto, or MPP.
- Excellent communication skills, with a highly motivated, open-minded approach to solving complex technological challenges.
- Team-oriented, problem-solving mentality with a positive, can-do attitude.
Technologies We Use
- Python, JavaScript, Pandas
- AWS S3, Glue, Athena, QuickSight, LakeFormation, Lambda, API Gateway, RDS, SageMaker
- Apache Spark, Presto, Hudi
- GIT, JIRA
Additional Qualifications (Bonus)
Experience in the payments domain is highly desirable.
What We Offer
- Competitive salary and excellent benefits.
- A role filled with a high degree of responsibility and a broad spectrum of opportunities.
- A modern, international work environment with a dedicated and motivated team.
- Extensive professional education and personal development opportunities.