Skip to main content

Big Data Engineer / Python Developer

Big Data Engineer / Python Developer
Collabera
7 months ago

Position Details

Title: Python Scripter/ Big Data Engineer

Compensation: $70/hour

Location: Richmond VA- Hybrid

Duration: 12 Months

Start date: ASAP

Day-to-Day

  • Led development of the big data platform, prioritizing scalability and optimization with Python scripting.

  • Design scalable systems for analytics and AI, optimizing performance using Python.

  • Analyze system performance, identifying areas for improvement with Python scripting.

  • Optimize existing dashboards and data systems for efficiency using Python automation.

  • Collaborate on architecture and strategies, integrating Python for streamlined data processing.

  • Mentor team on optimization techniques, emphasizing Python scripting.

  • Review code to ensure optimization, focusing on Python quality.

  • Implement solutions based on business needs, leveraging Python for flexibility.

Must Haves

  • Proficiency in Python scripting for data processing and optimization.

  • Strong expertise in designing and implementing scalable big data systems.

  • In-depth knowledge of Spark and Hadoop for distributed computing.

  • Experience in performance profiling and optimization techniques.

  • Ability to lead and mentor teams in complex solution development.

  • Excellent problem-solving skills and analytical mindset.

  • Effective communication and collaboration abilities in a team environment.

  • Understanding of regulatory reporting requirements and capital markets domain.

Plusses

  • Familiarity with MongoDB for NoSQL database management.

  • Experience in implementing real-time analytics and AI models.

  • Proficiency in functional programming languages for efficient data processing.

  • Knowledge of cloud platforms such as AWS or Azure for scalable infrastructure deployment.

Expertise level

Work arrangement

Similar Jobs in United States