Job Details
- Job Title: Python Data Engineer
- Location: Austin, TX (Onsite from day 1)
- Employment Type: Fulltime
Requirements
Must Have:
- Python API development experience
- End to end data pipeline from raw data sources > ingestion of data > ELT/ETL > consumable reporting tables with Big Query
- Google Cloud Storage
- Cloud Composer
Nice to have:
- Looker/Tableau
- Cyber Security background
Job Description
Design, develop, and deploy scalable data pipelines using GCP tools and services like Cloud Dataflow, Cloud Storage, Pub/Sub, and Cloud Functions.
Collaborate with stakeholders to understand business requirements and translate them into technical specifications for data pipelines.
Develop and maintain a comprehensive data architecture that ensures data quality, efficiency, and scalability.
Conduct thorough analysis of system data to identify trends, diagnose issues, and optimize data pipeline performance.
Advocate for the use of BigQuery as the central data warehouse solution and champion its capabilities to internal customers.
Perform customer-facing data analysis, generating insights and reports that inform decision-making.
Stay up-to-date on the latest advancements in data engineering technologies and best practices.
Collaborate with cross-functional teams (data analysts, data scientists, and developers) to ensure seamless data integration and analysis.
Document data pipelines and processes for maintainability and knowledge transfer.
Master’s/bachelor’s degree in computer science, business analytics, information technology, statistics, or a related field.
Experience and Skills Required
Minimum 5+ years of experience as a Data Engineer or related role.
Proven experience in designing, building, and deploying data pipelines in the cloud (ideally GCP).
Strong understanding of data architecture principles and best practices.
Expertise in SQL and experience with BigQuery.
Familiarity with data analysis techniques and tools.
Excellent communication and collaboration skills.
Ability to translate business requirements into technical specifications.
Experience working in a customer-facing role is highly desirable.
Experience with data warehousing concepts is highly desirable.
Proficiency in scripting languages (Python) is a plus.
Proficiency in BI tools such as Tableau, Power BI, or equivalent.
Certifications
GCP certification (Professional Data Engineer or equivalent)