Data Engineer
Nityo Infotech Corporation
6 months 2 weeks ago
Job Details
JOB: Data Engineer (Azure Data bricks, SQL, Snowflake, Python)
Location: NYC NY (Local)
Job Type: W2 Contract
Summary:
We are looking for a Snowflake developer with a financial background typically who plays a crucial role in leveraging Snowflake, a cloud-based data warehousing platform, to manage and analyze financial data.
Primary Responsibilities:
- Strong understanding of Snowflake on Azure Architecture, design, implementation, and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse.
- Hands-on development experience with Snowflake features such as Snow SQL; Snow Pipe; Python; Tasks; Streams; Time travel; Zero Copy Cloning; Optimizer; Metadata Manager; data sharing; and stored procedures.
- Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
- Need to have working knowledge of MS Azure configuration items with respect to Snowflake.
- Developing EL pipelines in and out of data warehouse using a combination of Data bricks, Python, and Snow SQL.
- Developing scripts UNIX, Python, etc. to Extract, Load, and Transform data, as well as other utility functions.
- Provide production support for Data Warehouse issues such as data load problems, transformation translation problems.
- Translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution.
- Understanding data pipelines and modern ways of automating data pipeline using cloud-based testing and clearly documenting implementations so others can easily understand the requirements, implementation, and test conditions.
- Perform code reviews to ensure fit to requirements, optimal execution patterns, and adherence to established standards.
Basic Qualifications:
- Minimum 5 years of designing and implementing an operational production-grade large-scale data solution on Microsoft Azure Snowflake Data Warehouse.
- Including hands-on experience with productionized data ingestion and processing pipelines using Python, Data bricks, Snow SQL.
- Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies.
- Excellent presentation and communication skills, both written and verbal, ability to problem solve and design in an environment with unclear requirements.
Report this job
- Dice Id: 10200946b
- Position Id: 8288085