Skip to main content

Python Developer with PySpark Experience

Python Developer with PySpark Experience
APN Consulting Inc.
7 months 3 weeks ago

Job Description

APN Consulting has an immediate need for a direct client requirement:

Python Developer - Pyspark

  • Location - Charlotte, NC (Hybrid)
  • Long-term Contract

Key Responsibilities

  • Involved in data manipulation using Python scripts Spark Scala
  • Created Parameterized Queries
  • Generated Tabular reports
  • Sub reports Cross Tabs Drill down reports using Expressions Functions Charts Maps Sorting the data
  • Defining Data sources and Subtotals for the reports

Required Skills

  • Experience in Developing Spark applications using Spark SQL in Databricks
  • Good understanding of Spark Architecture including Spark Core Spark SQL T SQL Data Frames Spark Streaming Driver Node Worker Node Stages Executors and Tasks
  • Domain Knowledge of Finance Logistics and Health insurance
  • Strong skills in visualization tools Power BI Confidential Excel formulas Pivot Tables Charts and DAX Commands
  • Expertise in various phases of project life cycles Design Analysis Implementation and testing

Skills and Tools

  • ETL Tools: Ab initio, GDE, Ab Initio Co Op
  • Databases: Teradata Oracle 10g, 11g, Exadata, My SQL, SQL Server 2008, DB2 Cosmos DB, Hadoop, Hive, Snowflake
  • Other tools: Autosys Control, M Client ALM, Jenkins, IBM Udeploy GitHub WinSCP, MSVisio, AWS Services, Service Now, AUTOMIC AROW, Airflow Windows, Powershell Python, IDLE, Kafka, GCP, Google Cloud Platform, Azure Big Data Technologies, Hadoop, Spark

Expertise level

Work arrangement

Similar Jobs in United States