Python developer with Spark AWS Job at Conch Technologies Inc, Columbus, OH

TURGeDB0RjlPNUtFdytIY1R3eUx1bk1GL3c9PQ==
  • Conch Technologies Inc
  • Columbus, OH

Job Description

Hi

Greetings from Conch Technologies Inc

Job Title: Python Spark AWS

Location: Columbus OH nonlocal candidates accepted

Duration: 12 Months COntract or Direct Fulltime

Job Responsibilities:

Develop and maintain data platforms using Python Spark and PySpark.
Handle migration to PySpark on AWS.
Design and implement data pipelines.
Work with AWS and Big Data.
Produce unit tests for Spark transformations and helper methods.
Create Scala/Spark jobs for data transformation and aggregation.
Write Scaladocstyle documentation for code.
Optimize Spark queries for performance.
Integrate with SQL databases (e.g. Microsoft Oracle Postgres MySQL).
Understand distributed systems concepts (CAP theorem partitioning replication consistency and consensus).

Skills:
Proficiency in Python Scala (with a focus on functional programming) and Spark.
Familiarity with Spark APIs including RDD DataFrame MLlib GraphX and Streaming.
Experience working with HDFS S3 Cassandra and/or DynamoDB.
Deep understanding of distributed systems.
Experience with building or maintaining cloudnative applications.
Familiarity with serverless approaches using AWS Lambda is a plus

With Regards



Teja Maripeti

Desk:

Email: t

Web:

Job Tags

Full time, Contract work,

Similar Jobs

Leidos

Senior Instructional Designer Job at Leidos

 ...Job Description Description The Instructional Systems Designer will be responsible for designing, developing, and supporting the execution...  ...-tiered curriculum that supports contractors - from entry-level professionals with one year of experience to senior experts... 

Pacific Advisory Service

Customer Support Agent - Japanese Bilingual for Import Job at Pacific Advisory Service

 ...An International Forwarder is looking for Japanese Bilingual Import Agent. Check and handle shipping documents (Invoice, Packing Lists., etc.) Input shipment data into internal systems Assist with tracking cargo and reporting status updates Arranging Customs... 

Good Samaritan

CNA - Sunset - FT Straight Nights Job at Good Samaritan

 ...Hours - Night Shifts Job Schedule: Full time Weekly Hours: 40.00 Salary Range:...  ...Required Certified Nursing Assistant (CNA) certification with the State Board of Nursing...  ...benefits package for qualifying full-time and part-time employees. Depending on eligibility,...