Python + PySpark - Junior Developer Job at Compunnel, Inc., New York, NY

TlY4NzlsOHF2OHg0aW42S0dJN01ybHZId0E9PQ==
  • Compunnel, Inc.
  • New York, NY

Job Description

The Python + PySpark Junior Developer will be responsible for developing scalable data solutions using PySpark and Python. The role requires hands-on experience in data engineering, SQL, and cloud platforms such as AWS or Azure. The candidate should have strong problem-solving skills and experience in building efficient ETL pipelines for large-scale data processing. Key Responsibilities Develop and maintain data processing pipelines using Python and PySpark Design and implement ETL workflows for structured and unstructured data Optimize data storage, retrieval, and transformation processes Work with cloud platforms (AWS or Azure) to deploy and manage data solutions Write complex SQL queries for data transformation and analysis Collaborate with data engineers, analysts, and stakeholders to ensure data integrity and reliability Troubleshoot and resolve performance issues in data pipelines Required Qualifications 5+ years of experience in data engineering Strong proficiency in Python and object-oriented programming Hands-on experience with PySpark for large-scale data processing Proficiency in SQL for data manipulation and query optimization Experience with cloud platforms (AWS or Azure) Knowledge of ETL processes and data warehousing concepts Experience with Hadoop is acceptable Preferred Qualifications Experience in optimizing Spark jobs for performance and efficiency Familiarity with DevOps practices for data engineering Understanding of data governance and security best practices #J-18808-Ljbffr Compunnel, Inc.

Job Tags

Similar Jobs

The Edge Fitness Clubs

InfraRED Yoga Instructor Job at The Edge Fitness Clubs

 ...Job Description Who We ARE: When you work at the Best. Gym. Ever, you join the Best. Team. Ever. Youll walk into our clean and spacious gyms with a smile on your face and a pep in your step because you know you are about to change lives! High-five your team and get... 

Revolution Technologies

Space Force - Tester - Tracking (Scottsdale) Job at Revolution Technologies

 ...highest standards. Preferred Skills and Experiences: Testing and Quality Assurance: Proficiency in manual and automated...  ...security testing methodologies and tools Familiarity with penetration testing and vulnerability assessment Collaboration and Communication... 

CLARK AUTOMOTIVE CLINIC

Auto Mechanic Technician Job at CLARK AUTOMOTIVE CLINIC

 ...solving skills and mechanical intuition Ability to lift heavy parts and work in tight spaces Company Description Clark Automotive is an affordable solution for your entire vehicle needs. Count on us for all your vehicle maintenance. Our intention is for you to... 

Uptime Institute

Digital Marketing Coordinator Job at Uptime Institute

 ...highly motivated and detail-oriented Digital Marketing Coordinator with 4-5 years of experience...  ...various channels including email, social media, and web. Coordinate with cross-functional...  ...organizational skills. Ability to work independently as well as part of a team.... 

Post Consumer Brands

Sales Specialist, E-Commerce Job at Post Consumer Brands

 ...Post Holdings, Inc., is dedicated to providing people and their pets with delicious food choices for every taste and budget. The company...  ..., thoughtful work, and the kind of impact that stretches from store shelves to kitchen tables, and food bowls, across the country....