Python + PySpark - Junior Developer Job at Compunnel, Inc., New York, NY

TlY4NzlsOHF2OHg0aW42S0dJN01ybHZId0E9PQ==
  • Compunnel, Inc.
  • New York, NY

Job Description

The Python + PySpark Junior Developer will be responsible for developing scalable data solutions using PySpark and Python. The role requires hands-on experience in data engineering, SQL, and cloud platforms such as AWS or Azure. The candidate should have strong problem-solving skills and experience in building efficient ETL pipelines for large-scale data processing. Key Responsibilities Develop and maintain data processing pipelines using Python and PySpark Design and implement ETL workflows for structured and unstructured data Optimize data storage, retrieval, and transformation processes Work with cloud platforms (AWS or Azure) to deploy and manage data solutions Write complex SQL queries for data transformation and analysis Collaborate with data engineers, analysts, and stakeholders to ensure data integrity and reliability Troubleshoot and resolve performance issues in data pipelines Required Qualifications 5+ years of experience in data engineering Strong proficiency in Python and object-oriented programming Hands-on experience with PySpark for large-scale data processing Proficiency in SQL for data manipulation and query optimization Experience with cloud platforms (AWS or Azure) Knowledge of ETL processes and data warehousing concepts Experience with Hadoop is acceptable Preferred Qualifications Experience in optimizing Spark jobs for performance and efficiency Familiarity with DevOps practices for data engineering Understanding of data governance and security best practices #J-18808-Ljbffr Compunnel, Inc.

Job Tags

Similar Jobs

WISE & Healthy Aging

Intake Coordinator, Ombudsman Program Job at WISE & Healthy Aging

For more than 50 years, Wise & Healthy Aging has been serving older adults at all stages of their lives. Offering a wide range of services for older adults from pre-retirement through elder years, we also offer services for caregivers and their families and work closely...

Amazon

Amazon Warehouse - Shopper Team Member $16-$35/hr Job at Amazon

 ...dedicated team that gets orders ready for people relying on Amazons service. From flexible part-time roles to full-time set schedules with health care benefits, Amazon has a variety of jobs available in our warehouses. FULFILLMENT CENTERS (CUSTOMER RETURNS) - Work inside... 

Airbus Americas, Inc.

HR Shared Services Specialist Job at Airbus Americas, Inc.

 ...in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, demotion, termination, layoff, recall, transfer, leaves of absence, compensation, benefits and training... 

Mackenzie Stuart

Director of Microwave Plasma Engineering for Semiconductors (San Francisco) Job at Mackenzie Stuart

 ...A leading recruitment agency is seeking a Principal Microwave Plasma Scientist for semiconductor manufacturing in San Francisco, CA. Candidates should have a Ph.D. in engineering or applied physics, with at least 5 years of experience in microwave systems and semiconductor... 

Domino's Franchise

Delivery Driver - 113 Foxbank Plantation Blvd., Suite A Job at Domino's Franchise

 ...with us or justearning some extra cash! Job Description Looking to make some extra cash in your spare time? Tried the food deliveryorrideshare gigs but tired of them taking most of the money? Come work for Dominos! We pioneered food delivery and in the past...