Pyspark Engineer Job at Trinity Technology Solutions LLC, Charlotte, NC

Q3ZERldac0p5NUZ0czcxcXRLN0VrNVRKeVE9PQ==
  • Trinity Technology Solutions LLC
  • Charlotte, NC

Job Description

Job Description:

Our client is seeking a highly skilled and experienced Senior PySpark Developer to join our dynamic data engineering team. This role is ideal for a motivated professional with a strong background in big data technologies, ETL processes, and database systems. The successful candidate will play a key role in designing, developing, and optimizing data pipelines and analytics solutions that support critical business operations.

📌 Note: Only candidates eligible to work on a W2 basis will be considered.

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines using PySpark and Spark SQL.
  • Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver robust solutions.
  • Optimize and troubleshoot complex ETL workflows and data transformation processes.
  • Write efficient SQL queries for data extraction, transformation, and loading.
  • Ensure data quality, integrity, and compliance with enterprise standards.
  • Participate in code reviews, testing, and deployment activities.
  • Monitor and maintain production workflows, including job scheduling and performance tuning.

Required Skills & Qualifications:

  • 5+ years of experience in data engineering or software development.
  • Strong proficiency in PySpark, Python, and Spark SQL.
  • Solid experience with SQL and relational database systems.
  • Proven expertise in ETL development and data pipeline orchestration.
  • Familiarity with job scheduling tools; Autosys experience is a plus.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration abilities.

Preferred Qualifications:

  • Experience working in the financial services industry.
  • Familiarity with cloud platforms and big data ecosystems.

Job Tags

Similar Jobs

TC Glass

Construction Project Manager Job at TC Glass

 ...TC Glass, Montanas premier glazing contractor, is seeking an experienced construction-based Project Manager. This position is based in Missoula, MT. The Project Manager position has the potential for career growth with our rapidly expanding company. This professional... 

Incedo

Scrum Master Job at Incedo

 ...Job Title: Scrum Master Job Location : Pittsburgh, PA / Dallas, TX Workplace: Hybrid Job Description As a Scrum Master within Bank Retail Technology organization. Supports and facilitates generally one to two Scrum Teams in various functions by fostering... 

OnTrac

Warehouse Package Handler Lead Job at OnTrac

 ...OnTrac is hiring a Warehouse Package Handler Lead Are you eager to join a dynamic and expanding company where you can both learn...  ..., push, pull and/or move items averaging 50lbs and occasionally up to 75lbs. Must be at least 18 years of age. Your Mission... 

Insight Global

Manager - Material & Inventory Planning Job at Insight Global

 ...Position: Materials Manager Location: Ladson, SC Length: FTE Rate: $120,000 - $145,000(Exact compensation may vary based on several factors, including skills, experience, and education) Required Skills Requires a minimum of 5 years of shipping/receiving... 

LHH

Director of Marketing Job at LHH

 ...manufacturing client to recruit a Director of Marketing to join their team on a permanent basis....  ...small team of B2B marketers across the digital, eCommerce and creative spectrum, with a...  ...bring 7+ years of integrated marketing experience with a deep understanding of B2B...