Pyspark Engineer Job at Trinity Technology Solutions LLC, Charlotte, NC

Q3ZERldac0p5NUZ0czcxcXRLN0VrNVRKeVE9PQ==
  • Trinity Technology Solutions LLC
  • Charlotte, NC

Job Description

Job Description:

Our client is seeking a highly skilled and experienced Senior PySpark Developer to join our dynamic data engineering team. This role is ideal for a motivated professional with a strong background in big data technologies, ETL processes, and database systems. The successful candidate will play a key role in designing, developing, and optimizing data pipelines and analytics solutions that support critical business operations.

📌 Note: Only candidates eligible to work on a W2 basis will be considered.

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines using PySpark and Spark SQL.
  • Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver robust solutions.
  • Optimize and troubleshoot complex ETL workflows and data transformation processes.
  • Write efficient SQL queries for data extraction, transformation, and loading.
  • Ensure data quality, integrity, and compliance with enterprise standards.
  • Participate in code reviews, testing, and deployment activities.
  • Monitor and maintain production workflows, including job scheduling and performance tuning.

Required Skills & Qualifications:

  • 5+ years of experience in data engineering or software development.
  • Strong proficiency in PySpark, Python, and Spark SQL.
  • Solid experience with SQL and relational database systems.
  • Proven expertise in ETL development and data pipeline orchestration.
  • Familiarity with job scheduling tools; Autosys experience is a plus.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration abilities.

Preferred Qualifications:

  • Experience working in the financial services industry.
  • Familiarity with cloud platforms and big data ecosystems.

Job Tags

Similar Jobs

City of Hialeah Municipal Government

Solid Waste Inspector Job at City of Hialeah Municipal Government

 ...involves daily field contact and the patrolling of public and private property for unsanitary conditions. Candidate must investigate...  ...Superintendent of the Division of Solid Waste. ESSENTIAL EXAMPLES OF DUTIES The following illustrates examples of some of the essential... 

Aspen Insurance Group

Senior Claims Adjuster Job at Aspen Insurance Group

 ...Location: Jersey City, NJ, US, 07310 Company: Aspen Insurance Since Aspen was founded in 2002, we have become a leading, diversified...  ...600.00 Maximum Salary - 122,000.00 As a Senior Claims Adjuster this individual will be able to use their deep knowledge and... 

Great American Insurance Group

Senior Underwriting Manager Job at Great American Insurance Group

 ...Running a farm or ranch has always involved a lot of risks. But these days, rapid changes in the industry are raising the stakes....  ...division provides coverage for full-time farms, ranches, and other agricultural operations in 44 states. The farm products can cover businesses... 

Pompei, Inc.

Ceramic Tile and Flooring Project Manager Job at Pompei, Inc.

Responsibilities An Project Manager in our flooring group will be responsible managing the project until completion with support staff from seasoned superintendents and project engineers.A background with flooring is preferred, but not required. Project Manager ...

Medix™

Non Clinical Registered Nurse - 240421 Job at Medix™

 ...Job Title: Non-Clinical RN Experience: Open to various clinical backgrounds/experience. Must have 2+ years...  ...desire to be flexible, innovative, and creative. EDUCATION AND EXPERIENCE: # Licensed, Registered Nurse, required in New York # Baccalaureate degree in...