PySpark Engineer Job at Tata Consultancy Services, Owings Mills, MD

Qy83S1ZKd096Wk5vdDdsb3ZxekhrNUhKemc9PQ==
  • Tata Consultancy Services
  • Owings Mills, MD

Job Description

Role: Lead PySpark Engineer

Job type: Fulltime

Location: Owings Mill, MD

Roles & Responsibilities:

10+ years of experience in big data and distributed computing.

• Very Strong hands-on experience with PySpark, Python, Airflow, DBT & DWH concepts

• Strong Hands on experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.).

• Proficiency in data modeling and ETL workflows.

• Proficiency with workflow schedulers like Airflow

• Hands on experience with AWS cloud-based data platforms.

• Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus.

• Strong problem-solving skills and ability to lead a team

Develop, test and maintain high-quality solutions using PySpark /Python programming language.

· Participate in the entire software development lifecycle, building, testing and delivering high-quality

data pipelines.

· Collaborate with cross-functional teams to identify and solve complex problems.

· Write clean and reusable code that can be easily maintained and scaled.

· Keep up to date with emerging trends and technologies in Python development. Design and develop

business controls using AWS Glue and PySpark

· Integrate data from various sources into Amazon Redshift

· Optimize performance of data processing jobs and fine tune queries

Salary Range: $110,000 - $115,000 a Year

Job Tags

Full time,

Similar Jobs

Medix™

Medical Scribe Job at Medix™

 ...We are seeking an Ophthalmic Medical Scribe who will be responsible for providing accurate documentation and summarization of the ocular examination and recommendations while maintaining patient flow and communication regarding appointment status within a high volume... 

ProKatchers LLC

Medical Receptionist Job at ProKatchers LLC

 ...Job Title : Medical Receptionist Location : Petoskey, MI Duration : 3 Months Education : High School Diploma or GED required Shift Details : 8:00 AM 5:00 PM Specific Skills : Greet and check in/outpatients and visitors with professionalism. Answer... 

Walpole Public Schools

School Year Secretary Job at Walpole Public Schools

School Year Secretary Location Walpole, MA : Walpole Public Schools is seeking a School Year Secretary (40 hours per week) for the 2025-2026 school year at Walpole High School, effective August 19, 2025. Role: The School Secretary works under the general supervision... 

Lakeland Regional Health-Florida

IS Epic Cache Database Administrator - IS Epic Engineering Job at Lakeland Regional Health-Florida

 ...been dedicated to serving our community with excellence in healthcare. As the only Level 2 Trauma center for Polk, Highlands, and Hardee counties,...  ...seeking motivated individuals to join our team in various entry-level positions. Whether you're starting your career in healthcare... 

AppleOne Employment Services

Construction Superintendent Job at AppleOne Employment Services

 ...components and proper installation procedures. Sequence work plans, schedule tasks, and manage budgeting and expenditures...  ...Administration, or a related field (preferred). Bilingual English/Spanish preferred HOW TO APPLY: Send a Microsoft Word version...