Role: Lead PySpark Engineer
Job type: Fulltime
Location: Owings Mill, MD
Roles & Responsibilities:
10+ years of experience in big data and distributed computing.
• Very Strong hands-on experience with PySpark, Python, Airflow, DBT & DWH concepts
• Strong Hands on experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.).
• Proficiency in data modeling and ETL workflows.
• Proficiency with workflow schedulers like Airflow
• Hands on experience with AWS cloud-based data platforms.
• Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus.
• Strong problem-solving skills and ability to lead a team
Develop, test and maintain high-quality solutions using PySpark /Python programming language.
· Participate in the entire software development lifecycle, building, testing and delivering high-quality
data pipelines.
· Collaborate with cross-functional teams to identify and solve complex problems.
· Write clean and reusable code that can be easily maintained and scaled.
· Keep up to date with emerging trends and technologies in Python development. Design and develop
business controls using AWS Glue and PySpark
· Integrate data from various sources into Amazon Redshift
· Optimize performance of data processing jobs and fine tune queries
Salary Range: $110,000 - $115,000 a Year
...FRONT DESK REPRESENTATIVE BILINGUAL IS A PLUS Primary Duties and Responsibilities: All... ...Qualifications: One year of administrative/reception work is required High School Diploma or equivalent Bilingual (Spanish) highly sought Background in customer...
...Now Hiring: Part-Time Evening Cleaning Technician Location: Thomasville, NC Schedule: MondayFriday (Evenings) Pay:... ...Crew Are you looking for consistent, part-time evening work with a company that values professionalism, communication, and...
...improvement, this practice is actively engaged in clinical research and innovative treatments, making it an ideal place for an aspiring optometrist to thrive and make a meaningful impact. If you're ready to contribute to a brighter future for patients, this is the perfect...
...Our client is a $28B NY based multi-strategy Hedge Fund currently seeking to add a talented Associate to their Data & Performance Analytics Team. This individual will be working closely with senior managers across finance, investment management, operations, technology...
...across power distribution, substations, and industrial systems. Role Description We are hiring Journeyman Electricians and Apprentice Electricians to join our electrical division. Our projects include power distribution, substations, and industrial electrical...