job summary:
Role Summary:
The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect's data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading a team of Data Engineers and Analysts, optimizing ETL processes, and supporting the data structure required for robust analytics.
Key Responsibilities:
Lead the development of data pipelines using AWS Glue and PySpark, transforming data from raw to analytics-ready stages.
Collaborate with the Data Architect to implement data models and ensure data integrity.
Oversee the work of Data Engineers, providing technical guidance and ensuring adherence to best practices.
Monitor and optimize data processing workflows, ensuring efficient resource usage.
Skills and Qualifications:
Bachelor's degree in Computer Science, Engineering, or related field.
7+ years of experience in data engineering, with a focus on AWS Glue and PySpark.
strong skills in SQL and data pipeline development.
Experience leading data engineering teams and optimizing ETL workflows.
location: Malvern, Pennsylvania
job type: Contract
salary: $75 - 80 per hour
work hours: 8am to 4pm
education: No Degree Required
responsibilities:
Role Summary:
The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect's data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading a team of Data Engineers and Analysts, optimizing ETL processes, and supporting the data structure required for robust analytics.
Key Responsibilities:
Lead the development of data pipelines using AWS Glue and PySpark, transforming data from raw to analytics-ready stages.
Collaborate with the Data Architect to implement data models and ensure data integrity.
Oversee the work of Data Engineers, providing technical guidance and ensuring adherence to best practices.
Monitor and optimize data processing workflows, ensuring efficient resource usage.
Skills and Qualifications:
Bachelor's degree in Computer Science, Engineering, or related field.
7+ years of experience in data engineering, with a focus on AWS Glue and PySpark.
strong skills in SQL and data pipeline development.
Experience leading data engineering teams and optimizing ETL workflows.
qualifications:
skills:
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
About the Company:
Randstad USA
Looking for your next great opportunity but not sure where to find it? When you let Randstad US handle your job search, you get the support of one of the world's largest staffing firms partnering with you every step of the way. Our recruiters have the resources to find a job that's right for you. We combine our passion for people with the power of today's latest technologies to find opportunities that fit your skills in environments where you can thrive. Whether you're looking for a temporary or permanent position, our focus is on partnering with you to realize your true potential. And it all starts with your next great role.
Company Size:
10,000 employees or more
Industry:
Staffing/Employment Agencies
Founded:
0
Website:
...Board Certified Behaviour Analyst - Washington DC Compensation: $85 to $95 per hour This is a part-time... ...individuals to provide Applied Behavior Analysis (ABA) therapy in client homes... ...The Board-Certified Behavior Analyst (BCBA) provides supervision to clients and...
Ardurra is seeking a Water/Wastewater Project Manager to join our growing Public Works team. Primary Function In this role, you will manage and work on a variety of water/wastewater projects including but not limited to w/ww treatment plants. Remote opportunity...
...Fundraising deliveries are starting soon and we are hiring for our driver positions. APPLY TO THIS AD TODAY OR CALL (***) ***-****... .... What we need from you is: Ability to Drive a Straight Box Truck with manual transmission. Air Brake Endorsement Required (or...
...Dietetics Commission on Dietetics Registration (CDR) is required. * Currents licensure in the state of Maryland as a Dietitian/Nutritionist is required. * Six months of experience as a clinical nutritionist in a hospital setting preferred. Additional Information...
...Compliance, Computer Forensics, Software Assurance, Software Testing, Test Automation, Section 508 and WCAG Accessibility Assessment... ...more secure. Job Summary TestPros is s eeking skilled Penetration Testers to conduct cybersecurity assessments and provide technical...