Share People Hub in partnership with a global company, is searching for a Data Engineer.What you'll do:Support Data Engineering team lead to ensure the quality and agility of the team activities.Work collaboratively and creatively with other data engineers to develop scalable and maintainable data pipelines using the latest technologies and leading industry practices.Build data pipelines that ingest various data sources into the Harmonized Data Mesh structure and make it available for consumption for both internal data analytics and data science teams, as well as external clients.Debug, unit-test, and deploy data pipelines, and optimize.Ingest and manage metadata in relation to data and processes.Manage, document, and version code.Participate and promote the Data Engineering best practices across the organization.Participate and promote Enterprise Data Governance frameworks.Partner with a variety of internal stakeholders across the organization to deliver creative, cutting-edge, high-quality engineering solutions that meet business requirements in a fast-paced, ever-changing business environment.Be part of a cross-functional team, directly contributing to feature development and maintenance of a global product.Partner with colleagues to build and maintain tooling for test development, automation, and release processes improvement.Advocate for the user experience when communicating with product, design, and tech.Follow best development practices to achieve continuous improvement.Provide the team with a quality strategy that supports the team's delivery goals.Be constantly challenged to create world-class solutions.What you'll need:Experience in Data Engineering.Years of experience with cloud computing, preferably Azure.Strong understanding of modern data storage and evolution (Data Lake, Delta Lake, Lakehouse, etc.
).Experience in Data pipeline development using PySpark, Scala, etc.Experience working with Big Data frameworks, preferably Databricks.Experience working with transactional/relational data and SQL.Strong experience in performance tuning and optimizations in PySpark and SQL.Strong experience working on Agile teams implementing DevOps practices.Strong experience in CI/CD pipelines.Excellent communication skills, adapting to various audience types.Passionate about innovation and loves solving complex problems in a highly collaborative, fast-paced team environment.Equal Opportunity & Affirmative Action:Our client is proud to be an Equal Opportunity and Affirmative Action employer.
We do not discriminate based on race, color, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other applicable legally protected characteristics.
#J-18808-Ljbffr