Data Engineer Sr

Detalhes da Vaga

Who We Are
PALO IT is a global innovation consultancy and Agile software development company dedicated to helping organizations embrace tech as a force for good. We work with clients to rapidly launch products and services, create new business models, leadership and culture for the future. We are a community of innovators, designers and technologists across 10 offices and five continents (France, Spain, Hong Kong, Singapore, Thailand, Australia, Mexico, USA, Brazil and Colombia).
We're committed to helping businesses transform our world for the better. We're proud to be a World Economic Forum (WEF) New Champion, and a B Corp-certified company in México, Singapore and Hong Kong, currently working towards certification across all other locations.
Our Impact in PALO IT
Using our B Corp certification and WEF status as our north star, we're eager to adapt to change, learn from our experiences and move to meet our planet's urgent needs. With 2025 as our horizon, we are taking action to meet the following objectives:

Become a climate net-zero company
Attain 50% of revenue from projects with a positive impact
Train 100% of our workforce on impact
Achieve B Corp certification among all 11 of our offices across the globe
Attain 90% happy employees at PALO IT

Our clients are amongst the world's most successful companies. We innovate with both established Fortune 1000s, SMEs and start-ups who aim to make an impact, become global leaders and address the world's most complex challenges.
What does your job look like?
As a Data Engineer, your main goal is to support and enhance a data-driven culture throughout the organization. You will collaborate with the Decision Science team to build solutions that enable teams to explore large datasets, experiment with and validate hypotheses, develop and optimize machine learning models, and use these models for real-time parametric decision-making. Additionally, you will contribute to the maintenance and development of the data flow on our Big Data platform. You will be responsible for designing, implementing, and optimizing data solutions using a variety of advanced tools and technologies.
Your main responsibilities will be to

Maintain and develop the data flow on the Big Data platform.
Design and build robust and scalable data pipelines.
Integrate and manage large volumes of data from various sources.
Develop and optimize data processing jobs using Hadoop, Spark, and other related tools.
Configure and maintain workflow orchestration tools like Apache Airflow.
Ensure data quality, integrity, and security.
Collaborate with multidisciplinary teams to identify data requirements and provide appropriate technical solutions.
Document processes, architectures, and data flows.

What you need to succeed on this role

Degree in Computer Science, Computer Engineering, or a related field.
Demonstrable experience using Hadoop, Sqoop, Spark, Airflow, Avro, Python, ELK, Oracle Database, PostgreSQL, and Hive.
Strong knowledge of relational and non-relational databases.
Experience in implementing and maintaining data pipelines in Big Data environments.
Programming skills in Python.
Knowledge of log monitoring and analysis tools like ELK.
Ability to solve complex problems and work independently and as part of a team.
Good communication skills and ability to document technical processes.
Advance English B2 or above.

Desirable Qualifications

Previous experience in technology companies or Big Data projects.
Familiarity with agile methodologies and project management tools.

You're aligned with our value by:

Your willingness to do the right thing even when facing adversity
You care about the well-being of others and the world at large
You strive to approach things in an optimistic way
You nail the fundamentals, sweat the details
You understand the whole is more than the sum of its parts and actively work towards continuous improvement of the group

What We Offer

Stimulating working environments
Unique career path
International mobility
Internal R&D projects
Knowledge sharing
Personalized training
Entrepreneurship & intrapreneurship

Discover more about us
- With our PALOCast with direct testimonies from our Palowans!
- More on our team culture and benefits in our careers page.
PALO IT is an equal opportunity employer that values merit, qualifications, and abilities. We prioritize privacy and data security. For more information on our privacy practices, please refer to our Privacy Policy.
#J-18808-Ljbffr


Salário Nominal: A acordar

Fonte: Whatjobs_Ppc

Função de trabalho:

Requisitos

[Job-19300] Sr Arquiteto De Software - Brasil

Nós somos especialistas em tech transformation, nós somos a CI&T. Combinamos a força disruptiva da Inteligência Artificial com a expertise humana para apoiar...


Ci&T - Brasil

Publicado há 7 dias

[Job-19476] System Architect (Node/React), Brazil

Nós somos especialistas em tech transformation, nós somos a CI&T. Combinamos a força disruptiva da Inteligência Artificial com a expertise humana para apoiar...


Ci&T - Brasil

Publicado há 7 dias

[Job-19023] Master Sdet (Software Developer Engineer In Test) - (.Net/C# - Automation), Brasil

We aretech transformationspecialists, we areCI&T. We combine the disruptive power of Artificial Intelligence with human expertise to support large companies...


Ciandt - Brasil

Publicado há 9 dias

[Job-19021] Senior .Net Developer, Brazil

We aretech transformationspecialists, we areCI&T. We combine the disruptive power of Artificial Intelligence with human expertise to support large companies...


Ciandt - Brasil

Publicado há 9 dias

Built at: 2024-12-27T14:49:09.656Z