Senior Data Engineer

Senior Data Engineer
Empresa:

Lean Tech


Lugar:

Brasil


Função de trabalho:

Tecnologia da informação

Detalhes da Vaga

Company Overview:Lean Tech is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer many opportunities for professionals to elevate their careers and experience substantial growth. Joining our team means engaging with expansive engineering teams across Latin America and the United States, contributing to cutting-edge developments in multiple industries.We are seeking a dedicated Senior Data Engineer to join our team and provide support and troubleshooting for our drivers.Position Title: Senior Data EngineerLocation: Remote - LATAMWhat you will be doing:The Senior Data Engineer will be responsible for the development, optimization, and maintenance of Extract, Transform, Load (ETL) processes using Python, focusing on building a data ingestion engine to support customer reporting solutions. Your responsibilities will include:Develop, optimize, and maintain ETL processes using Python.Troubleshoot ETL-related issues to ensure data accuracy and integrity.Collaborate with departmental teams to understand data and reporting requirements.Implement best practices for data retrieval and reporting performance.Maintain documentation of ETL processes and data architectures.Automate the ingestion of external data via Snowflake, including validation and transformation.Create standard SQL queries for report generation and upload files to a server.Ensure seamless delivery of reports, including email notifications for customers.Work closely with stakeholders to define and refine data requirements and reporting strategies.Develop and maintain data pipelines to support analytics and business intelligence efforts.Requirements & Qualifications:To excel in this role, you should possess:Proficiency in SQL and experience with Snowflake.Strong ETL experience using Python.Experience with large, structured datasets.Ability to collaborate effectively with cross-functional teams.In-depth knowledge of Amazon Web Services (AWS) and Platform as a Service (PAAS) (Good to have)Working knowledge of Bitbucket and Git (Good to have)Foundational knowledge of CI/CD platforms, preferably TeamCity (Good to have)Experience working with data in various formats including XML, JSON, and CSV (Good to have)Ability to automate data ingestion from Amazon S3, FTP, and other technologies (Good to have)Strong problem-solving skills and attention to detail.Proven ability to manage multiple tasks and meet deadlines.Experience in designing and implementing data architectures.Understanding of data governance and data security best practices.Experience with data warehousing concepts and technologies.Ability to work independently and as part of a team.Strong analytical and critical thinking skills.Why you will love Lean Tech:Join a powerful tech workforce and help us change the world through technology.Professional development opportunities with international customers.Collaborative work environment.Career path and mentorship programs that will lead to new levels.Join Lean Tech and contribute to shaping the data landscape within a dynamic and growing organization. Your skills will be honed, and your contributions will play a vital role in our continued success. Lean Tech is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.#J-18808-Ljbffr


Fonte: Whatjobs_Ppc

Função de trabalho:

Requisitos

Senior Data Engineer
Empresa:

Lean Tech


Lugar:

Brasil


Função de trabalho:

Tecnologia da informação

Network Engineer

IT Engineer - QA Analyst #2382Position Summary:Our partner, a fast-growing PaaS company specializing in remote monitoring and network management solutions, i...


Desde Ranger Technical Resources - Brasil

Publicado 4 days ago

Engenheiro (A) De Software C# (.Net Core) | Pleno

O Que Procuramos?Experiência em desenvolvimento C# ;Experiência com .NET Core;Conhecimento de arquiteturas de microsserviços e APIs RESTful;Experiência com b...


Desde Tqi - Brasil

Publicado 4 days ago

Senior Software Engineer

Senior Software Engineer / Golang DeveloperAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that unde...


Desde Remobi - Brasil

Publicado 4 days ago

Analista De Suporte Técnico Sap Business One Pl

Atividades realizadas:Garantir a operação eficiente e ininterrupta do sistema SAP B1, fornecendo suporte técnico e funcional de alta qualidade para os usuári...


Desde Sps Group - Brasil

Publicado 4 days ago

Built at: 2024-10-17T03:56:53.775Z