Senior Data Engineer

Detalhes da Vaga

www.hcltech.com We are HCLTech, one of the world's largest and fastest growing technology and DSA companies with over 227,000 professionals across 60 countries, driving progress through industry-leading capabilities focused on Digital, Engineering and Cloud. The driving force behind this work, our people, is a diverse, creative and passionate audience that enables us to continually raise the bar for excellence in our services. We strive to empower each of our professionals to achieve their best, while also striving to help them find their daily inspiration and become the best version of themselves. We are looking for a highly talented and self-motivated Software Engineer to join us on our journey to advance the world of technology through innovation and creativity. Job description: The Data Engineer I supports our business goals by designing, implementing, and maintaining data pipelines using cloud-native tools in a modern data stack. JOB RESPONSIBILITIES: • Expertly perform tasks under supervision. • Develop and maintain end-to-end data pipelines using cloud-native solutions to extract, load, and transform data from disparate data sources to a cloud data warehouse. • Capable of formatting and distributing custom data extracts through various means (e.g., custom SFTPs, APIs (e.g., RESTful), and other bulk data transfer mediums) and optimizing data storage options based on business requirements. • Competent in helping to develop/design database structure and function, schema design, and database testing protocols. • Contribute to the process of defining company data assets (data models) and custom client workflows, as well as standardized data quality protocols. • Capable of independently and collaboratively troubleshooting database issues and queries for improving data retrieval times across various systems (e.g., via SQL). • Collaborate with both technical and non-technical stakeholders including IT, Data Science, and various team members across a diverse array of business units. • Work closely with IT team whenever necessary to help facilitate, troubleshoot, or develop database connectivity between internal/external resources (e.g., on-premises Azure Data Lakes, Data Warehouses, and Data Hubs). • Help implement and enforce enterprise reference architecture and ensure that data infrastructure design reflects enterprise business rules as well as data governance and security guidelines. QUALIFICATION REQUIREMENTS: • Bachelor's degree (BS/BA) in Information Systems, Software Engineering, Computer Science, Data Engineering, or related field required. Master's degree (MS/MA) preferred. • Experience with Azure Stack (Data Lake/Blob Storage, PowerBI Services, Azure Data Factory (or equivalent), Databrick) and production level experience with on-premises Microsoft SQL Server required. • Experience with ETL/ELT, taking data from various data sources and formats and ingesting into a cloud-native data warehouse, required. • Experience with one of the following: Python, Pyspark ,as well as standard analytic libraries/packages (e.g., pandas, Numpy, dplyr, data table, stringr, Slick, and/or Kafka) and related distribution frameworks required. Strong verbal and written communication skills required. • Experience with DataRobot, Domino Data Labs, Salesforce MC, Veeva CRM preferred. • Familiarity with Snowflake Warehouse preferred. • Familiarity with statistical concepts and analytic modeling (e.g., regression analyses, hypothesis testing, and ML based modeling) preferred. • Experience with healthcare marketing analytics, healthcare data claims, and common medical coding APPROVED Why choose us? We are one of the largest and fastest growing technology companies in the world, with offices in over 60 countries and 224,000 employees Our company is extremely diverse with 165 nationalities represented We offer the opportunity to work with colleagues from all over the world We offer a virtual-first work environment, promoting a good integration between your work and personal life, with real flexibility We are committed to your growth, offering learning and career development opportunities at all levels to help you find your unique brilliance. We offer comprehensive benefits to all employees We are certified as a "Great Place to Work" and "Top Employer" in 17 countries, and recognized as a "Top Employer" in Brazil specifically, offering a positive work environment that values employee recognition and respect Equality & Opportunity for All Representing 165 nationalities worldwide, we are proud to be an equal opportunity employer committed to providing equal employment opportunities to all applicants and employees without regard to race, religion, sex, color, age, national origin, pregnancy, sexual orientation, disability or genetic information, or any other protected classification, in accordance with federal, state and/or local laws


Fonte: Adzuna_Ppc

Função de trabalho:

Requisitos

Líder Técnico De Software Iii (Machine Learning)

O Inatel está recrutando Especialista para atuar com Liderança Técnica de projetos na área de Machine Learning, no ICC SW. Responsabilidades e atribuições Li...


Desde Instituto Nacional De Telecomunicações - Inatel - Brasil

Publicado a day ago

Staff Data Science

Staff Data Science - Brazil (remote) Our client in Brazil is looking for a Staff Data Science to build and define objectives almost from scratch. They are re...


Desde S&You - Brasil

Publicado a day ago

Pessoa Desenvolvedora De Software Sênior (Back-End)

Nosso jeito de fazer história: Entre para a história de construção do maior Hub de Dados e Analytics do Brasil. Além de você contribuir diretamente neste obj...


Desde Neoway - Brasil

Publicado 11 days ago

Analista De Testes / Qa Sênior

Analista de Testes / QA Sênior Job Description A Genesis Consulting tem oportunidade imediata para Analista de Testes/QA Sênior experientes com verdadeira pa...


Desde Genesis Consulting Partners, Llc - Brasil

Publicado 11 days ago

Built at: 2024-11-01T04:49:43.764Z