Azure Senior Data Engineer

Azure Senior Data Engineer who has strong experience in DWH and ETL technologies on Big Data and Azure cloud and experience in real time data processing. Candidates must have strong communication skills that allow you to regularly deal with stakeholders, as well as with specialists from related fields including POs, architects, and other Engineers. They should show some proven experience in the architecture definition ensuring the scalability, reliability, and performance. At least 6 years of experience as a Data Engineer or in a similar role. Have experience cleansing, manipulating and analysing large datasets both structured and unstructured exceptional data Project experience using Azure cloud, data lake storage, Data factory, Spark/Databricks, Python or Java, Kafka (for streaming and real time data consumption) Experience using tools for efficient data virtualization, exploration, and transformation tools ( Dremio ) Experience in creating Batch and Realtime Data pipelines on Azure (preferentially). Experience in performance tuning of complex ETL mappings for relational and non-relational workloads. Advanced SQL programming , PySpark, PL/SQL or T-SQL, SparkSQL Hands on Unix scripting or PowerShell , experience with Azure PaaS servicesHadoop Data Serialization mechanism line PARQUET, AVRO, ORC. Hands on experience in Azure, preferably data heavy / analytics applications leveraging relational and NoSQL databases, data warehouse and big data. Languages (mandatory): Native speaker Portuguese and Advanced English (spoken, written, read)