July 5
Airflow
Apache
AWS
Benchmarks
Cloud
Flash
Google Cloud Platform
Grafana
Kubernetes
MapReduce
Prometheus
Python
Spark
Terraform
Go
• The main goal of the data engineering team is to build and maintain data pipelines and processes to create a high-performance, self-service platform for Analytics Engineers, Data Analysts, and Data Scientists. This platform will enable them to build excellent pipelines easily, with abstractions ready for reliability, scalability, performance, security, quality, profiling, documentation, lineage, and more. • Build and maintain a high-performance data platform that meets the company's needs, connects with product solutions, and leads analytical innovation, enabling incredible architectures and efficient platforms • Responsible for the entire code development lifecycle (monitoring deployment, adding metrics and alarms, ensuring SLO budget compliance, and more) • Align with stakeholders to understand their primary needs, while also having a holistic view of the problem and proposing extensible, scalable, and incremental solutions • Conduct PoCs and benchmarks to determine the best tool for a given problem, and decide whether to use an off-the-shelf solution or develop one in-house • Contribute to defining the strategic vision, crossing team and service boundaries to solve problems
• Knowledge in Big Data technologies, solutions, and concepts (Spark, Hive, MapReduce) and multiple languages (YAML, Python) • Proficiency in Python, or one of the main programming languages, and a passion for writing clean and maintainable code. You may even be a Software Engineer with a focus or passion for data-oriented solutions • Understanding of the data lifecycle and concepts such as lineage, governance, privacy, retention, anonymization, etc. • Excellent communication skills, proactively sharing and seeking context to collaborate with different teams.
• Competitive salary package • Bonus • Meal allowance ("Flash benefícios") • Health plan • Dental plan (optional) • Life insurance • Daycare subsidy • Subsidy to sports practicing (Gympass) • Extended maternity and paternity leave • Reserved room for breast-feeding* • Discount on our parking lot;* • Language learning support • Free transfer from Vila Madalena and Fradique Coutinho stations to the office* • Free bike rack in our parking lot.*
Apply NowMarch 20