This job is no longer active. It was disabled the Oct. 11, 2024 by Relex
Data Engineer
<p>RELEX is a fast-growing technology company that helps retailers optimize their businesses. By accurately forecasting consumption and demand of goods, reducing inventory costs, increasing availability, minimizing spoilage and reducing fleet emissions, we help retailers minimize their environmental impact, increase profits and aim for higher customer satisfaction.</p> <p>The RELEX platform consists of multiple inter-connected applications – Work, Plan, Store and Connect. As the systems grow and integration requirements become more complex, the Data Engineering team at RELEX ensures that data is shared between applications in a structured, predictable and observable manner.</p> <p>As an internal team our focus is simple - We deliver data where and when it’s needed. The volumes are high, latencies need to be low and the pipelines need to be highly reliable. In order to achieve our goals, we are now looking for a Senior Data Engineer to join our team in Helsinki, Finland. The engineer will join a fast-moving team that is building a platform for delivering, storing and analyzing data in motion and at rest.</p> <h2 id="what-youll-be-working-on">What you’ll be working on </h2> <p>You decide! The team is busy building a robust next generation data platform and we are taking systems from "Proof-of-Concepts" to production. We work in small Agile squads and each team member helps shape the future of the platform. As part of this squad, you will be:</p> <ul> <li>Creating managed and observable ETL/ELT pipelines using modern ETL tools such Airflow and NiFi</li> <li>Extracting from and writing data to databases such as PostgreSQL, Redis and our proprietary in-memory OLAP database</li> <li>Designing, managing and administering centralized data warehouse solution</li> <li>GitOps - Managing and provisioning your own infrastructure on Azure using Terraform</li> <li>Provisioning and managing Kafka, Spark Streaming and other stream processing tools</li> <li>Writing connectors for Kafka, Spark etc. for various internal systems and data stores</li> <li>Writing batch and streaming ETL jobs in Python and Scala</li> <li>Introducing your pets to your extended family at RELEX!</li> <li>Your choice!</li> </ul> <p>Besides using Python in data engineering, at RELEX we trust the JVM ecosystem: our main backend language is Java, but we run services written in Kotlin, JRuby, Scala, and Clojure. Hence, familiarity with JVM ecosystem is a big plus.</p> <h2 id="what-we-are-looking-for">What we are looking for</h2> <p>While we prefer candidates with a strong data engineering background, we are open to considering “all-rounder” candidates with demonstrable experience in building large scale data intensive applications. We highly value stability, ability to learn and ability to deliver under demanding conditions. </p> <p>An ideal candidate has many of the following items. Note that you don't need to have check every box on the list!</p> <ul> <li>Experience in building end to end data pipelines using tools such as Airflow, Streamsets, NiFi etc</li> <li>Solid experience with public cloud infrastructure. At RELEX we use Azure.</li> <li>Experience with big data tools/systems such as HDFS, HBase, Spark is a plus</li> <li>Experience with SQL, NoSQL and time series databases</li> <li>Experience with data warehouses and data lakes</li> <li>Experience in managing and provisioning big data infrastructure using Terraform, ARM or CloudFormation is highly desirable</li> <li>Good understanding of distributed systems and architectures</li> <li>Strong programming skills in Java/Scala/Python</li> <li>Strong Linux and Unix skills</li> <li>Experience with containers and Kubernetes is highly desirable</li> <li>Experience with Kafka and Stream processing engines such as Flink, Spark Streaming or Storm would be advantageous</li> <li>Eye for detail. Experience in testing and TDD would be advantageous</li> </ul> <p>Besides having the relevant technical skills, we value the ability to reason, to break down problems into manageable pieces, and to question and consider alternatives. You are realistic and are able to strike a balance between deadlines, deliverables and perfection.</p> <h2 id="our-offer-to-you">Our offer to you</h2> <p>A position in a fast-growing company, room for creativity and opportunity to create new things with modern technologies in small autonomous teams. An ability to define your own role according to your preferences. Private health insurance, a cellphone contract, yoga classes and a laptop of your choice! And of course, your monthly pay cheque!</p> <p>If that sounds exciting, please send your cover letter and resume through the application form as soon as possible, but no later than April 5th, 2020. Note that the position will be filled as soon as we find the right person - so act quickly.</p> <p>If you have questions regarding this position, please contact our Data Architect Matias Käkelä <<a href="mailto:camillo.sars@relexsolutions.com">matias.kakela@relexsolutions.com</a>> by email. Please note that we cannot process applications via email.</p>