Platform Engineer - Data 🇦🇺
Evolve Energy
This job is no longer accepting applications
See open jobs at Evolve Energy.See open jobs similar to "Platform Engineer - Data 🇦🇺" URBAN-X.Software Engineering
Melbourne VIC, Australia · Melbourne, VIC, Australia
Posted on Jul 2, 2024
About Octopus Energy and Kraken
Since 2016, Octopus has been on a mission to bring affordable, green energy to the world. With the help of our in-house developed technology platform, Kraken, we’ve become the largest energy supplier in the UK, opened retailers in 7 other countries, and licensed our software to retail giants including E.ON in the UK and Origin Energy in Australia. We’ve reinvented energy products with smart, data-driven tariffs to balance customer demand with renewable generation - and we’re the biggest investor in renewable generation in the UK.
We've since expanded our tentacles and we are now looking for a Platform Engineer, based in Melbourne. We're looking for someone with a general interest in technology and problem-solving; someone diligent and thoughtful. Working with Kraken is a chance to join an exciting scale-up business within the energy supply sector, one that’s at the forefront of changing the landscape of the energy industry across the world. A role with us offers you the chance to contribute to building world-class operations that will catapult you into a fantastic career.
Our team
At Kraken we have developed a platform to provide data services to our retail businesses and clients across 22 deployments globally.
The data platform engineering team develops and manages the back-end systems and processes supporting this platform, predominantly working with time-series data fed into the system by our customers’ smart metres. We have developed a suite of applications to process, transform, and make this data available to downstream services.
To process the volume of data we typically see, our applications run PySpark or dbt jobs using Databricks as our Spark engine. We also leverage Airflow and Kubernetes heavily. We also employ software engineering best practices to design, test, and deploy our data platform and services.
For our stack we use…
Python as our main programming language
Terraform for our infrastructure definition
Kubernetes for data services and task orchestration
Helm for deploying and managing kubernetes apps
Airflow for job scheduling and tracking
Circle CI / Github Actions for continuous deployment
Parquet and Delta file formats on S3 for data lake storage
Postgres / aurora for our relational databases
Spark / Databricks for data processing
dbt for data modelling
SparkSQL for analytics
Streamlit for data applications
Git for version control
What you'll do...
- We are hiring a Platform engineer to support the operation and maintenance of our data infrastructure. We are constantly growing and our current goal is to be able to deploy a new data platform end-to-end in a working week.
- We are looking for someone who can support and contribute to that, is able to self-direct as well as working asynchronously across global product teams to ensure that best practice is followed in everything we build, deploy, and deliver
- First and foremost, we want our platform engineers to have a passion for writing high quality code and building lean processes. We are a team of passionate and opinionated engineers working to build robust and reusable systems.
About you
- We are looking for a candidate who will self-manage, adapt to our changing business requirements, and proactively work to scope problems and deliver pragmatic solutions. As well as growing our core functionality, maintenance of existing client infrastructure will be required.
- Ideally you will have experience working with…
- AWS
- Terraform
- CDC systems (DMS, Debezium etc.)
- Kubernetes (EKS)
- Python
- CI/CD systems (CircleCI/Github Actions)
- Version control (Git)
- Experience working with, managing, or tuning Postgres or similar DBs
- An interest in or experience with data or network security
- Experience with building repeatable and reusable patterns for deployment
- Experience with maintaining and uplifting capabilities of existing infrastructure
- Experience in identifying and resolving issues with critical batch and/or streaming processes
- Experience with supporting colleagues on DevOps related queries/requests
- Experience with other elements of our stack
- Airflow
- Jupyter
- Spark/Databricks
- Helm
- Docker
Additionally it would be useful to have….
What you will love about us
- Our company culture - We are organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We want your hard work to be rewarded with perks you actually care about! We won best company to work for in 2022, on Glassdoor we were voted 50 best places to work in 2022 and our Group CEO, Greg has recorded a podcast about our culture and how we empower our people.
- Flexible working environment - genuine work life balance here, we are in the top 5 companies in the UK, we treat you as a human, and do our best to make work and life merge smoothly together
- Equity Options Scheme - you own your own part of the business, share options in the whole Octopus Energy Group so we all work together towards success
- Office - have a certain tech requirement? We’ll do our best to get it. We also have drinks, snacks and a coffee machine at our brand new office in the CBD.
- Your development is important - we support and help with development including internal and external courses, learning, study support etc, all bespoke to you
Studies have shown that some groups of people, like women, are less likely to apply to a role unless they meet 100% of the job requirements. Whoever you are, if you like one of our jobs, we encourage you to apply as you might just be the candidate we hire. Across Octopus, we're looking for genuinely decent people who are honest and empathetic. Our people are our strongest asset and the unique skills and perspectives people bring to the team are the driving force of our success. As an equal opportunity employer, we do not discriminate on the basis of any protected attribute. Our commitment is to provide equal opportunities, an inclusive work environment, and fairness for everyone.
This job is no longer accepting applications
See open jobs at Evolve Energy.See open jobs similar to "Platform Engineer - Data 🇦🇺" URBAN-X.