As we undertake a fast paced data transformation into Databricks at E.ON Next using best practice data governance and architectural principles, we are growing our data engineering capability within the Data Team.
At E.ON Next we're looking for the most ambitious, talented, and creative people out there to join our brand new, fresh, start-up business. E.ON Next is one of the biggest energy providers in the UK and plays a crucial role in shaping the UK energy market. This isn't the old energy as you know it - we're all-in on 100% renewable energy and sustainability and focussing what we do around our customers. This is new, exciting, and waiting for stars like you to shape it. Do you love delivering for customers? Are you full of energy, ideas, and passion?
A taste of what you'll be doing:
You will build and maintain scalable and efficient data pipelines within Databricks in accordance with best practice. You will evolve and improve these pipelines as requirements change and as new technologies become available.
You will build towards and maintain an enterprise data model within Databricks.
You will integrate new sources into the data platform through the use of batch and streaming processes, all the while adhering to committed SLAs.
You will create and maintain documentation of data pipelines and associated systems, and adhere to the security and monitoring processes around data.
You will ensure data quality and reliability processes are effective and adhered to, ensuring trust in the data.
Are you the person for the job?
Minimum four years hands-on experience as a Data Engineer.
Knowledge and experience of Amazon Web Services is essential.
Be comfortable with taking ownership of complex data engineering projects and develop appropriate solutions in accordance with business requirements.
Hand-on experience with working with stakeholders and managing their requirements.
Actively coach and mentor others in the team and foster a culture of innovation and peer review within the team to ensure best practice.
A strong attention to detail and a curiosity about the data you will be working with.
A strong understanding of Linux based tooling and concepts.
A strong Python background, ideally with four or more years of experience building solutions using Python. You will require working knowledge of advanced Python concepts such as, but not limited to, decorators, protocols, functools, context managers, and comprehensions.
A strong understanding of cloud based design, in particular on Amazon Web Services.
A strong understanding of SQL, database design, and data architecting.
Strong experience with Databricks and/or Spark.
Experienced with data governance, data cataloguing, data quality principles, and associated tools.
Experience of data extraction, joining, and aggregation tasks, especially on big and real-time data i.e. Spark.
Perform data cleansing operations to prepare data for analysis, including transforming data into useful formats.
Able to explain data storage concepts and logical data structures ie. data warehousing.
Able to write repeatable, production quality code as part of your data pipelines, taking advantage of templating and parameterisation where needed.
Able to make recommendations for data pipeline design based on business requirements.
Previous data migration experience is ideal.
Be open to new ways of working, and open to working with new technologies.
Be able to set your own goals and take the initiative when working.
Have a drive to troubleshoot and deconstruct problems, and build appropriate solutions.
Energy sector experience is a bonus but not essential.
What else do I need to know?
Closing date - Thursday 9th May 2024
We'll have regular team socials and lively team chats
Competitive salary
Location - London, Leicester or Nottingham with travel to our other sites when required.
Working environment: Flexible hybrid working - a blend of in the office and home working.
26 days holiday plus bank holidays each year - this includes a guaranteed day off for your birthday if you want it.
A generous pension scheme.
The chance to choose from our award-winning Flexible Benefits package which includes the option to buy up to 10 days holiday a year.
We've exciting opportunities for everyone to develop their talent at E.ON. Our open access, inclusive talent networks provide networking, learning and development for all, building your skills, qualifications, and capabilities throughout your career.
For all successful candidates. Due to the nature of this role your employment will be subject to a basic DBS (Disclosure Barring Service) check being carried out by ourselves via a 3rd party service provider
We're committed to equal opportunities and actively promote a diverse and inclusive working environment, and fairness for everyone.
We realise the best people bring their energy at different times, so we're happy to talk flexible working. We offer a range of flexible working options, including full time, part time, job share, remote working and variable start and finishing times.