Senior Data Engineer - UK Remote
QueryClick, United Kingdom
Job Description
Excellent opportunity for an experienced Senior Data Engineer to join our awesome Engineering team!
Why are we looking?
We are building a brand new software product - Corvidae. Powered by machine learning and capable of handling massive amounts of marketing behaviour data, the Corvidae product allows its users to understand the value of their marketing activity and use this information to automatically optimise that activity.
You will work in a small team of multi discipline engineers to develop, maintain, and deliver data pipeline solutions to high standards and appropriate scale AND to develop, maintain, and deliver data storage and management solutions to acceptable standards.
We understand that our team are our greatest asset, so we invest heavily in training, benefits and incentives to ensure our team are happy and productive. Some of what we offer, remote working, flexible working, extended core hrs, currently trialling 9 day fortnight (every other Friday off), training amp; development budget, home office set up and much much more!
What will you do?
As our Senior Data Engineer in the Corvidae project you will be expected to implement, deploy, and manage the data pipeline and storage components of the Corvidae delivery process from end to end, effectively and efficiently. Understanding the data pipeline requirements which enable the reporting and modelling needs of the product and ensuring that enables high quality and robust delivery to Corvidae clients. You will be responsible for setup, deployment, and maintenance of data processing infrastructure (cloud storage, cloud compute, clustering, etc.), data cleansing, and data enrichment.
What will you need?
- Proven ability implementing and maintaining the technical components of common data solutions (Databases, Data Formats, Data Management)
- Experience with data architecting and data governance
- Experience with all the following relevant technologies
- Python,
- SQL/NoSQL
- Data Warehousing
- ETL Tools and Process development
- Machine Learning principles
- Distributed Systems (Spark/Hadoop)
- Scheduling and orchestration tools
- Relevant authoritative experience with Azure Cloud technology
- Software Development and Delivery skills (including coding standards, quality, testing, CI/CD)
- Experience and in-depth knowledge of Data Types
- Requirements Gathering/Stakeholder Management
- Experience with the Scrum Agile Framework
Nice to have:
- C#, TypeScript
- Relevant Azure Certifications (desired)
What about you?
- An organized leader and role model performer who pushes convention and drives change
- Experienced in mentoring and training junior Data Engineers
- Seen as go to person to wider business for anything related to their domain,
- Develops and maintains a solid foundation of market knowledge in their area, proactively identifies potential issues/risks- publishes blogs and disseminates knowledge to the team
- Can make sensible decisions across all areas of the core principles of their role with little delay.
More of what we offer!
- UK Remote First company with offices in Edinburgh and London (access to co-working office space across the UK for those who prefer office space to work from)
- Flexible working, extended core hrs, we trust our team to own their time to balance work and life!
- 34 days holidays (including bank holidays), options to buy and sell up to 5 days per yr to support flexibility
- Trialling 9 day fortnight - we are committed to our team's wellbeing and having time to balance both work and life so we are currently trialling a 9 day fortnight. As part of this trial our team get every second Friday back to invest in themselves on completing their work with no change to pay or benefits (and we don't expect our team to work condensed hours to take this time)
- Home Office set up and budget to support you with this, ready to start on your first day.
- Your Development, we believe in continuously investing in your talent and offer training and development budget.
- Industry leading private medical cover and mental health hub
- Enhanced Family Leave, we support our team to grow their career and to balance this with starting a family. We offer enhanced family leave policies such as enhanced maternity pay, 4 weeks paternity leave, fertility treatment leave, and enhanced shared parental leave
- Silver healthy working lives employer- we support our team’s well-being both in and out of work
- Quarterly team get together budget and socials
Who are QC?
Founded in 2008, We are a performance marketing com