Sword propels organisations on their data driven journey; where decisions are based on facts, metrics are used to motivate, data is openly shared, and trust and transparency are prioritised above all else.
Having the right people is essential for us to deliver the exceptional levels of service that our clients deserve. Our skilled team are experts in their field with market-leading experience and accreditation levels.
Sword partner with private and public sector organisations across Finance, Manufacturing, Media, Energy and Government who count on the Sword team to deliver innovative Information Technology and Information Management solutions and services.
Location: UK Flexible remote working- should be able to get to offices in UK occasionally, Scotland.
We are looking for a skilled and passionate Data Engineer , you will play a critical role in designing, building, and maintaining data infrastructure. You will be responsible for creating and optimizing data pipelines, developing database models, and implementing data warehousing solutions.
The ideal candidate will be proficient in Python, Apache Spark, SQL, Databricks, and Azure Data Factory, with strong knowledge of data warehousing design and database modelling.
Requirements
- Design, develop, and maintain scalable and reliable data pipelines to ingest, process, and store large volumes of structured and unstructured data.
- Collaborate with data scientists, analysts, and other stakeholders to define data requirements and ensure data quality, integrity, and security.
- Develop and optimize data models for efficient storage and retrieval of data in various database systems, including relational and NoSQL databases.
- Utilize expertise in Python, Apache Spark, SQL, Databricks, and Azure Data Factory to implement data processing and transformation tasks.
- Implement and maintain data warehousing solutions, including designing and developing star schema, snowflake schema, and other data warehousing concepts.
- Monitor and troubleshoot data pipeline performance, ensuring optimal efficiency and minimal downtime.
- Collaborate with cross-functional teams to promote best practices in data engineering and contribute to the ongoing improvement of our data infrastructure.
- Continuously stay up-to-date with industry trends, emerging technologies, and best practices in data engineering.
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 3+ years of experience in data engineering, database development, or a similar role.
- Strong proficiency in Python, Apache Spark, SQL, Databricks, and Azure Data Factory.
- Solid understanding of data warehousing design principles and database modelling techniques.
- Experience with various database systems, including relational and NoSQL databases.
- Strong analytical and problem-solving skills, with a keen attention to detail.
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
- Self-motivated, with the ability to work independently and manage multiple projects simultaneously.
Benefits
In terms of location, it is anticipated that this role will involve a blend of remote, office and client site working with a bias toward supporting remote working.
All members of the Sword team are supported and encouraged to develop their career with Sword through our personal training and development plan alongside a competitive salary, pension, and healthcare package.
If you would like to