Big Data Technical Lead
Quantexa, United Kingdom
Job Description
Founded in 2016 with only a handful of individuals, Quantexa was built with a purpose that through a greater understanding of context, better decisions can be made. 7 years, and 700+ employees later we still believe that today. We connect the dots within our Customers data using dynamic entity resolution and advanced network analytics to create context, empowering businesses to see the bigger picture and drive real value from their data. Quantexa empowers organisations to drive better decisions from their data. Using the latest advancements in big data and AI, Quantexa uncovers hidden customer connections and behaviours to solve major challenges in financial crime, customer insight and data analytics.
Quantexa has accomplished rapid global expansion and achieved a valuation of $1.8 billion in April 2023 making us the first UK Unicorn business for 2023. Due to our continuous success and high demand from our customers, we are looking for a Big Data Tech Lead with a proven track record to join the Quantexa family.
Typical responsibilities include:
- Manage, transform, and cleanse high volume data.
- Write defensive, fault tolerant and efficient code for data processing.
- Automate data processing to enable on-going alerts on high-risk activity.
- Present project results to clients both face to face and virtually.
- Work very closely with data scientists to ensure efficient and effective delivery of solutions.
- Use leading open source big-data tools, such as Spark, Hadoop, Scala and Elasticsearch. You should be comfortable with working with high profile clients, on their sites.
- Work with our expert software development team to produce reusable applications.
- Use emerging and open-source technologies such as Spark, Hadoop, and Scala.
- Collaborate on scalability issues involving access to massive amounts of data and information.
- Take on ad-hoc tasks as required for the running of a small, yet rapidly expanding business.
- Leading a team and mentoring junior engineers.
Please note: This role is located for our office in Liverpool near the Liverpool Science Park building, but some work occurs on our clients’ sites. Quantexa is rapidly expanding into other territories and candidates interested in travel opportunities are encouraged.
Requirements
What do I need to have?
- Proven big data experience, either from an implementation or a data science prospective.
- Excellent technical skills including expert knowledge of at least one big data technology such as Spark, Hadoop, or Elasticsearch.
- Experience of building data processing pipelines for use in production hands off batch systems, including either (or preferably both) traditional ETL pipelines and/or analytics pipelines.
- Strong coding experience in the likes of Scala, Java, or Python.
- Good experience with testing libraries of common programming languages and can talk about how they used them for example scalatest (or equivalent packages for other languages)
- Knows the difference between different test types ( unit test vs integration test for example) can provide specific examples of one they have written themselves or oversaw when asked
- Can explain unit testing and how they have been automated can provide specific examples relevant to their own code or project when asked
- Strong client facing, communication and presentation skills.
- Strong academic qualifications, high quality degree (2:1 or above) or equivalent.
- Enthusiasm to learn and develop emerging technologies and techniques.
- Exhibit strong technical communication skills with demonstrable experience of working in rapidly changing client environments.
- Demonstrate strong analytical and problem-solving skills and the ability to debug and solve technical challenges with sometimes unfamiliar technologies.
Ideal candidates will also:
- Have worked on a variety of complex data orientated projects for financial services clients.
- Healthcare experience is beneficial but not mandatory.
- Have a good understanding of Computer Science and preferable come from a software engineering background or other scientific degree incorporating IT modules (e.g. Maths/Physics)
- Have exposure to Agile, especially SCRUM.
- Arrive with experience at working with a variety of modern development tooling (e.g. Git, Gradle, Jenkins, Nexus) as well as technologies supporting automation and DevOps (e.g. Ansible, Chef, Puppet, Docker and a little bit of good old Bash scripting).
- Have an excellent appreciation of what makes a high quality, operationally stable system and how to streamline all areas of development, release, and operations to achieve this.
Benefits