Job Description

The Opportunity:

Consulting as a Senior Data Engineer on a major central government project to provide the required services to develop robust data pipelines, analytics and visualisation tools that will support the integration of multiple infrastructure datasets across various sectors.

These services will contribute to the creation of solutions that align with the principles of digital twins, which are virtual models connected to their real-world counterparts by a two-way flow of real-time data where the primary challenge is to consolidate these sources into one cohesive framework.

N.B. Candidates will have or be willing to undergo a basic level of security clearance prior to starting the role.

Skills and Experience:

* ETL Expertise: proven experience designing and implementing data pipelines using open-source ETL tools including Airbyte and DBT (data build tool) to integrate with externally hosted REST APIs.

* Programming Proficiency: strong proficiency in Python for data manipulation and integration tasks.

* Semantic Technologies: solid understanding and hands-on experience with SparQL and RDF.

* Data Storage Solutions: expertise in data storage and caching technologies to optimise pipeline performance.

* Database Skills: extensive experience with relational databases, especially PostgreSQL.

* Problem-Solving: ability to troubleshoot and resolve complex data-related issues efficiently.

* Communication: excellent verbal and written communication skills for effective stakeholder engagement.

* Stakeholder Engagement: experience working closely with stakeholders to gather and refine data requirements.

* Containerisation: familiarity with Kubernetes for deploying and managing data pipelines in a containerised environment.

* Cloud-hosting: experience with cloud hosting technologies (AWS preferred)

Please call Edward here at ISR to learn more about our client leading the way in developing the next-generation of digital-twin solutions through innovation and transformational technology?