Title: Lead Data Engineer
Location: London, UK
Division: Managed Services
Reports to: Head of Technical Operations
- Are you ready to drive digital transformation and innovation within a dynamic organisation focused on delivering exceptional public services?
- Do you have a passion for helping clients harness the power of technology to solve complex challenges and improve experiences?
- Do you want to have the opportunity to help drive and support our data and insights clients, providing first class delivery and support across the data platform landscape.
If so, we would love to hear from you!
ABOUT US
Agilisys is at the forefront of digital transformation and innovation in the public services sector. With over two decades of experience, we have established ourselves as a trusted partner for governments, local authorities, and organisations nationwide. Our mission is to empower our clients to deliver exceptional public services by harnessing the full potential of technology and data.
OUR VALUES
Partnership: we become one team and family with organisations, helping them to navigate change and stay agile.
Integrity: our people really care, going beyond the brief to make change happen for organisations and citizens.
Innovation: we bring together the right technologies and services to design solutions that work.
Passion: we are passionate about - and dedicated to - public services and improving people’s lives.
THE ROLE
Key responsibilities
- Lead the development, delivery, support, expansion, and optimisation of data platform and engineering services.
- Collaborate with data architects to design, build, optimise, and manage robust data platforms within Azure/AWS ecosystems, ensuring alignment with client and internal architecture needs.
- Drive data development and management initiatives, playing a pivotal role in the design, deployment, and ongoing support of data services for clients.
Specific duties
As the lead data engineer, you will play a key role in managing incidents, implementing changes, and overseeing the environment for complex data platforms within a multi-client managed services framework, guaranteeing operational reliability, smooth transitions, and peak efficiency through careful coordination and execution of maintenance tasks. Your responsibilities also include:
- Proactively respond to and swiftly resolve escalated technical issues, ensuring minimal downtime and maintaining high availability of data services by implementing effective troubleshooting methodologies and coordinating with cross-functional teams for comprehensive solutions.
- Oversee the ticketing system to ensure timely and effective resolution of data platform and engineering service issues, taking ownership of critical incidents and driving them to resolution.
- Monitor and ensure compliance with Service Level Agreements (SLAs) for all data services provided to clients, implementing strategies to consistently meet or exceed these performance metrics.
- Lead and manage a team of junior data engineers, including task delegation, mentorship, and professional development, to build a highly skilled and efficient team capable of tackling diverse data challenges.
- Develop and implement robust processes for incident management and resolution, ensuring that all solutions are documented and communicated effectively within the team and to relevant stakeholders, promoting a culture of continuous improvement and learning.
- Manage and integrate large, complex data sets to meet both functional and non-functional business requirements.
- Spearhead internal process improvements by automating manual tasks, optimising data delivery, and redesigning infrastructure for enhanced scalability using cloud-native and hybrid services.
- Build and maintain infrastructure for efficient data extraction, transformation, and loading (ETL) from diverse sources utilising SQL, Azure Data Factory, Synapse Pipelines, AWS Glue, and other big data technologies.
- Experience in Event-Driven Architecture (Pub/sub, Event streaming). at least one MPP datastore (Snowflake/Synapse/Redshift), Spark/Databricks based implementation of Medallion Architecture and NoSQL solutions (COSMOS/Cassandra/Mongo DB etc.) is desirable.
- Develop analytics tools that leverage the data pipeline for insights into financial management, operational efficiency, and key business performance indicators.
- Serve as a liaison with internal and external stakeholders (Executive, Product, Data, Design teams) to address data-related technical issues and fulfill data infrastructure needs.
- Ensure data privacy and security across multiple cloud regions, adhering to compliance and governance standards for data at rest and in transit.
- Establish expertise in client data activities, including compliance with statutory requirements, handling subject access requests, and leveraging standard reporting tools.
- Implement and oversee data quality frameworks, including rules for data improvement, cleansing activities, and quantitative research for service evaluation.
- Produce detailed reports and briefings on data content, structure, and quality.
- Design and develop tools to support the analytics and data science teams, enhancing the functionality of the data platform.
- Collaborate with data and analytics experts to enhance data platform functionality and foster a culture of innovation.
Opportunity
This role offers the chance to deliver transformative IT services in the Public Sector, leveraging cutting-edge technologies and promoting automation and efficiency in managing data platforms.
ABOUT YOU
This role offers the chance to deliver transformative IT services in the Public Sector, leveraging cutting-edge technologies and promoting automation and efficiency in managing data platforms.
The Ideal Candidate
- Demonstrated leadership in managing and mentoring technical teams, with a focus on fostering diversity and collaboration.
- Deep expertise in data analytics, strategy, science, governance, and management, with a proven ability to delegate effectively and drive team success.
- Strong analytical and problem-solving skills, adaptable to evolving technologies and business needs.
- Commitment to continuous performance improvement, providing constructive feedback, and maintaining high stakeholder engagement.
- Experience in matrix management environments, with exceptional skills in performance management and stakeholder communication.
- A passion for innovation, with a vision for transforming public services through cutting-edge data solutions.
- Security clearance or the ability to obtain it, ensuring compliance with relevant data protection and privacy regulations.
WHAT WE OFFER YOU:
This role offers exposure to the right mix of challenges, within a culture that promotes continuous learning and development.
Benefits include:
- Enhanced Pension Scheme
- Health Insurance
- Private Medical Insurance
- Life Assurance
- Access to exclusive discounts and offers through the company’s “Perks at Work” scheme
- 25 days annual leave (with the option to buy more)
PROCESS
Simply submit your CV.
By submitting your CV, you understand that we have a legitimate interest to use your personal data for the purposes of assessing your eligibility for this role. This means that we may use your personal data to contact you to discuss your CV or arrange an interview or transfer your CV to the hiring manager(s) of the role you have applied for. You can ask us at any time to remove your CV from our database by emailing talentacquisition@agilisys.co.uk – but please note that this means we will no longer consider you for the role you have applied for.
We have a rigorous recruitment process, which we use for all our roles to ensure we attract the very best talent.
Individuals seeking employment at Agilisys must note that we see diversity as something that creates a better workplace and delivers better outcomes. As such, we are keen to maximise the diversity of our workforce and actively encourage applications from all. We encourage diversity through perspective, background, identity, and thought whilst also fostering an environment where everyone can express themselves regardless of your race, religion, sex, gender, colour, national origin, disability, or any other applicable legally protected characteristic. We are committed to continuing to nurture an inclusive environment and building a diverse workforce.