Lead Data Engineer
GCP Data Engineer - Upto £600 per day - 6 months - Outside IR35 - 3 days on-site - North London
I am currently seeking 2x GCP Data Engineers to support a long term client and accelerate an internal project through ingestion of data from various web sources. The ideal candidate will have experience working withing a GCP environment and delivering robust ETL and ELT solutions.
Skills Required:
* Python
* GCP
* Docker / Containers
* Microservices
* Big Query
* Cloud experience (e.g. Google Cloud and Cloud Run preferred) including core web application infrastructure
* DBT
Responsibilities:
* Knowledge of agile practices and able to perform in agile software development environments
* Responsible for ingestion of data from various sources and ensuring data is well organised across the data lakes
* Demonstrated experience of Python backend development (e.g. using FastAPI)
* Experience with Docker or containerized applications, especially architecture of multi-container applications
* Scale up of web application using cloud infrastructure
* Responsible for high quality software implementations according to best practices, including automated test suites and documentation
* Develop, measure, and monitor key metrics for all tools and services and consistently seek to iterate on and improve them
* Liaise with other technical staff and CTO, to build an end-to-end pipeline consuming other data products
If this role sounds ideal then please reach out to Matt Watson @ Xcede.