£90000.00 - £150000 per annum
about 1 month ago
Data Engineer: London based or Remote
Data Engineer: heavy data, Data, London based or Remote
As a data engineer/developer at you will be embedded into a cross IT, Research and Product Development team, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.
The ideal candidate an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company's data architecture to support our next generation of products and data initiatives
* Assemble large, complex data sets that meet functional / non-functional business requirements.
* Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies.
* Create data tools for analysts and other Data Team members that assist them in building and optimizing our product into an innovative industry leader.
Data competencies * BA/BS degree in in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. Graduate Degree a plus. * 3-5+ years of experience in a Data Engineer role with direct experience with data ingestion, ETLs, event-driven architecture and using implementing forecasting or imputation algorithms using large datasets
* Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
* Experience building and optimizing 'big data' data pipelines, architectures and data sets.
* Build processes supporting data transformation, data structures, metadata, dependency and workload management.
Please forward me your application if this role is suitable to you.