Data Engineer in London - eFinancialCareers

A leading global trading firm is seeking an experienced Core Data Engineer to own the end-to-end lifecycle of its most critical data products, including security master data, reconciled ETF compositions, high-resolution historical market data, and trade/order/quote/inquiry records. High-quality data is at the heart of the firm’s strategic growth, enabling quantitative trading strategies and supporting stakeholders across the organization.

Key Responsibilities:

• Take ownership of core data products, ensuring they are delivered accurately, reliably, and on time.
• Build and maintain automated data pipelines, implement quality checks, and streamline manual processes.
• Develop and refine a common data model, including identifiers, normalized schemas, and master data standards.
• Investigate and onboard additional data sources to maximize value and insight.
• Collaborate closely with cross-functional teams to optimize workflows, guide architecture/design decisions, and ensure appropriate data access and governance.
• Manage multiple projects in parallel while balancing operational priorities and stakeholder needs.

Required Skills & Experience:

• Strong programming skills (Python preferred) and experience with Linux, SQL, and relational/non-relational databases.
• Experience working with large datasets and familiarity with big data solutions.
• Hands-on experience with Airflow, Kafka, and cloud platforms such as GCP (GKE, Dataproc, BigQuery) is highly desirable.
• Knowledge of Pandas, Spark, Apache Beam, or Apache NiFi is a plus.
• Highly organized with strong attention to detail and a drive to automate and optimize processes.
• Excellent communication skills and the ability to collaborate with both technical and non-technical stakeholders.
• Familiarity with financial domain data such as symbology, security reference/pricing data, ETF compositions, and exchange market data is advantageous.

This is a rare opportunity to work with a globally recognized trading firm and contribute directly to its core data infrastructure, impacting key business decisions and strategic growth.