Senior Data Engineer

Senior Data Engineer

Falcon Smart IT (FalconSmartIT) | Greater London, ENG, GB

Posted 19 days ago

Apply Now

Description

Job Location: London, UK/Hybrid - 2 days Onsite and 3 Days Remote


Job Type: FTC - 1 Year


Mandatory Skillsets: AWS + Snowflake + Python


Key Responsibilities



  • Architect and Develop: Contribute to the platform’s architectural design and build integration, modelling, data persistence, and analytical systems.

  • Data Pipelines: Implement, maintain, and test robust data pipelines.

  • Metadata Management: Develop and manage metadata processes and tools.

  • Performance Monitoring: Ensure the stability and performance of data pipelines.

  • Data Quality: Implement tools for data curation, metadata management, and quality assurance.

  • Collaboration: Engage with business and technology teams to align the platform with organizational goals.


Preferred Technical Skills



  • Programming: 12+ years of experience in Python.

  • Cloud Expertise: Strong understanding of AWS services (e.g., Lambda, Step Functions, ECS).

  • Data Platforms: Hands-on experience with Snowflake and data stack technologies like Apache Iceberg and Spark.

  • Workflow Orchestration: Exposure to tools like Apache Airflow, Prefect, Dagster, or DBT.

  • Data Services: Familiarity with AWS Glue, Lake Formation, EMR, EventBridge, Athena, and similar services.

  • Metadata Tools: Experience with tools like Amundsen, Atlas, DataHub, OpenDataDiscovery, or Marquez.

  • RDBMS: Knowledge of PostgreSQL is a plus.

  • Industry Experience: Proven experience building enterprise-wide data and analytics systems, preferably in financial services or asset management.


#J-18808-Ljbffr