Senior Data Engineer

💻 Ework Group - founded in 2000, listed on Nasdaq Stockholm, with around 13,000 independent professionals on assignment - we are the total talent solutions provider who partners with clients, in both the private and public sector, and professionals to create sustainable talent supply chains. With a focus on IT/OT, R&D, Engineering and Business Development, we deliver sustainable value through a holistic and independent approach to total talent management. By providing comprehensive talent solutions, combined with vast industry experience and excellence in execution, we form successful collaborations. We bridge clients and partners & professionals throughout the talent supply chain, for the benefit of individuals, organizations and society. 🔹 For our Client we are looking for Senior Data Engineer 🔹 Location : Wrocław Expected office presence : hybrid (2–3 days on-site) for the foreseeable future, on-site 5 days once confirmed this is possible We are looking for a highly skilled Senior Data Engineer to join our innovative data team. The ideal candidate will have extensive experience in data extraction, transformation, and loading (ETL) processes, as well as a strong background in cloud data tools. You will be responsible for building and optimizing data pipelines, ensuring data quality, and collaborating with cross-functional teams to deliver actionable insights. ✔️Key Responsibilities: Data Management : Extract, combine, transform, load, manipulate, and cleanse data from various sources to ensure high-quality datasets for analysis. This also includes data migration from legacy systems into next generation systems Collaboration: Work closely with data modelers and business analysts to understand the data model and source-to-staging data mapping. Data Structures: Create and integrate data structures suitable for analysis, including developing DDLs to create various MS Cloud SQL Server tables and views in Pond (a subset of the Data Lake) DB. Databricks Development: Design and develop Databricks notebooks for extracting data from various input files, joining related entities to create Shared File Formats (SFFs). Ingestion Framework: Configure the Ingestion Framework (IF) tables to utilize the existing framework for loading staging and Data Lake Core (DLC) tables. Algorithm Development: Develop and deploy algorithms in performance-efficient code across analytical and data platforms. Data Pipelines: Build large-scale batch and real-time data pipelines using data processing frameworks in cloud platforms or on-premises environments. Continuous Integration : Leverage best practices in continuous integration and delivery to enhance data workflows. Data Governance: Track data consumption patterns, collaborating with data governance and information stewards, and participate in vetting and promoting content for the curated data catalog. Automation : Recommend and implement automation in existing and future integration flows to improve efficiency. Data Quality Improvement: Drive advancements in data acquisition, testing, and tooling to enhance data quality. Agile Collaboration: Work in cross-functional agile teams to continuously experiment, iterate, and deliver on new product objectives. Requirement Analysis: Play a key role in requirement analysis and project estimates to ensure alignment with business goals. Performance Monitoring: Monitor performance and optimize SQL queries for maximum efficiency. Documentation: Prepare detailed design documents with prototypes and screenshots based on Business Requirement Documents (BRD) and System Requirement Documents. Cloud Tools Utilization: Work with various cloud data tools such as Azure SQL, Azure Data Factory, and Azure Databricks to ingest and prepare data for analysis as per business requirements. ✔️Qualifications: • Education: Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred. • Experience: 5+ years of experience in data engineering or a related field, with a strong focus on ETL processes and cloud data tools. • Certifications required: Certified Azure Data Engineer, Databricks Certified Data Engineer. Technical Skills: Proficiency in programming languages such as Python, Java, or Scala. Experience with MS Cloud SQL Server, Azure Data Factory, and Azure Databricks, PySpark, Spark SQL, ADLS, SQL, PowerBI, SSIS, SSRS, Agile and Scrum Strong knowledge of SQL and experience with relational databases. Familiarity with big data technologies and data processing frameworks. Soft Skills: Excellent problem-solving skills, strong communication abilities, and a collaborative mindset. ✔️ We offer: B2B agreement Transparent working conditions with both Ework and the client Current support during our cooperation Possibility to work in an international environment Collaborative environment in Swedish organizational culture Private medical care Life insurance Multisport Teambuilding events Contact person: karolina.rosikiewicz@eworkgroup.com Client code: MM03 Do you know someone who would fit this position? Recommend a candidate by sending her/his CV to: polecenia@eworkgroup.com Whistleblowing Policy, which provides guidelines for reporting misconduct can be found on Ework website: https://www.eworkgroup.com/about-us/our-responsibility