We are looking for a Senior Data Engineer with experience in designing, building, and maintaining scalable data management solutions, with a specific focus on Master Data Management (MDM). The ideal candidate will lead the design, development, and implementation of robust MDM architectures and processes.
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
- Design, develop, and maintain Master Data Management solutions, including data governance, data quality, and data integration.
- Collaborate with business stakeholders and data architects to understand data requirements and translate them into technical MDM solutions.
- Develop and manage data storage solutions, including data warehouses and data lakes, using technologies such as Hadoop, Spark, or cloud-based platforms (e.g., AWS, Azure, GCP).
- Design and implement data governance policies, data quality checks, and metadata management practices.
- Ensure data security, privacy, and compliance with relevant regulations and standards.
- Monitor and optimize data processing performance and scalability.
- Stay current with emerging trends and best practices in big data technologies, data engineering, and MDM.
- Mentor junior data engineers and provide technical guidance on MDM projects.
- Bachelor's degree in Computer Science, Information Systems, or a related field.
- Minimum of 7 years of professional experience in data engineering, with a focus on Master Data Management.
- In-depth knowledge of data modeling, database design, and SQL.
- Proficiency in big data technologies (e.g., Hadoop, Spark, Kafka, Flink).
- Experience with cloud platforms (AWS, Azure, GCP) and related data services.
- Expertise in MDM solutions, tools, and best practices (e.g., Informatica MDM, IBM InfoSphere MDM, SAP Master Data Governance).
- Strong scripting skills in languages such as Python, Scala, or Shell.
- Experience with data orchestration tools (e.g., Apache Airflow, Luigi, Prefect).
- Excellent analytical and problem-solving abilities.
- Strong communication skills with the ability to collaborate effectively with diverse teams.
- Professional certifications (e.g., AWS Certified Big Data - Specialty, Google Professional Data Engineer, Informatica MDM Certification) are a plus.