In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
Key responsibilities include:
- Designing and developing data processing systems, including ETL processes and databases
- Collaborating with data scientists, software engineers, and business stakeholders
- Ensuring data quality and integrity through testing, validation, and documentation
- Implementing data security measures and adhering to relevant policies and regulations
- Monitoring system performance and conducting optimizations
- Strong scripting skills in languages such as Python
- Proven experience as a Data Engineer, preferably in a consulting or banking environment
- Proficiency in data management tools and technologies such as SQL, NoSQL databases (e.g., MongoDB, Cassandra) and Big Data frameworks (e.g., Hadoop, Spark)
- Design, develop, and maintain scalable data processing systems, including ETL processes, data pipelines, and databases to support AI models.
- Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to understand data needs and translate them into technical solutions.
- Experience with cloud platforms (AWS, Azure, Google Cloud)
- Familiarity with AI/ML workflows and tools is preferred
- Experience with ETL tools (e.g., Apache NiFi, Talend)
- Knowledge of data security measures and regulations, particularly in the banking sector
- Experience with continuous monitoring and optimization of system performance