A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe. You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat. Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
As a Senior Python Data Engineer, you will play a pivotal role in our organization. You will be responsible for designing, developing, and implementing robust data solutions using Python. This role demands a proactive, self-reliant individual with a passion for their work.
Key responsibilities include:
- Designing and building solutions to transfer data from various operational and external environments
- Creating and implementing Extract, Transform, and Load (ETL) processes, ensuring the seamless flow of data
- Writing high-quality, object-oriented code in Python, applying software design patterns in practice.
- Utilizing NumPy and Pandas for data manipulation and analysis.
- Applying software engineering best practices for Python( (linters, virtual environments, unit testing, static typing, etc.)
- Managing version control with git & GitHub (CLI).
- Collaborating with cross-functional teams to integrate data pipelines into our existing systems.
- Staying updated with the latest advancements in data engineering and data science fields.
- Writing efficient, reusable, and testable code in Python
- Collaborating with cross-functional teams, including front-end developers, to design and implement software features, especially REST APIs, event-driven architectures and lambdas.
- Participating in code reviews and providing constructive feedback · Documenting code and technical specifications
- Strong Python programming (BE)
- SQL in Pandas / Polars
- Knowledge of Python API frameworks (preferably FastAPI)
- Experience with database systems (SQL)
- Familiarity with version control systems (e.g., Git)
- Understanding of software development methodologies (Agile and Scrum)
- Familiarity with parallel computing concepts to efficiently scale Machine Learning (ML) model executions.
- Excellent English language is a must
- Implement improvements to enhance the performance of existing systems running on AWS
- Optimize the parallelization of ML models during runtime for efficient resource utilization and faster execution
- Design, deploy, and manage scalable solutions on AWS, leveraging services like EC2, S3, and Lambda where appropriate
- (Optional) Collaborate with data science teams to integrate OpenSearch for advanced data querying and analysis
- Ensure all solutions adhere to best practices, security standards, and compliance requirements