A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe. You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio
We are seeking a Senior AI Engineer with a strong track record of developing and deploying AI solutions, particularly in the domain of large language models (LLMs), agents, and retrieval-augmented generation (RAG) pipelines. This role will involve close collaboration with clients to architect, build, and deliver real-world solutions using platforms such as Snowflake, AWS, and Google Cloud.
The ideal candidate combines technical depth with a pragmatic, delivery-oriented mindset and has excellent communication skills to lead client engagements and cross-functional teams.
Responsibilities:
- Solution Architecture: Lead the design and development of LLM-based solutions including RAG pipelines, agent workflows, and generative AI applications.
- Multi-Platform Implementation: Develop and deploy AI solutions across Snowflake, AWS, Google Cloud, Databricks, and other enterprise environments.
- Client-Facing Delivery: Work directly with clients to understand business needs, propose architectures, and implement solutions that deliver measurable value.
- Model Development & Optimization: Fine-tune models, build embedding workflows, implement vector search, and monitor performance in production environments.
- Workflow Automation & Integration: Architect AI systems that integrate with cloud-based data pipelines and enterprise tools, ensuring reliability and scalability.
- Mentorship & Collaboration: Provide technical leadership, mentor junior engineers, and contribute to the growth of Hakkoda’s AI practice.
- Innovation & Research: Stay informed on emerging AI technologies and bring innovative capabilities into production use.
- As of April 2025, Hakkoda has been acquired by IBM and will be integrated in the IBM organization. Your recruitment process will be managed by IBM. IBM will be the hiring entity
- Minimum of 5-7 years of experience in AI engineering, machine learning, or related fields.
- Demonstrated experience working in a professional services or consulting environment with client-facing responsibilities.
- Proven experience developing and deploying LLM-powered applications into production
- Strong background in RAG architecture, vector search, and embedding pipelines
- Familiarity with agent frameworks such as LangChain, LlamaIndex, or CrewAI
- Expertise in Python, with sound software engineering practices
- Experience working with Snowflake, including Cortex and UDFs for AI integration
- Hands-on experience deploying AI solutions on multiple cloud platforms (especially AWS and GCP)
- Strong client-facing skills, with the ability to lead technical discussions and present to stakeholders
- Demonstrated ability to scope, build, and deliver full AI solutions—not just prototypes
- Bachelor’s degree in Computer Science, Data Science, AI, or a related field
- Experience with LLMOps tools (PromptLayer, LangSmith, Weights & Biases, etc.)
- Understanding of AI cost optimization and production reliability concerns
- Prior experience with consulting or professional services engagements
- Experience building AI solutions with synthetic or simulated data
- Contributions to open-source AI projects or active involvement in AI communities