At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk
- Use of Data Architecture patterns for access and data movement in both cloud and on-premises environments.
- Experience with cloud providers such as IBM, AWS, Azure along with big data solution such as Hadoop, Spark and Databricks.
- Cloud migration methodologies and processes including tools like Azure Data Factory, Data Migration Service,
- Use of Big Data File Formats and compression techniques such as Parquet, JSON, CSV, AVRO, ORC, etc.
- Confident & versatile IT professional with the ability to communicate effectively across all levels of the Business and IT community
- Familiarity with different development methodologies (e.g. waterfall, agile, XP, scrum).
- Bachelor's of Engineering degree
- Experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, NoSQL and data warehouse solutions.
- Hands-on experience in Azure/AWS and Big Data technologies such as PowerShell, C#, Python, SQL, ADLS/Blob, Spark/Spark SQL, Databricks, Hive and streaming technologies such as Kafka, EventHub, etc.
- Data modelling for analytical solutions (dimensional modelling, business and physical modelling)
- RDBMS experience such as SQL Server, Oracle or DB2.
- Proven experience as a Senior Programmer Analyst within a Big Data environment
- Experience with integrating structured and unstructured data across various database platforms
- Hands-on experience with AWS suite of services supporting big data (Glue, Lambda, Athena, EMR and others)
- Proficient in Python, Java, JavaScript, SQL & related languages
- Experience in building ETL pipelines in SSIS, DataStage, Informatica & Talend.
Same as above