Data Engineer Python - Data Platforms
IBM
**Introduction**
**Your role and responsibilities**
The successful candidate will be responsible for designing, developing, and maintaining scalable data processing systems, collaborating with cross-functional teams, and ensuring high-quality data. Key responsibilities include:
* Designing and developing data processing systems, including ETL processes and databases
* Collaborating with data scientists, software engineers, and business stakeholders
* Ensuring data quality and integrity through testing, validation, and documentation
* Implementing data security measures and adhering to relevant policies and regulations
* Monitoring system performance and conducting optimizations
**Required technical and professional expertise**
* Strong scripting skills in languages such as Python
* Proven experience as a Data Engineer, preferably in a consulting or banking environment
* Proficiency in data management tools and technologies such as SQL, NoSQL databases (e.g., MongoDB, Cassandra) and Big Data frameworks (e.g., Hadoop, Spark)
* Design, develop, and maintain scalable data processing systems, including ETL processes, data pipelines, and databases to support AI models.
* Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to understand data needs and translate them into technical solutions.
**Preferred technical and professional experience**
* Experience with cloud platforms (AWS, Azure, Google Cloud)
* Familiarity with AI/ML workflows and tools is preferred
* Experience with ETL tools (e.g., Apache NiFi, Talend)
* Knowledge of data security measures and regulations, particularly in the banking sector
* Experience with continuous monitoring and optimization of system performance
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
Por favor confirme su dirección de correo electrónico: Send Email
Todos los trabajos de IBM