We are hiring an ETL Developer / Data Engineer to build and support the data pipelines behind our fee management platform for large global investment banks. You will ingest, transform, and process high-volume financial data from flat files, databases, and APIs, ensuring accurate and timely delivery to internal teams and clients.
Key Responsibilities
- Design, develop, and maintain ETL pipelines using Talend and Informatica.
- Build data processing workflows using Python and Spark/PySpark for large financial datasets.
- Ingest and integrate data from flat files, relational databases, and APIs.
- Develop complex SQL queries, stored procedures, and database objects to support data processing and analytics.
- Work with structured and semi-structured datasets in cloud and on-premise environments.
- Collaborate with business, operations, and technology teams to understand data requirements and ensure data quality.
- Troubleshoot and optimize ETL jobs, database performance, and data processing workflows.
- Support cloud-based data platforms and participate in modernization initiatives.
- Drive adoption of Al-enabled development practices
Requirements
- 4+ years of experience in Data Integration and Data Engineering.
- Hands-on experience with Talend or Informatica PowerCenter.
- Working knowledge of Apache Spark / PySpark for large-scale data processing.
- Proficiency in Python for data processing and automation.
- Experience handling flat files, database sources, and API integrations.
- Strong SQL skills, including complex queries, CTEs, joins, window functions, and performance tuning.
- Solid database experience with relational databases such as Oracle and PostgreSQL.
- Experience with cloud platforms such as AWS and Microsoft Azure.
- Experience with job scheduling and orchestration tools such as Airflow and Control-M.
Good to Have Skillsets:
- Experience in the Financial Services / Banking domain.
- Experience with data warehousing concepts, data modeling, and data quality frameworks.
- Experience with Git and CI/CD practices for data pipelines.
- Experience with BI tools such as Power BI and Tableau.
Equality Statement: Smartstream is an equal opportunities employer. We are committed to promoting equality of opportunity and following practices which are free from unfair and unlawful discrimination.