Description
Job Summary
pWe are seeking a Data Engineer to join our A&I Digital Excellence team. The role involves designing and building reliable data platforms that support continuous auditing, predictive risk sensing, digital forensics, and analytics delivery.
Responsibilities
- Develop scalable ETL/ELT workflows using Azure Data Factory, Synapse/Spark, Databricks, SQL, and Python.
- Create well-structured, audit-ready datasets and curated layers for reuse across engagements.
- Implement data quality controls, validation rules, lineage tracking, and transformation logic.
- Uphold privacy, access control, evidence integrity.
Required Skills
- Data Integration and ETL
- Data Processing Frameworks
- Programming (Python, SQL)
- Data Modeling
- Data Quality Management
Required Skills Explained
- Data Integration and ETL practices: Combining data from different sources into a single, unified view and transforming it into a suitable format for loading into a destination system.
- Data Analysis: Inspecting, cleansing, transforming, and modeling data to discover useful information and support decision-making.
- Data Processing Frameworks: Using tools like Apache Hadoop and Apache Spark to process large data sets efficiently.
- Programming: Proficiency in languages such as Python, R, and SQL for manipulating, analyzing, and visualizing data.
- Data Modelling: Creating a model for storing data in a database, representing the data structures and their relationships.
- Data Quality Management: Ensuring that data is accurate, complete, reliable, and relevant for its intended use.
Who is this for
pThis role is ideal for someone who enjoys working on large-scale data projects and has a passion for ensuring data integrity. You should have excellent communication skills to work effectively with various teams.
Why This Job is a Good Opportunity
ulliOpportunity to work on advanced projects involving continuous auditing, predictive risk sensing, and digital forensics.liA chance to contribute to the shift towards data-driven assurance in an organization.liPotential for collaboration with various teams such as Data Scientists, Forensic experts, and audit teams.liRole involves developing scalable workflows using modern technologies like Azure Data Factory, Synapse/Spark, Databricks, SQL, and Python.liStrong focus on data governance and compliance, ensuring the integrity of data used in critical operations.
Interview Preparation Tips
- Prepare examples of projects where you have implemented ETL workflows or data processing frameworks to solve complex problems.
- Discuss your experience with data quality controls and lineage tracking. Explain how you ensure data integrity and traceability.
- Be ready to discuss your approach to implementing CI/CD pipelines and ensuring observability in data services.
- Showcase your ability to work collaboratively by providing examples of successful stakeholder management in previous roles.
- Highlight any experience with big data technologies, data visualization, or data security measures.
Career Growth in This Role
pThe role offers significant opportunities for growth and advancement. With a focus on continuous auditing, predictive risk sensing, and digital forensics, you can develop expertise in cutting-edge technologies and methodologies. The team environment fosters collaboration and innovation, allowing you to take on more complex projects as your skills grow. Additionally, the role involves strategic stakeholder management, which can provide valuable experience in leadership and influence within the organization.pAs you progress, you may have the chance to mentor junior team members or lead initiatives that drive further improvements in data processes and governance. The ability to demonstrate advanced proficiency levels in data analysis, ETL practices, and data modeling will make you a standout candidate for future opportunities both within A&I/DEX and beyond.
Explore More Opportunities
Skills
Frequently Asked Questions
What are the key responsibilities of a Data Engineer in this role?Key responsibilities include designing ETL workflows, creating audit-ready datasets, implementing data quality controls, and ensuring privacy and access control.
What skills are most important for success in this position?Proficiency in ETL processes, Python programming, SQL, data modeling, and data quality management are crucial.
Can I apply if I don't have extensive experience with big data technologies?While prior experience with big data tools is preferred, we are open to candidates who are eager to learn and bring strong foundational skills in relevant areas.
