Roles & Responsibilities
Data Engineer
POSITION OVERVIEW : Industry Consulting Consultant
POSITION GENERAL DUTIES AND TASKS :
Position Summary : Person will be working on :
On-prem : As a Developer to work on new requirement and Change requests in BRAIN COSY project which involves changes to be done either Database Oracle source scripts, PowerCenter Informatica as ETL tool and SQL server as On-prem Database. Healix Migration : to be involved in end-to-end migration activity to migrate the ETL code from PC Informatica to IDMC and SQL Server to AWS RDS SQL Server. Involves the SFTP process to transfer the files and also PGP encryption for the files. Identify business needs :
- Collaborate with stakeholders to understand business needs and information management requirements across all systems, platforms and applications
- Identify users’ information seeking behaviour
- Determine inter-system interface design based on requirements.
- Recommend types of data needed to measure and predict outcomes
- Oversee the development of design and specification proposals
- Guide feasibility and functional studies
- Influence integration of data from across the enterprise
- Set guidelines for appropriate structuring and enrichment of data
Design information architecture
Identify the desired state of a coordinated information flow through the organisationAssess existing systems to evaluate their usability, usefulness, and efficiencyGuide alignment of information management standards with the enterprise architectural plan and information security standardsDesign data architecture across varying operating systems (e.g. Windows, Linux) and sites (onsite, cloud, hybrid)Understand the existing data and relationship in order to identify the gaps between current availabilities and user requirementsDevelop strategies for seamless and low-risk migration of data between systemsDesign the optimum data storage schema to allow usage for analysis by power users / data scientistsCommunicate the design and recommendations to stakeholders.Develop information systems
Perform organisation of data content and data mappingDevelop prototypes, data schemas, and architecture documents to model the physical layout of the information environmentSupport the implementation of information designs into systemsMonitor user-interaction with the implemented information designsValidate effectiveness of information delivery through usability testingPerform operational ad-hoc data provision to extract / load data based on stakeholders requirements using ETL tools such as Informatica.Optimize database queries and / or otherwise optimize system performance based on monitored system performance and user feedbacks (both end users and power users)Analyse Data
Manage problem definition and hypothesis formulation processAdvise development of data analysis models based on project requirementsOversee data sourcing, acquisition, cleansing, integration, warehousing, exploration and deliveryCoordinate data quality reviews Report InsightsSet the guidelines for the development of end user reportsAdvise the design of complex reporting and analytical solutionsDevelop roadmaps for optimising the BI analysis insightsGuide implementation
Provide guidance on the implementation of information architectureProvide direction on linkages between different systems to ensure the information flow is aligned with the architecture.Maintain clear and accurate documentation of data storeRecommend innovative solutions to increase efficiencies around the integration of complex systemsRequirements / Qualifications :
Informatica PowerCenter - 8 to 10 years
Database RDMS Oracle - 7 to 8 years
Database RDMS Sql Server - ? 5years
OBIEE Reporting tool – Preferred
Tableau – Preferred
AWS IDMC, S3, EC2 – Preferred
AWS RDS – Preferred
Databricks - Preferred
Tell employers what skills you have
Tableau
OBIEE
RDS
Oracle
Data Analysis
AWS
Informatica
ETL
Data Quality
Databricks
Data Design
EC2
SQL
SQL Server
Data Architecture
S3
Linux