Engineer – Data Lake Architect, Dubai
Position Code: 751211
Area: 4th Industrial Revolution
Field: Information Technology or Computer Sceince
Description
The Data Lake Architect will be a part of the DEWA R&D Team responsible for the systems architecture, design and development of a large, scaled-out, real-time, high performing, multi-tenant Hadoop Infrastructure, allowing DEWA Industrial Solutions to leverage data effectively for internal and external data ingestion, stream processing, advanced analysis and applications. As the Data Lake Architect, you will be responsible for the following:
- Architect, design and build big data infrastructure platform, primarily based on Hadoop technologies, ensuring that the infrastructure is high availability (HA) and secure.
- Architect and build security compliant user management framework for multi-tenant big data platform.
- Work closely with Management and Data Scientist teams to define and refine the big data platform to achieve company product and business objectives.
- Collaborate with other technology teams and architects to define and develop cross-function technology stack interactions.
- Research and experiment with emerging technologies and tools related to big data.
- Contribute to the big data open-source ecosystem.
- Work with the cross functional teams to establish and reinforce disciplined software development processes and best-practices.
- Maintain and support the platform on a day-to-day basis.
- Work closely with the product management and development teams to rapidly translate the understanding of customer data and requirements to product and solutions.
- Set architectural vision and direction across a matrix of teams.
- Be proficient in SQL and ETL processes, ETL and DB performance tuning, table partitioning, shell scripting, driving prototypes and POCs.
- Set up infrastructure for Data visualization tools like Tableau, QlikView etc.
- Familiar in Different cloud technologies like AWS, Google, GCP, Azure, CenturyLink Cloud, Open stack.
The candidate should be comfortable working as member of a dynamic, research-oriented team with several ongoing concurrent projects across multiple areas but also manage individual tasks independently. Candidate should be able to think out of the box and comfortable in bridging cross-disciplinary silos to conduct innovative research.
We offer a supportive working environment and a position that will be initially filled for two years, with possible extensions connected to new research projects. The contract includes fringe benefits such as health insurance.
Basic Qualifications:
- Bachelor’s Degree from accredited university or college in Business, Information Systems, Information Technology (IT) or Computer Science
- Minimum of 10 years of experience as a technology leader designing and developing data modelling with a minimum of 3 of those years specializing in big data architecture or data analytics (should include technologies such as Hadoop, NoSQL and Map-Reduce and other Industry BigData Frameworks) and other database modelling and management tools.
Preferred Qualifications:
- Strong, in-depth experience in data modelling and experience with business intelligence systems (dimensional modelling, data mining, predictive analytics).
- Familiarity with Hadoop open-source stack including YARN, Kafka, Hive, Pig as well as relational databases.
- Broad based architecture acumen: Database architecture, ETL, SOA, Cloud, etc.
- Comfortable in multi-terabyte production environments.
- Highly proficient with large data sets and clusters.
- Demonstrated skill in critical thinking and problem-solving methods.
- Uses appropriate facilitation techniques to gain agreement or move others to action.
- Ability to work successfully in a global team environment.
To apply
To apply, send your cover letter, CV and other supporting documents (if any) to R&D Recruitment R&D.Recruitment@dewa.gov.ae. Subject Line of the email should be “ Application for Engineer – Data Lake Architect – position code 751211".
No comments:
Post a Comment