Azure Data Engineer

Azure Data Engineer

Neogotiable Day Rate - Outside IR35

Remote - with some travel to sites 

12 Month Duration

Role Overview:
Supporting Project AIilluminate, the data engineer will leverage large language models (LLMs) to enhance service efficiency, ensure compliance, optimize processes, analyze customer sentiment, and extract insights from large text datasets.
Key Competencies:
- Strong data design, modeling, and metadata expertise.
- Ability to translate business problems into data solutions.
- Identifies opportunities for change and data-driven decision-making.
- Excellent communication skills to convey complex ideas clearly.
- Quick adaptability to new technologies and concepts.
Responsibilities:
- Consolidate disparate data hubs into a centralized enterprise data platform.
- Design and build scalable Azure-based big data solutions.
- Develop data ingestion, transformation, and visualization pipelines.
- Lead cloud adoption and automation initiatives on Azure.
- Implement automated data workflows for reporting and analysis.
- Collaborate with business teams, data scientists, and analysts to deliver solutions.
- Develop high-availability, scalable data pipelines for batch and streaming data.
- Secure data access, ensuring users can only retrieve necessary information.
Requirements:
- Degree in Computer Science, Information Systems, or equivalent experience.
- Extensive hands-on experience in IT/data management with a focus on Azure cloud.
- Expertise in Azure Data Factory (ADF), Databricks (Medallion Architecture), Delta Lake, and Azure SQL.
- Knowledge of data science, MDM, BI, and data warehousing.
- Experience designing CI/CD-driven data architectures on Azure.
- Understanding of open data concepts and API-based data accessibility.
- Strong grasp of data modeling, databases, and real-time data processing.
- Experience building cloud data pipelines and handling structured & unstructured data.
- Skilled in agile methodologies for solution delivery.
- Utilities/Electricity Distribution industry experience is a plus.
- Ability to work collaboratively with infrastructure and support teams.