Description:
Daily tasks include designing and implementing Synapse or other automated data flows in Azure using Python which are deployed via Azure DevOps CI/CD pipelines. This role will also be expected to contribute to implementing services in C# accessed via APIs which related to data ingestion and orchestration. The role requires that the individual be a consensus builder that works to align systems engineering strategy and design with architectural guidelines, application strategy and business goals.
Required Qualifications:
- Experience in building data pipelines with Azure synapse or Azure Data Factory using Python
- Experience with various Azure service services including Azure Data Lake, Azure blob storage, Azure Functions
- Working knowledge of software development principles and best practices
- Experience coordinating with multiple project teams
- Experience with CI tools (i.e. Azure DevOps/VSTS, GIT)
- Experience in developing solutions in at least one or more modern languages (Python, C#, Java, Go, C++, or similar)
- Working knowledge of software development principles
- Experience with SQL or No SQL databases and associated blob formats such as parquet and JSON
Preferred Qualifications:
- Experience with data ingestion and ETL pipelines.
- Experience in the Oil and Gas industry and the OSDU data platform
Education:
- Required: BS in Computer Science, Software Engineering, Mathematics or Similar disciplines or 10 years equivalent work experience as software engineer
- Responsibilities
- Develop Azure synapse pipelines to deliver data products to the platform.
- Must be able to handle multiple tasks and able to pivot during sprints.
- Actively participate in high-level team activities such as suggesting architecture improvements, recommending process improvements.