Company: Petroplan
Skills: IT - Software Development
Experience: 5 + Years
Education: Masters Degree
Location: Houston, Texas, United States


Data Engineer III - Hybrid Remote

BASIC PURPOSE:
As a Data Engineer III, the successful candidate will play a pivotal role in building, managing, and optimizing data pipelines for the Enterprise Data & Analytics initiatives following industry standard practices and tools. This role will be the key interface in operationalizing data and analytics on behalf of the business unit(s) and organizational outcomes. The candidate will require both creative and collaborative skills working with IT and business, including data scientists, data analysts, and other data consumers, as well as 3rd party business partners and vendors. The candidate should have 5-7 years of experience in the responsibilities listed below.
MAJOR RESPONSIBILITIES/SKILLS:

 

  • Architect, build, and maintain data pipelines through acquisition, ingestion, staging, and modeling
  • Provide architectural input to program leadership for project teams to develop solutions that align with long-term data warehouse strategy
  • Strong experience with various Data Management architectures like Data Warehouse, Data Lake, Data Hub, Data Vault and the supporting processes like Data Integration, Governance, and Metadata Management
  • Strong experience working with large, heterogeneous datasets in building data pipelines and integrating datasets using traditional data integration technologies, including ETL/ELT, data replication/CDC, message-oriented data movement, and API-based data acquisition
  • Responsible for the identification and qualification of source data to satisfy master and transactional data requirements for the target warehouse
  • Lead data assessment and mapping activities, and develop the underlying migration framework to extract, transform, validate, enrich, and load the source data
  • Define reusable solution architectures using standard modeling practices
  • Design and deliver solutions that are reliable and scalable and focused on driving automation and improving productivity
  • Fundamental understanding of data warehousing principles
  • Ability to understand impacts of a solution architecture on corresponding design, build, and test efforts

 


EDUCATION AND EXPERIENCE:

 

 

  • Required Experience:
    • Strong experience with cloud data warehouses, such as Snowflake
    • Strong experience working with complex SQL code
    • Moderate experience working with open-source or commercial message queuing technologies, such as Azure Service Bus, Apache Nifi, Apache Kafka, etc.
    • Strong experience working with DevOps capabilities like version control, automated builds, testing and release management using tools like Git
    • Moderate experience working with replication software such as Fivetran or HVR
    • Strong experience with ETL tools

 

  • Preferred Experience:
    • SQL Server 2008 experience a plus
    • SAP Hana experience a plus
    • Tableau experience a plus
    • Power BI experience a plus
    • R/Python experience a plus
    • Dbt experience strongly preferred
  • Education:
    • HS Diploma or equivalent required
    • Bachelor's degree in Business with MIS or technology related degree (C.S.) required


About Petroplan

Petroplan is the trusted, specialist global Talent Solutions partner of choice for employers and professionals in the Energy sector. Since 1976, Petroplan has been here to help people like you make the most of the opportunities available and find the best fit for you as an individual.

Over 10,000 placements in more than 55 countries for over 550 clients across 65 disciplines.

In an industry where skilled and experienced professionals are increasingly sought after resource, we appreciate the true value of what you have to offer. What's more, we understand that different things are important to different people in today's world of work - it's about making exactly the right connections for you as an individual.

Our reputation for contractor and candidate care, understanding what makes you tick, and finding you the best match is second-to-none. We understand the industry inside-out and seek to understand YOU and your motivations in the same way. We take the time to evaluate your individual strengths, understand the most important things to you, and establish exactly what you're looking for from your next role.