Data Engineer
Posted on: 2 Jul 2024
Houston, TX
Job Description
Responsibilities
Assist with developing a data ecosystem that is robust, fast, and scalable.
Design, build and launch efficient & reliable data pipelines to move and transform data (both large and small amounts)
Optimize existing pipelines and maintain of all domain-related data pipelines.
Deploy inclusive data quality checks to ensure high quality of data.
Use DevOps methodologies to create automated, efficient CI/CD processes to reduce the time to promote, test, and deploy Analytics models and analyses.
Develop, test, deploy, and maintain efficient and reusable patterns of streaming and batch data ingestion pipeline architectures.
Document and maintain architecture and coding standards for supported platforms.
Participate in all phases of the software development lifecycle, including requirements gathering, technical planning, design, development, testing, sustaining support, and documentation.
Seek guidance when a direction is needed and speak up about technology risks identified.
Follow agile practices, as well as quality management procedures as defined by precedents, standards, or policies.
Collaborate with the Analytics team members and teams across NOV to deliver solutions and evolve products.
Comply with all NOV Company and HSE policies and procedures.
Minimum Qualifications
Bachelor’s degree in computer science, Computer Engineering, relevant technical field, or equivalent practical experience.
3+ years of Python, PySpark or other modern programming language development experience.
Hands-on experience working with data pipelines using a variety of source and target locations (e.g., Databricks, SQL Server, Data Lake, file-based, SQL and No-SQL database).
3+ years of experience in custom ETL design, implementation, and maintenance.
Experience developing batch ETL pipelines; real-time pipelines are a plus.
National Oilwell Varco
Houston, TX
National Oilwell Varco, Inc. designs, manufactures, and sells systems, components, and products for oil and gas drilling and production worldwide. It operates in three segments: Wellbore Technologies, Completion & Production Solutions, and Rig Technologies. The Wellbore Technologies segment offers various equipment and technologies used to perform drilling operations. It also provides solids control and waste management equipment and services; drilling fluids; portable power generation products; drill and wired pipes; drilling optimization and automation services; tubular inspection, repair, and coating services; rope access inspection, instrumentation, and measuring and monitoring services; downhole and fishing tools; steerable technologies; hole openers; and drill bits.
The Completion & Production Solutions segment provides equipment and technologies for hydraulic fracture stimulation, including pressure pumping trucks, blenders, sanders, hydration units, injection units, flowline, and manifolds; well intervention, such as coiled tubing units, coiled tubing, and wireline units, as well as blowout preventers and tools; onshore production comprising fluid processing systems, composite pipes, surface transfer and progressive cavity pumps, and artificial lift systems; offshore production that include fluid processing systems, floating production systems, and subsea production technologies; and connectors for conductor pipes. The Rig Technologies segment offers substructures, derricks, and masts; cranes; jacking systems; pipe lifting, racking, rotating, and assembly systems; mud pumps; blowout preventers; drives and generators; rig instrumentation and control systems; mooring, anchor, and deck handling machinery; and pipelay and construction systems.
It also provides spare parts, repair, and rentals, as well as remote equipment monitoring, technical support, field service, and customer training services. The company was founded in 1862 and is based in Houston, Texas.
-
IndustryOil and Gas
-
No. of Employees34,220
-
Website
-
Jobs Posted216
