Job Description

Job Description

SECTION 1: POSITION RESPONSIBILITIES

Position Summary

The ETL Data Engineer position is tasked with overseeing the full lifecycle of architecture and back-end development of ETL and ELT processing including on-premise, cloud and hybrid environments, database and performance administration, and collaborate with BI and Data warehouse teams to provide and receive valuable feedback. As an ETL Data Engineer, you will work closely with ALLDATA and AutoZone IT, Data Management-, Data Science- and BI teams professionals to architect, engineer, develop and continuously maintain the ALLDATA ETL environment in an Agile framework. The Data Engineer supports the Data Science department (IaaS, BI and Analytics), front- and back-office operations, Production, Technologies, HR, Finance and IT Operations in their need to have accurate information while delivering business objectives.

Key Responsibilities

The ETL Engineer key responsibilities are to build and manage data pipelines and storages and to execute them. As the ETL Data Engineer, you will be building the data foundation and interface with the Data architect, the Datawarehouse engineer, dB Administrators, BI developers, Analysts and Data Scientists, each of which will have specific access needs to the data. You will participate in the requirements for each of these roles as strategic approach is required in order to develop appropriate solutions. This is a key role that entails the following responsibilities:

* ETL Process Management
* Outline the ETL process, setting the borders of data processing
* Provide system architecture for each element and the whole data pipeline
* Document the requirements of the system and manage its development
* Take part in the actual development/implementation of ETL tools
* Conduct testing of the tools and data pipelines
* Data Modeling
* Define the required data formats and end formats that will be represented in the Datawarehouse
* Construct and document the data models in collaborating with the business analysts, data analysts, and Datawarehouse Engineer
* Data Warehouse Architecture
* Collaborating with the Datawarehouse Engineer and the Data Architect, define the data warehouse architecture as well as the tools that will be used to load data into it. Be aware that the ETL Data Engineer should possess all the required skills and knowledge to define the architecture
* Data Pipeline Development
* Develop the technical infrastructure that will automatically perform the following actions as a single system:
* Data extraction from given sources
* Data uploading into the staging area (cloud and on-prem)
* Data formatting to the defined standards, including operations as data cleansing, data structuring and mapping, metadata inclusion to enrich the information with the required details, structured data loading into the warehouse
* ETL testing
* As an ETL Engineer, you will oversee the testing of the system, units, data models, and warehouse architecture. You will work alongside the QA teams, to ensure that the following aspects are fully tested:
* Data model
* Data warehouse architecture
* Representation tools
* Data flow validation
* Uploading/downloading/querying speed testing, and
* System performance tests
* Other data-specific aspects may include testing of ETL system code, data design, mapping techniques, root cause analysis on all processes and resolving production issues

Other responsibilities will include:

* Working with the Business to understand and deliver according to acceptance criteria
* Work closely with the Analytics, BI and IaaS teams to understand and deliver according to acceptance criteria
* Documentation of data dictionaries, user manuals, tutorials, blog articles, and sample code for the rest of ALLDATA
* Participating in the product team scrums
* Ability to manage agile methodologies

Supervisory Responsibilities

Will this position have direct reports? NO

Education and/or Experience

* Minimum of bachelor's degree in computer science, software/computer engineering,
* 5+ years of experience of experience as a ETL Engineering
* Experience in Talend Components (database, file, API, OS system calls, etc), Context management, Deployment, Performance Tuning and Administration (setting up projects, using admin-console to configure jobs, etc.)
* Experience with different project development life cycle methodologies such as Waterfall Model, agile/scrum to iterate quickly on product changes, developing user stories and working through backlogs
* Preferred - Experience with the below:
* ETL tools like Talend, Scribe
* Replication tools like TCI (Tibco) and GoldenGate
* UML, Hadoop, Snowflake, SOLR, Cloud (GCP)
* Data Vault modeling methodology (must be willing to learn if a STAR schema modeler)
* Strong Knowledge and experience in Java programming
* Familiar with various reporting tools & environments (like WebFOCUS, PowerBI, & others)

Certificates, Licenses, and Registrations

Google Professional Cloud Architect or better - Not required but preferred

Azure Solutions Architect Expert - Not required but preferred

SECTION 2: SKILLS AND ABILITIES

Functional Competencies

* Knowledge of Cloud Technologies, GCP preferred
* Proficiency in all aspects of data modeling and data profiling
* Strong documentation & Strong coordination skills.
* Strong Experience with ETL Tools
* Database/DBA/Architect background
* Expertise in Data Analysis
* Strong knowledge in scripting languages (Java, Bash, Python, Perl, etc.)
* Software Engineering Background
* Troubleshooting
* Self-starter, results-oriented, & delivery-focused
* Strong communication, presentation, & inter-personal skills

SECTION 3: COMPETENCIES

Core Competencies

1. Puts Customers First
* Provides WOW! Customer service every time, every where
* Understands customer needs and solves their problem
* Shows sense of urgency in correctly meeting customer needs
2. Team Player
* Is a reliable and supportive team member
* Values the ideas and opinions of others
* Gives recognition for good work
* Builds strong relationships with others
* Resolves conflict effectively
* Steps in and assumes leadership roles when needed
3. Communicates Effectively
* Communicates in a clear, straightforward, respectful way
* Demonstrates effective listening skills
* Listens and assumes positive intent
* Shares information in a timely manner
4. Results the Right Way
* Does what it takes to do the job right (WITTDTJR)
* Is accountable, takes ownership and meets commitments
* Prioritizes well, plans and executes in a manner of high integrity and ethics
* Makes decisions based on what is best for AutoZone

5. Development Focused
* Asks for and embraces feedback
* Owns professional development
* Provides feedback and ideas to develop others
6. Embraces Change
* Understands and is open to change
* Looks for ways to improve our processes, services and products while maintaining our culture of thrift
* Encourages innovative thinking

SECTION 4: PHYSICAL DEMANDS

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job.

* Typical physical demands are required to perform the work, such as some walking, standing, bending, or carrying of light items
* Occasional game of pool, shuffleboard or air hockey