Data Engineer Job Description Template

In this role, you will work directly with other engineers and data scientists to enable experiments, machine learning models, and analytical data products. Your responsibilities will include expanding and optimizing our data pipeline, architecture, and collection for cross functional teams, along with supporting the data needs of multiple systems and projects. The ideal candidate is someone who wants to demonstrate their thought leadership while creating, maintaining, and testing infrastructures, and providing elegant insights that have a direct influence on the company’s bottom line.

Typical Duties and Responsibilities

  • Create maintainable, elegant code and high-quality data products that are modeled, well-documented, and simple to use
  • Build, maintain, and improve the infrastructure to extract, transform, and load data from a variety of sources using SQL and AWS technologies
  • Design analytics tools to utilize the data pipeline to produce actionable insights
  • Analyze business needs to create scalable engineering solutions
  • Identify methods to streamline processes and automate repetitive procedures
  • Work with partners from different functional areas and lead projects
  • Maintain the security data across multiple data centers and regions

Education

  • Bachelor’s degree in computer science or a related technical subject, or comparable experience

Required Skills and Experience

  • 8+ years of experience in the field, as well as expertise in creating distributed data pipelines for batch and real-time applications
  • 4+ years of programming experience in Java or Python
  • 4+ years of experience with SQL (No-SQL experience is a plus)
  • 4+ years of experience in dimensional data modeling and schema design
  • Well-versed in a variety of transport and API protocols, including REST, GraphQL, and gRPC
  • Proven track record of managing and interacting with internal clients 
  • Knowledge of developing, managing, and designing data processing systems
  • Experience working on any size/scale with a Map Reduce or MPP system
  • Knowledge of constructing microservices with frameworks like Spring Boot
  • Strong communication skills
  • Comfortable working in highly agile environments with ambiguous needs and quick iterations
Contact us

Recruit with Nexus IT Group