Senior Data Engineer for OPENLANE, Inc. in Carmel, IN will participate daily in Agile ceremonies to help design, plan, build, test, develop, and support Openlane large enterprise data products and platforms consisting of ADF ETL pipelines and Postgres, DynamoDB, Elastic search, and Snowflake databases; plan and design data schemas; Will work with a team in a shared services delivery model supporting seven lines of business, including front-end customer facing products, B2B portals, mobile applications, business analytics, and data science initiatives. Work with Azure Cloud or AWS, Work with product, data science, analytics, and engineering teams to learn project data needs and define project scope; Conduct Gap Analysis and Data Validation; design and planning of data services solutions on the Data Platform; building and delivery of Azure Data Factory (ADF), Python, Docker, and Kubernetes feed framework data pipeline jobs and services; Manage SQL, Github / Azure DevOps (CI/CD); contribute to the Data Engineering team delivery framework including building of re-usable code, implementing industry best practices, and maintain a common delivery framework; monitoring, maintenance, documentation, and incident resolution of scheduled production data jobs supporting internal and external customers data needs. May work remotely anywhere in the US.
Requirements:
Bachelor’s degree in Computer Science, Software Engineering, Mechanical Engineering, Engineering Management, or related field, and 5 years of progressive experience as a Data Engineer or related occupation in data engineering.
Must possess a minimum of 5 years of experience with the following: SQL and Python development including data warehousing. Must possess a minimum of 3 years of experience with each of the following: Planning and designing data schemas; Azure Cloud or AWS; Gap Analysis and Data Validation; Github / Azure DevOps (CI/CD); Azure Data Factory (ADF), Docker, and Kubernetes; and working with large enterprise data such as Postgres, DynamoDB, Elastic search, or Snowflake. May work remotely anywhere in the U.S.
#LI-DNI
Top Skills
Similar Jobs
What you need to know about the Austin Tech Scene
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center