Shift5 Logo

Shift5

Data Engineer

Job Posted 19 Days Ago Reposted 19 Days Ago
Remote
2 Locations
Senior level
Remote
2 Locations
Senior level
As a Data Engineer, you will design and build data processing pipelines, collaborate across teams, and ensure data accuracy and integrity while developing scalable applications.
The summary above was generated by AI

Shift5 is the observability platform for onboard operational technology (OT). We’re a rapidly growing scale-up that specializes in cybersecurity, predictive maintenance, and compliance for operational technology (OT) systems across defense, aerospace, and rail. We are a collaborative, passionate, and driven cadre of dynamic, multidisciplinary experts and we’re focused on helping our customer’s fleets run smarter and safer by accessing and democratizing the volumes of onboard OT data generated by transportation and freight fleets, and defense fleets and weapon systems. Come join us. 

Our Values:

  • Embrace Truth and Integrity: Base decisions on data, foster open dialogue, and uphold unwavering integrity.
  • User-Centric Focus: Prioritize user needs to guide our actions and resource allocation.
  • Collaborative & Adaptable: Collaborate for excellence, learning from failures and driving iterative improvements, recognizing every decision's significance.

Shift5 is seeking a Data Engineer to join our growing team. In this role, your primary responsibilities will be to:

  • Interpret requirements and design specifications and take ownership of building features from the ground up.
  • Write clean, well-documented, scalable, extensible, testable code to ensure application quality and maintainability.
  • Work cross-functionally across Shift5 engineering teams to build applications that integrate cleanly across other Shift5 componentry.
  • Design, build, and maintain data processing, storage, and integration pipelines.
  • Build robust and scalable data products for various stakeholders including data scientists, transportation engineers, and executives that drive insights and decision making.
  • Create solutions that utilize AWS cloud services that are efficient, reliable, cost-effective, dynamically scalable, and observable.
  • Collaborate with data scientists and engineers to create semantic data models to represent complex vehicular systems.
  • Perform analysis on complex data sets to create data ontologies, verify data quality/integrity, and ensure accuracy of data after passing through data pipelines.

You’ll operate in a team-based environment with engineers, product managers, program managers and designers to conceive, implement and shape major features. Engineers are key contributors in shaping this design process and you’ll be a major factor in generating high-impact products that literally save lives. This role resides in our Product Engineering team and reports to our Director, Software Engineering.

Shift5 is a rapidly growing data and cybersecurity scale-up. We specialize in capturing and analyzing vehicular bus data in real time, providing anomaly detection and operational intelligence required to act. Our insights provide real-time alerting and historical trends to assure mission readiness and cyber survivability, and our innovative technology enables military systems to deter adversaries, protect warfighters, and maintain their competitive edge. We are a collaborative, passionate and driven cadre of cyber security experts. Our engineers are multidisciplinary, and our team is dynamic. We’re a growing company focused on helping our customer’s fleets run smarter and safer by capitalizing on mountains of data resting right about the wheels. Come join us!

Qualifications:

Required : 

  • 5+ years software/data engineering.
  • 3+ years experience with a major programming language (GoLang, Java, Python)
  • 3+ years experience with of relational database experience (PostgreSQL, MySQL, Oracle, etc.).
  • 3+ years experience with Big Data (Hadoop, Spark) and Data Modeling.
  • 2+ years experience with containerization and cloud services: Docker, Kubernetes, cloud monitoring tools.
  • Proven experience building complex data applications from scratch including requirements gathering, design, planning, and implementation.
  • Familiar with modern data stack components including data ingestion, transformation, and orchestration.
  • Expertise with batch and streaming data pipelines using technologies such as Apache Airflow or Benthos.
  • Demonstrated delivery of scalable, observable, supportable, reliable data processing applications.
  • Deep understanding of software engineering practices and concepts.
  • Experience with end-to-end feature design and ownership.
  • Comfortable working in a fast-paced environment.
  • Ability to efficiently multitask and accommodate change of priorities on demand.

Preferred : 

  • Active US Government TS clearance (and willingness to maintain) or an ability to obtain one. US Citizenship.
  • MS in Computer Science, Cybersecurity, Cyber Intelligence, or equivalent.
  • Experience and understanding of data lakes/warehouses (e.g. Snowflake, Databricks, Redshift).
  • Proficiency with CI/CD, source control, design reviews, and integrating observable practices.
  • Strong verbal and written skills.
  • Excellent analytical and problem-solving abilities.
  • Ability to work effectively in a team and with cross-functional groups.

Compensation & Benefits:

  • Base Salary: $150,000-$200,000
  • Bonus program and equity in a fast-growing startup
  • Competitive medical, dental, and vision coverage for employees and their families
  • Health Savings Account with annual employer contributions
  • Employer-paid Life and Disability Insurance 
  • Uncapped paid time off policy
  • Flexible work & remote work policy
  • Tax-deferred public transit benefits with Metro SmartBenefits (DC/MD/VA) 

We are committed to building an inclusive culture of belonging that embraces the diversity of our people and represents the communities in which we work and the customers we serve. We know the happiest and highest performing teams include people with diverse perspectives and ways of solving problems. We strive to attract and retain talent from all backgrounds and create workplaces where everyone feels empowered to bring their full, authentic selves to work.  

Shift5 is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sexual orientation, gender identity, national origin, disability, age, marital status, ancestry, projected veteran status, or any other protected group or class.

Privacy Policy and Notice for Shift5, Inc. Job Applicants, Employees & Contractors


Top Skills

Apache Airflow
Benthos
Databricks
Docker
Go
Hadoop
Java
Kubernetes
MySQL
Oracle
Postgres
Python
Redshift
Snowflake
Spark

Similar Jobs

17 Hours Ago
Remote
Hybrid
2 Locations
240K-274K Annually
Senior level
240K-274K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
As a Distinguished Data Engineer, you will drive the adoption of modern technologies, collaborate on key business challenges, and mentor talent while promoting engineering excellence.
Top Skills: AirflowAws GlueDatabricksGoJavaKafkaKinesisPythonSnowflakeSparkSQL
Yesterday
Remote
San Francisco, CA, USA
116K-187K Annually
Mid level
116K-187K Annually
Mid level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Data Engineer, you'll build data models and pipelines, optimize data storage and retrieval, and work collaboratively to enhance data-driven solutions.
Top Skills: AirflowAWSPythonSparkSpark-SqlSQL
2 Days Ago
Remote
Hybrid
67 Locations
130K-256K Annually
Senior level
130K-256K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
The GCP Data Engineer Senior Manager will lead data infrastructure development, execute data pipelines, and collaborate with clients on data solutions. Responsibilities include architecting scalable systems, applying data governance, and coaching teams to enhance data capabilities.
Top Skills: BigQueryCloud ComposerData FusionDataflowDataprepGCPLookerQuickbaseSQLTableauTerraform

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account