DTN is a global leader providing insights and analytics to our customers to feed, fuel, and protect the world. We help people make critical business decisions that impact the agriculture, oil and gas, trading, and weather industries.
It’s a difference you’ve likely felt without even knowing it. From the food on your plate to the gas in your car to the last flight you took, chances are a DTN customer made it possible. And that’s just for starters. That’s why we say, “When our customers prosper, we all win.”
Job Description:
DTN is seeking an experienced Senior Data Engineer to join our close-knit, high-energy Eco Data team. If you’re excited by the challenge of building high-performance data processing pipelines at scale, working with complex geospatial datasets, and delivering time-sensitive weather content, we want to hear from you.
In this role, you’ll help design, build, and optimize data models and services that transform raw weather data into fit-for-purpose formats used in time-series applications. It’s a great fit for engineers who love solving deep technical problems and want to work at the intersection of data engineering, distributed systems, and cloud-native infrastructure.
What you'll be responsible for:
-
Collaborate with a global, agile team — participating in stand-ups, sprint ceremonies, and async communication.
-
Build and optimize data pipelines that convert large weather model outputs into high-performance formats.
-
Own the full pipeline lifecycle: from data ingestion to transformation and delivery.
-
Use open-source tools and AWS to plan, create, test, and optimize custom data transformation pipelines that convert weather model outputs into high-performance formats.
-
Design and maintain REST APIs to serve data to customer-facing applications.
-
Translate technical concepts for cross-functional partners and stakeholders.
-
Lead async code reviews and contribute to a supportive, feedback-oriented team culture.
-
Provide guidance during production issues and contribute to documentation and operational readiness.
What you'll bring to the role:
-
Deep expertise in Python and data transformation tools like Apache Arrow, Pandas, NumPy, and Polars.
-
Experience with scientific data formats like Zarr or Parquet.
-
Hands-on experience building distributed, cloud-native data pipelines on AWS (e.g., EC2, S3, SQS, SNS, EKS).
-
Proficient with relational databases and schema/versioning tools (PostgreSQL, Alembic).
-
Strong understanding of event-driven architectures and scalable system design.
-
Proven experience with custom ETL pipelines and handling large, time-sensitive datasets.
-
Familiarity with containerized applications (Kubernetes), IaC (Terraform), and CI/CD (Gitlab).
-
Knowledge of parallel processing and asynchronous programming for performance optimization.
-
Clear communicator with the ability to explain complex topics to technical and non-technical audiences.
Nice-to-Have Experience:
-
Experience with geospatial data and time-series data models (especially in meteorology)
-
Familiarity with scientific data formats like GRIB and NetCDF.
-
Experience building APIs with FastAPI or Typescript/Express.
-
Expertise in a concurrency-focused language like Node.js.
-
Experience with observability tools like Datadog.
What you can expect from DTN:
-
Competitive Salary
-
Unlimited PTO
-
Collaborative and dynamic work environment.
-
Flexible working hours
-
Remote work model
-
Competitive Medical, Dental and Vision Insurance Plans
-
6% 401K matching
-
Unlimited access to 13k+ courses via learning platform to support employee career advancement
-
Employee Assistance Program (EAP)
The targeted hiring base pay range for this position is between $101,250 and $148,500. DTN is a pay for performance organization, which means there is the opportunity to advance your compensation with performance over time. The actual base pay offered for this position will be dependent upon many factors, including but not limited to: prior work experience, training/education, transferable skills, business needs, internal equity and applicable laws. The targeted hiring base pay range is subject to change and may be modified in the future. This role may also be eligible for market competitive variable pay and benefits.
DTN Core Values:
-
Bold - you cultivate innovation by experimenting and adapting, learning from failures and pushing boundaries; you are open to change and grant others the space to do the same.
-
Passionate - you yearn to make customers successful; you bring an infectious energy and zeal to everything you do.
-
Selfless - you leave your ego at the door and believe if customers succeed, we all succeed; your influence is earned through outcomes, not your title.
-
Outcome-oriented - you are biased towards results, setting high standards for yourself and others; you focus on outcomes over process; you prefer to demonstrate vs talk about it.
-
Autonomous - you create clarity, optimism and opportunity in the face of ambiguity and setbacks; you don’t need everything spelled out for you; you act decisively and courageously, solving problems through others by seeking input, not consensus.
-
Multi-faceted - you pride yourself in being skilled in multiple disciplines and your propensity to grow and learn new ones; you connect the dots and move beyond the obvious to drive growth.
-
Candor - you are open and honest in your quest to create value for customers; you share difficult or unpopular messages in a motivating way, and let people know where they stand honestly and sensitively.
#LI-REMOTE
Why DTN?
OUR VISION: To be the independent, trusted source of insights to our customers who feed, protect, and fuel the world.
OUR MISSION: Empower our customers with intelligent and actionable insights that exceed their expectations and enable their success on a daily basis.
OUR VALUES: Customer-Focused, Forward-Thinking, People-Centric, Solution-Oriented
We have great benefits at DTN – apply today to find out more!
At DTN, we are an equal opportunity employer. Come join us as we help feed, fuel, and protect the world!
** DTN is an Equal Opportunity Employer Minorities/Women/Veterans/Disabled
Top Skills
Similar Jobs
What you need to know about the Austin Tech Scene
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
