The Senior Data Engineer designs scalable data pipelines, collaborates with teams to address business needs, and ensures data infrastructure reliability.
Join a pioneering financial services company that is redefining homeownership through innovative, data-driven solutions. As a Senior Data Engineer, you will be instrumental in designing and building scalable data pipelines, transforming complex datasets, and ensuring the reliability of the data infrastructure. Working closely with data scientists and analysts, you will provide critical insights that shape strategic decisions. If you are passionate about data engineering and thrive in a fast-paced, collaborative environment, this role offers you the opportunity to contribute to cutting-edge projects and help shape the future of data architecture
Requirements
- 5+ years of Python development experience.
- Experience with AWS, including services like DynamoDB, S3, EMR, Glue, Athena, and Redshift.
- Knowledge of distributed computing engines, such as Apache Spark.
- Proficiency in both relational and non-relational databases, along with data modeling expertise.
- Experience setting up code pipelines using CloudFormation or Terraform.
- Familiarity with ETL pipeline development in OLAP and Data Warehouse environments.
- Hands-on experience with orchestration tools like Airflow.
- Understanding of serverless architectures and scalable application design principles.
- Proficiency with version control systems, particularly Git.
- Experience with Node.js, DevOps, and CI/CD practices is a plus.
- Background in cloud technologies (AWS or Azure) and fintech or banking is desirable.
Responsibilities
- Design and implement scalable data pipelines in a horizontally scaled environment.
- Collaborate with cross-functional teams to understand business needs and define transactional scenarios across multiple microservices.
- Write high-quality, maintainable code that meets established standards and best practices.
- Build strong relationships with clients by understanding their business model and delivering solutions that align with their goals.
- Influence and communicate effectively at all levels, including management and engineering teams.
- Utilize distributed computing systems to transform and manage large datasets efficiently.
- Work with cloud-based technologies such as AWS to support the company’s data infrastructure.
- Contribute to continuous integration/continuous delivery (CI/CD) pipelines and DevOps practices.
- Collaborate with data scientists to ensure the availability and accessibility of critical insights for decision-making.
Top Skills
Airflow
Spark
Athena
AWS
Ci/Cd
CloudFormation
DevOps
DynamoDB
Emr
ETL
Git
Glue
Node.js
Olap
Python
Redshift
S3
Terraform
Similar Jobs
eCommerce • Legal Tech • Professional Services • Software • Data Privacy
As a Senior Data Engineer, you will manage data infrastructure, build ETL pipelines, and improve data models while collaborating with analysts.
Top Skills:
Apache AirflowAWSDbtPostgresRedshiftSnowflake
Big Data • Transportation • Analytics • Big Data Analytics
The Senior Data Engineer will design and optimize data/ML pipelines and architectures, collaborate with teams, ensure data quality, and mentor juniors.
Top Skills:
AirflowSparkBeamBigQueryDataflowDataprocDbtDockerFlinkGCPJavaKafkaKinesisKubernetesNoSQLPrefectPythonPyTorchScalaScikit-LearnSQLTensorFlowVertex Ai
Artificial Intelligence • eCommerce • Food
As a Senior Data Engineer, you'll develop and maintain data pipelines that inform analytics, ensuring data quality for decision-making across teams.
Top Skills:
DatabricksPythonScalaSpark
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
