The role involves supporting data migration from GCP to Azure, focusing on ETL processes, data quality assurance, and environment management.
Our client is currently undergoing a transition from the Lucernex database hosted on Google Cloud Platform (GCP) to an Azure-based environment using Databricks. We are seeking a skilled Data Migration Specialist to support this critical migration effort. The role will focus on data extraction, transformation, and loading (ETL) across different data platforms, ensuring smooth and reliable migration processes while maintaining data quality. If you have expertise in data ingestion, integration, migration, and cloud-based environments, we'd love to hear from you..
Requirements
- Strong experience in data migration, specifically in moving data across platforms (GCP to Azure).
- Expertise in handling ETL processes, particularly using tools like Altova MapForce.
- Experience working with databases such as SQL Server.
- Familiarity with cloud-based platforms, especially GCP and Azure.
- Knowledge of DevOps tools like Bitbucket and Jenkins for CI/CD processes.
- Ability to work with various data formats (CSV, screenshots, etc.) and create data mappings between systems.
- Strong problem-solving skills with an emphasis on data quality and integrity.
- Experience in environment management and administering cloud platforms.
- Excellent communication skills to collaborate with clients on data mapping and migration requirements.
Responsibilities
- Data Ingestion: Extract data from various source platforms and systems.
- Integration: Combine and transform data from multiple sources to ensure consistency and usability.
- Data Quality: Ensure the accuracy, completeness, and reliability of the data throughout the migration process.
- Migration: Facilitate the movement of data to the destination storage, ensuring proper handling and processing.
- Testing: Validate that the processed data meets business requirements and is fit for purpose.
- Environment Management: Administer the platforms and tools, ensuring the smooth operation of the migration process and maintaining efficient workflows.
Top Skills
Altova Mapforce
Azure
Bitbucket
Databricks
ETL
Google Cloud Platform
Jenkins
SQL Server
Similar Jobs
Information Technology • Productivity • Software • Infrastructure as a Service (IaaS)
As a Data Scientist, you will apply machine learning and statistical models on complex data, collaborate with teams to drive actionable business strategies, and optimize processes for NinjaOne's products and services.
Top Skills:
AWSC++JavaKotlinMatplotlibNumpyPandasPostgresPower BIPythonRScikit-LearnSQLTableau
Enterprise Web • Fintech • Marketing Tech • Software
Lead data-focused projects, manage data migrations, mentor junior consultants, and deliver advanced reporting and analytics solutions.
Top Skills:
Power BISQLSsrs
Fintech • Gaming • Mobile • Sports • Esports
The Staff Researcher will lead research initiatives to understand player behavior and psychology, producing actionable insights for product and business strategies.
Top Skills:
Behavioral AnalysisQualitative ResearchQuantitative ResearchStatistical Techniques
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
