Junior Data Migration Developer
- Posted 26 May 2023
- LocationSingapore
- Job type Permanent
- Reference64261
Company's Benefits
-
Paid Parental Leave
-
Flexible Working Arrangements
-
Mentorship Program
-
Leadership Development Program
-
Raise Numbers Of Women In Leadership
-
Internal Women's Networking Group
Job Description
Job Description
As a Junior Data Migration Developer (Data Engineer), you will support the implementation of projects focused on collecting, aggregating, storing, reconciling, and making data accessible from disparate sources to enable analysis and decision making. This role will also play a critical part in the data supply chain, by ensuring stakeholders can access and manipulate data for routine and ad hoc analysis. Additionally, you will support the full lifecycle of data from ingesting through analytics to action.
Key Role Responsibilities:
Translate business requirements to technical solutions leveraging strong business acumen
Analyze current business practices, processes and procedures as well as identifying future business opportunities for leveraging Microsoft Azure Data & Analytics PaaS Services
Support the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments.
Deliver of architectures for transformations and modernizations of enterprise data solutions using Azure cloud data technologies.
Design and Build Modern Data Pipelines and Data Streams.
Design and Build Data Service APIs.
Develop and maintain data warehouse schematics, layouts, architectures and relational/non-relational databases for data access and Advanced Analytics.
Expose data to end users using PowerBI, Azure API Apps or any other modern visualization platform or experience
Implement effective metrics and monitoring processes.
Skill & Capability Requirements:
Around 3 years of working experience as a Data Engineer, with experience in Data Migration
Demonstrated experience in turning business use cases and requirements into technical solutions
Experience in business processing mapping of data and analytics solutions.
Ability to conduct data profiling, cataloging and mapping for technical design and construction of technical data flows
The ability to apply such methods to solve business problems using one or more Azure Data and Analytics services in combination with building data pipelines, data streams, and system integration.
Ability to leverage a variety of programming languages & data crawling/processing tools to ensure data reliability, quality & efficiency
Experienced in Cloud Data Transformation using ETL/ELT tools such as Azure Data Factory, Databricks
Experienced in building modern cloud-based data architectures, building Lakehouse architecture using Databricks, and technologies such as Data Lake, Delta Lake, and Data Lakehouse e.g., Azure Data Lake Gen 2, Azure Delta Lake
Experienced in building data pipelines using pyspark and distributed computing, Python scripting using data engineering and machine learning libraries, PowerShell, bash, DAX, M-language, Big data files formats e.g. Parquet, Avro, ORC and Big data technologies such as Hadoop, Hive, Map-Reduce, Partition design, performance tuning in Spark
Experienced in Dev-Ops processes (including CI/CD) and Infrastructure as code fundamentals.
Experienced in Data Governance tools like Unity Catalog / Purview, Master Data Management (MDM) and Data Quality tools and processes
Knowledge of business intelligence tools such as Power BI, Tableau, Qlik, Cognos TM1
Knowledge of Azure Data Lake, Azure SQL DW, and Azure SQL, Azure App Service is required. Azure IoT, Azure HDInsight + Spark, Azure Cosmos DB & Azure Stream Analytics are a plus.
Knowledge in data modeling and database management, such as performance tuning of the Enterprise Data Warehouse, Data Mart, and Business Intelligence Reporting environments, and support the integration of those systems with other applications
Experience preparing data for use in Azure Machine Learning / Azure Databricks
Experience preparing data and building data pipelines for AI Use Cases (text, voice, image, etc).
Designing and building Data Pipelines using streams of IoT data.
Knowledge of Lambda and Kappa architecture patterns.
Strong team collaboration and experience working with remote teams.
Working experience in Visual Studio, PowerShell Scripting, and ARM templates.
Azure certifications (AZ-900, AZ-200, and 201), Databricks certification, DevOps certifications
What we offer you
Come for the distinctive experiences you have helping forward-thinking corporations, non-profits, and governments push the boundaries of digital innovation. Stay for the limitless learning opportunities that encourage you to master Microsoft and pursue big ideas. Enjoy ambitious growth for yourself as part of Avanade’s people-first culture with benefits like employee share purchasing, flexible work arrangements, a commitment to diversity and inclusion, and competitive pay.