Azure Data Engineer Job at mavinsys, Louisville, KY

c082WXBYRlNCUndiQ1lOM2IvUlRpSnZrWHc9PQ==
  • mavinsys
  • Louisville, KY

Job Description

Healthcare is Must
PBM experience is desired
Skills must have: Azure SynapseDatabricks SnowFlake Python PySpark(ETL)


Job Title: Azure Data Engineer
Job Details:
Considering Python as the ETL tool for reading data from the source handling datatype and data transformations managing error handling logging and loading data into Databricksmanaged Delta tables the candidate should have strong expertise in Python along with solid knowledge of Databricks and PySpark enabling them to evaluate and perform data transformations within Databricks. They should be proficient in all aspects of Python including classes objects methods dictionaries loops Wheel files and packages and should be able to connect to various data sources including databases and streaming data
Expertise in Azure services such as Azure SQL Database Azure Data Factory Azure Synapse Analytics and Azure Data Lake is also required.
The ideal candidate has extensive experience in data engineering working with largescale data infrastructures and optimizing ETL processes
Expertise in Azure services such as Azure SQL Database Azure Data Factory Azure Synapse Analytics and Azure Data Lake
At least 6 years of experience in data engineering with a focus on building data pipelines
Proven experience with Spark Scala and other related technologies
Familiarity with Could Warehouses data lakes storage formats.
Strong knowledge of data modeling and ETL processes
Experience leading data engineering projects.
Proven experience with Databricks and Apache Spark
Strong proficiency in Python
Experience in Unix shell scripting and scheduling tools

Python

Job Tags

Similar Jobs

TLC Nursing

Travel Registered Nurse Psych Job Job at TLC Nursing

Embark on an exciting journey as a Registered Nurse specializing in Psych in sunny Florida, Jacksonville. Join our team on 03/31/2025 for a weeks-long assignment and experience the rewarding opportunity to make a difference in the lives of patients struggling with mental... 

Coeur d'Alene Resort

Housekeeping Attendant - CdA Resort Job at Coeur d'Alene Resort

Job Summary The room attendant's responsibilities include changing towels, making beds, and cleaning bathrooms. You will also address Guest inquires and make sure the rooms are fully stocked, clean, and inviting at all times. Candidate must have open availability 7 ...

Lifestyle App Magazine

Interactive Web/Graphic Designer Job at Lifestyle App Magazine

Interactive Web/Graphic DesignerLifestyle App Magazine looking for Interactive Web/Graphic Designer/ProgrammerRequirements:1. Creative & conceptual with your own ideas & ability to create stunning layouts and designs? 2. Able to use common design using the following programs... 

Skyline Mail Carriers, Inc.

Class A Local Class A CDL Job Job at Skyline Mail Carriers, Inc.

 ...We operate a fleet of over 90 tractors and trailers in the Northwest. Skyline is currently one of the largest mail carriers for the USPS in the Northwest.Job Description: Class A CDL Drivers in Portland, ORSMC is hiring qualified Local Class A CDL Drivers for the Portland... 

Volarify

Estimator-Restoration Job at Volarify

 ...Our Client is seeking a dynamic and skilled General Estimator to join their team as a fourth-level estimator. In this role, youll...  ...industrial projects. Youll work directly with clients, utilizing Xactimate software to develop competitive estimates and manage projects...