- Career Center Home
- Search Jobs
- Data Engineer - PySpark & Azure
Results
Job Details
Explore Location
Cognizant
Sydney, AUSTRALIA
(on-site)
Job Function
Financial Services
Data Engineer - PySpark & Azure
The insights provided are generated by AI and may contain inaccuracies. Please independently verify any critical information before relying on it.
Data Engineer - PySpark & Azure
The insights provided are generated by AI and may contain inaccuracies. Please independently verify any critical information before relying on it.
Description
We are seeking a highly skilled Data Engineer to join our team and help design, build, and maintain robust data solutions. This role involves working with cutting-edge technologies to develop scalable ETL pipelines and optimize big data workflows in a cloud environment.Key Responsibilities
- Design, build, and maintain scalable ETL pipelines using Apache Spark and Python.
- Optimize Spark jobs for performance, scalability, and reliability.
- Work with structured and unstructured data from diverse sources (databases, APIs, cloud storage).
- Apply a strong understanding of Data Warehousing principles.
- Implement best practices for data quality, governance, and security.
- Monitor and troubleshoot production data pipelines, ensuring high availability.
- Contribute to architectural decisions for big data platforms and cloud environments (Azure).
- Document technical designs, workflows, and processes for knowledge sharing.
- Hands-on expertise in PySpark for building and optimizing data pipelines.
- Strong experience with Azure cloud services and familiarity with big data ecosystems.
- Solid understanding of Data Warehousing concepts and best practices.
- Proficiency in SQL for querying and managing large datasets.
- Ability to work with structured and unstructured data from multiple sources.
- Knowledge of data governance, security, and quality frameworks.
- Experience in monitoring and troubleshooting production pipelines for reliability and scalability.
- Bonus Points if you have experience with Databricks and advanced Spark optimization techniques
Joining Cognizant will give you the opportunity to learn and collaborate with some of the most talented people in the industry, while having your finger on the pulse of emerging industry trends and working on the cutting edge of technology in your field of expertise.
We recognize that our people perform at their best when they feel valued as significant contributors and that is why at Cognizant, taking care of our employees is a priority:
- You can pursue innovative career tracks and opportunities here
- You can enhance your professional development through education and dedicated training
- We'll give you the skills you need to keep pace with the changing workplace while our compensation, benefits and wellness packages help you stay healthy and plan for the future.
At Cognizant, we engineer modern businesses to improve everyday life because we're dedicated to making a lasting impact. Cognizant (Nasdaq: CTSH) engineers modern businesses. We help our clients modernize technology, reimagine processes and transform experiences so they can stay ahead in our fast-changing world. Together, we're improving everyday life. See how at www.cognizant.com or @cognizant.
Job ID: 81828003
Jobs You May Like
Median Salary
Net Salary per month
$4,003
Cost of Living Index
75/100
75
Median Apartment Rent in City Center
(1-3 Bedroom)
$2,214
-
$4,547
$3,381
Safety Index
66/100
66
Utilities
Basic
(Electricity, heating, cooling, water, garbage for 915 sq ft apartment)
$117
-
$354
$203
High-Speed Internet
$43
-
$67
$53
Transportation
Gasoline
(1 gallon)
$4.62
Taxi Ride
(1 mile)
$2.69
Data is collected and updated regularly using reputable sources, including corporate websites and governmental reporting institutions.
Loading...